Department of Defense open systems based projects
implications for the contracting process
This research explores the use of the modular open systems approach (MOSA) as a method for implementing an evolutionary acquisition strategy as well as the implications of using such an approach on the contracting process. The modular open systems approach (MOSA) is identified as an enabler for the evolutionary acquisition strategy, and a brief discussion on MOSA principles is provided. The contractual implications of using a modular open systems approach is then discussed, focusing on each of the six phases of the procurement process. The research will then conclude with the identification of characteristics of a successful MOSA program procurement and resulting contract.
Modular Open Systems Approach (MOSA)
The modular open systems approach is considered an enabler to successfully implementing an evolutionary acquisition strategy. While Evolutionary Acquisition focuses on rapidly developing and producing weapon systems incrementally, with each increment providing an increasing level of operational capability, the modular open systems approach ensures access to the latest technologies and products and facilitates affordable and supportable system development and modernization of fielded assets (Defense acquisition guidebook, 2004).
Program managers implementing an open systems approach should consider the five MOSA principles listed below and described in the Open Systems Joint Task Force Guide to MOSA (Defense acquisition guidebook, 2004; OSJTF guide, 2004).
- Establish an Enabling Environment.
- Employ Modular Design.
- Designate Key Interfaces.
- Use Open Standards.
- Certify Conformance.
As program offices use these five MOSA principles to guide their implementation of a modular open system approach in their acquisition programs, the implications of these principles should permeate throughout all aspects of the acquisition process. One major area in which the MOSA strategy should have a significant influence is the contracting process. The next section of this research will focus on the various contractual documents prepared, contractual language developed, and contracting activities performed during the contracting process, as well as on the implications of using a modular open systems approach on those documents, language, and activities. This contracting process consists of the following phases—procurement planning, solicitation planning, solicitation, source selection, contract administration, and contract closeout (Garrett & Rendon, 2005).
Procurement planning is the first contracting phase and involves identifying which business needs can be best met by procuring products or services outside the organization. This process involves determining whether to procure, how to procure, what to procure, how much to procure, and when to procure. Key practice activities included within the procurement planning phase include determining the initial scope of work or the description of the product in the acquisition, conducting market research to analyze the level of technologies and types of products and services available in the marketplace, determining funds availability, and developing initial cost and schedule estimates as well as manpower resources. Developing an initial Statement of Work (SOW) and Work Breakdown Structure (WBS) are also included in the procurement planning phase. Conducting an initial integrated assessment of contract-type selection, risk management, and an initial analysis of potential contract terms and conditions is also part of the procurement planning process (Garrett & Rendon, 2005).
Market research is a critical step in the acquisition of open systems-based programs. The Federal Acquisition Regulation (FAR) states that agencies must conduct market research appropriate to the circumstances before developing new requirements documents for an acquisition by that agency and before soliciting offers for acquisitions with an estimated value in excess of the simplified acquisition threshold (FAR 10). It is during this process that the buyer determines the availability of COTS products and open systems-based products, as well as determines if these available products will meet the specified acquisition requirements. Market research activities focus on acquiring knowledge of current market practices, technologies, capabilities, products, and future trends in areas related to the acquisition. Given the objectives of using a modular open systems approach, market research is extremely critical in leveraging commercial investment, enhancing access to cutting-edge technologies and products and increasing competition. Market research should also be used in an open systems-based acquisition to determine the capabilities of contractors to use open systems approaches and to comply with contractual requirements for using open systems approaches. A market research technique is the benchmarking of industry best practices related to the development and use of open systems in product development (Garrett & Rendon, 2005).
Industry conferences are also used for obtaining industry knowledge related to the development of the solicitation (as well as the acquisition in general). Industry conferences can provide valuable information in the areas of state of technologies and market practices concerning the use of open systems and the development of open systems architectures in product development and acquisition. Industry conferences serve two main purposes—to inform industry about the technical requirements and acquisition planning of the program and to solicit industry inputs for the pending program (Office of the Undersecretary of Defense (AT&L), 2005).
Request for Information
Requests for Information (RFIs) are used as a market research technique for the purpose of gathering information from industry to be used in planning an acquisition. Government agencies typically use RFIs as a source of information for understanding, developing, defining and refining the acquisition requirement. It should be noted that RFIs are not solicitation notices, nor do they commit the government to issuing a solicitation or even continuing with the acquisition. RFIs are also used as a method for identifying potential offerors for an upcoming acquisition. These types of RFIs are also known as Sources Sought Synopses. Given the objectives of managing an acquisition using a modular open systems approach, RFIs, along with other market research techniques, are extremely valuable for acquiring knowledge of current market practices, technologies, capabilities, products, and future trends in areas related to the acquisition. This information will effectively support the MOSA objectives of leveraging commercial investment, enhancing access to cutting edge technologies and products, and increasing competition. RFIs can be effective in determining the capabilities of contractors to use open systems approaches and to comply with contractual requirements for using open systems approaches. RFIs can also provide information on a potential offeror's past performance in integrating technical and management processes in prior programs (Office of the Undersecretary of Defense (AT&L), 2005).
The second phase of the procurement process is Solicitation Planning, which involves the process of preparing the solicitation documents needed to support the acquisition. This is a critical phase of the procurement process since it is during this phase that the work statements, specifications and other exhibits, standard terms and conditions, as well as special contract requirements are developed, revised, and finalized. Key practice activities within the solicitation planning process include using standard procurement forms and documents such as solicitation templates, model contracts, specifications and item descriptions, solicitation provisions, and contract terms and conditions (Garrett & Rendon, 2005).
The solicitation for an acquisition program using an open systems approach will require specific language unique to the use of a modular open systems approach. Thus, the procurement documents that make up the solicitation should incorporate the specific language that reflects the preference or mandated use of a modular open systems approach in the acquisition program. Section C (Description/Specification/Statement of Work), Section L (Instructions, Conditions, and Notices to Offerors or Respondents), and Section M (Evaluation Factors for Award) are the primary parts of the solicitation that are influenced by the particular engineering approach to the acquisition program. These sections are the core of the solicitation and directly influence the offeror's proposal and the resulting contract.
System Performance Specification
A critical Section C document is the performance specification. The system performance specification defines the government's performance requirements for the system and should reference any industry and approved military specifications and standards. Typically, the system performance specification in the solicitation is considered a “preliminary system performance specification,” and the offeror responds to the solicitation with a formal system performance specification in its proposal. The solicitation must be clear in delineating whether the government will consider offeror-proposed revisions to the preliminary performance requirements that may be cost effective. The offerors run the risk of being declared non-responsive to the solicitation for proposing revised performance requirements (Office of the Undersecretary of Defense (AT&L), 2005). In acquisition programs using a modular open systems approach, the system performance specification plays a critical role in communicating the government's requirement for communicating “openness” and delineating requirements for open systems. Typically, the performance specification is developed using the requirements document that was the basis for initiating the acquisition. These requirements documents, such as the Operational Requirements Documents (ORD) or Capability Development Document (CDD), will be extensively used in developing the performance specification.
Statement of Work
Another critical document in Section C of the Solicitation is the Statement of Work (SOW). Traditionally, the government has used a SOW in its major acquisition programs. The solicitation Statement of Work (SOW) describes the actual work to be done by means of specifications or other minimum requirements, quantities, performance date, and requisite quality (Garrett & Rendon, 2005). The offerors propose their management, technical, and cost approach to meeting the requirements of the SOW in their proposal. Already a critical part of the solicitation package, the SOW takes on even more of a significant role in an acquisition using an open systemsbased approach. In these acquisition programs, the SOW must be clear and concise in communicating the requirements that contractors must comply with in terms of meeting open systems standards and incorporating open system components in the development of the total system. The SOW in solicitations and resulting contracts for acquisition programs using an open systems approach is a critical tool for delineating the contractor's requirements and responsibilities in performing the contract.
Statement of Objectives (SOO)
The SOO is a government-prepared document incorporated into the RFP that states the overall objectives of the solicitation. Typically, the SOO is a very short document, usually under 10 pages, that clearly delineates the program objectives and the overall program approach of the acquisition. The purpose of the SOO is to provide the maximum flexibility to each offer to propose an innovative development approach (Garrett & Rendon, 2005). The offerors respond to the government's SOO with a SOW providing the details of its proposed management, technical, and cost approach for delivering the requirements of the acquisition. Therefore, instead of the government developing the SOW with detailed instructions and requirements, the government provides the SOO with only the top level objectives of the acquisition; the offerors then respond with the proposed detailed approach in their SOW. Thus, the use of the SOO by the government encourages offerors to propose innovative approaches and flexible design solutions (Meyers & Oberndorf, 2001). With this in mind, it can be clearly seen how SOOs definitely support the use of a modular open systems approach acquisition program.
Instructions to Offerors
In addition to the documents in Section C of the Solicitation, such as the System Performance Specification, SOO/SOW, and Contract Deliverables Requirements List (CDRL), specific language should also be included in Section L of the solicitation as well. Section L provides the Instructions to the Offerors (ITOs) for developing the proposals in response to the solicitation. Section L of the solicitation specifies the format and content of proposals, as well as information or proposal preparation instructions that are not included elsewhere in the solicitation (Engelbeck, 2002). Acquisitions using a modular open systems approach have a critical need for providing specific instructions to offerors concerning the development of proposals and the offeror's adherence to the use of open systems in the development process. Typically, the ITOs reference other documents in the solicitation package such as system technical architecture requirements and design guidance and standards for open architectures. The ITO typically specifies the factors to be used in the proposal evaluation phase of the source selection. These evaluation factors are traditionally categorized as technical, cost, and management. In acquisitions using a modular open systems approach, usually the technical evaluation factor specifies the ITO requirements related to the acquisition's open-systems requirements.
Solicitation is the third phase of the procurement process and is the process of obtaining bids and proposals from prospective sellers on how to meet the objectives of the project. The solicitation phase is critical to the overall acquisition strategy because it is this phase that executes the procurement planning strategy for a full and open competition or a sole source procurement. Some key practice activities within the Solicitation phase include conducting market research and advertising to identify new sources of supplies and services for the purpose of developing a list of interested offerors (Garrett & Rendon, 2005). These offerors will receive the solicitation requesting the proposal. Another key practice activity in the Solicitation phase includes conducting a pre-solicitation or pre-proposal conference to ensure that all prospective contractors have a clear, common understanding of the technical and contractual requirements of the acquisition (Garrett & Rendon, 2005).
Typically, the process of issuing a solicitation and then later amending the solicitation to incorporate corrections, updated specifications, and revised language results in an extended and prolonged acquisition schedule. One of the goals of the solicitation process is to develop and structure a current and complete solicitation that will result in accurate, complete, and competitive proposals from prospective contractors in the shortest amount of time. The use of Draft RFPs has become a proven best practice in the solicitation planning process (Garrett & Rendon, 2005). Issuing a Draft RFP to interested offerors allows for additional industry feedback on any aspect of the proposed acquisition. With this “early and up-front” feedback from interested offerors to the contracting office, the contracting office can continue to improve and enhance the solicitation while it is still being developed, thus saving time and shortening the acquisition schedule.
In developing a procurement strategy for an acquisition program, the traditional options include conducting a full and open competition or a sole source procurement. The benefit of full and open competition includes obtaining quality goods and services at a fair and reasonable price. Allowing all responsible offerors to compete also allows the government to leverage the forces of the marketplace to include leading technologies and innovative management approaches in developing solutions. Obviously, the benefits of pursuing a full and open competition fully support the objectives of managing an acquisition program using an open systems approach. Since the underlying concepts of an open systems-based acquisition focus on the ability to insert cutting-edge technology as it evolves, the commonality and reuse of components among systems, the enhanced access to emerging technologies and products from multiple suppliers, the increased ability to leverage commercial investment, and an increase in competition, it would seem appropriate to pursue a full and open competition strategy for the acquisition.
A unique procurement strategy is the use of a “rolling down-select” procurement strategy approach. In this approach, a full and open competition is initially conducted, and multiple contracts are awarded. These contracts are typically used early in the acquisition lifecycle, such as for the development of preliminary designs. Once the designs have been submitted and evaluated, a down-select of the initial contractors to a single contractor is conducted for the development and production of the actual system. The acquisition strategy may involve multiple “down-selects,” depending on how many evaluation phases the buyer desires. For example, there may be an initial full and open competition for conceptual development contracts, a down-select to a smaller number of the original contractors for preliminary designs, another down-select to even a smaller number of contractors for prototype development, and finally, a final down-select to a single contractor for full development and production of the actual system.
Source Selection is the fourth phase of the contracting process and involves the process of receiving proposals and applying evaluation criteria to select the contractor. Key practice activities within the source-selection process include using evaluation criteria focusing on management, technical, and cost, tailoring the basis for award to either lowest cost/technically acceptable or best value, and taking into consideration an offeror's past performance in evaluating proposals (Garrett & Rendon, 2005).
Section M of the solicitation specifies how the buyer will evaluate the factors identified in the Instructions to Offerors (ITO) in Section L. These evaluation factors are traditionally categorized as technical, cost, and management. In acquisitions using a modular open systems approach, it is usually the technical evaluation factor that specifies the ITO requirements related to the acquisition's open system requirements. The relationship between cost and non-cost factors (such as quality, technical, and past performance), as well as how they will be used in the source-selection decision, are described in Section M. The two major evaluation strategies are Lowest Price/Technically Acceptable (LPTA) or best value. In an LPTA source selection, the offeror proposing the lowest price, technically acceptable offer will be awarded the contract. However, in a best-value source selection, the contract award may be made to “other than the lowest priced, technically acceptable offeror,” based on a trade-off among cost, technical, and past performance factors. The use of the best-value evaluation strategy is appropriate for acquisitions that involve requirements that are less definitive, require more development work, or the acquisition has greater performance risk, and where more technical or past performance considerations play a dominant role in the source-selection decision (FAR, 15.101). Obviously, an acquisition that involves the use of a modular open systems approach in the development of the system would involve a less definitive requirement, require more development work, have greater performance risk, and involve more technical or past performance considerations playing a dominant role in the source-selection decision. Thus, the use of a best value evaluation approach is desired for these types of acquisitions (Meyers & Oberndorf, 2001).
Once the contract is awarded, the government and contractor relationship then shifts to a performance measurement and management focus in which the government manages the contractor's performance to ensure that acquisition objectives are achieved. One way of ensuring the contractor meets these acquisition objectives is through the use of appropriate contract types and contract incentives, which are administered during the contract administration phase of the acquisition. This is discussed in the next section of this report.
Contract Administration is the fifth phase of the contracting process and entails managing the relationship with the contractor and ensuring that each party's performance meets the contract requirements. During contract administration, the government's focus is on managing the contractor's cost, schedule, and performance. Key practice activities within the contract administration process include using an integrated team approach for monitoring the contractor's cost, schedule, and performance, and having an established process for administering incentive and award-fee provisions (Garrett & Rendon, 2005). These incentives and award fees are tools used to motivate and incentivize the contractor to meet specific performance standards of the contract.
The biggest challenge in using incentive contracts and award fee/term contracts is the ability to structure an effective incentive tool that will successfully motivate the contractor to perform in specified areas and exceed the performance requirements. It is particularly important to structure appropriate incentive arrangements that will result in the contractor applying additional emphasis in the areas important to the government. In acquisition programs using a modular open systems approach, the government will want to incentivize the contractor to meet higher levels of “openness” in the design and development of the system.
Acquisition programs using a modular open systems approach are challenged with incentivizing the contractor to achieve the required levels of “openness” by meeting or exceeding the technical requirements of the contract, as well as cost and schedule requirements. The Award Fee type of incentive has been traditionally used for motivating the contractor to excel in technical performance. All of the programs referenced in conducting this research used the Award Fee process as a tool for incentivizing the contractor to achieve a certain level of openness in the design and development of the weapon system
A new type of incentive tool that is currently very successful is the Award Term incentive. Award Term is similar to Award Fee; it differs only in that an Award Term contract ties the length of the contract's period of performance to the performance of the contractor. Contractors with good performance may have the term of the contract extended, or contractors with poor performance may have the contract term reduced (Garrett & Rendon, 2005).
The selection of contract types and contract incentives requires careful planning, implementation, management, and measurement to ensure its success in incentivizing contractors and improving performance (Garrett & Rendon, 2005). Programs that are encouraging the use of a modular open systems approach in the development of the system should incorporate Award Fee and Award Term incentives. This is especially true when a Statement of Objectives (SOO) is used to describe the government's required outcomes and overall objectives and when the contractor has the flexibility to be innovative in proposing its management and technical approach towards meeting those outcomes and objectives.
The final phase of the contracting process is Contract Closeout. Contract Closeout is the process of verifying that all administrative matters are concluded on a physically complete contract. This involves accepting final deliveries and making final payment to the contractor, as well as completing and settling the contract and resolving any open items. Key practice activities within the contract closeout phase include using checklists and forms for ensuring proper documentation of closed contracts and maintaining a “lessons learned and best practices” database for use in future contracts and projects (Garrett & Rendon, 2005). The contract closeout phase is often forgotten and has traditionally been considered an administrative burden or relegated to a clerical or non-essential task. An important aspect of completing and closing out the contract is conducting a final evaluation of the contractor's performance on the contract in terms of meeting cost, schedule, and performance objectives. This final contractor evaluation will be used as a past-performance evaluation of the contractor in future contract competitions and source selections.
As previous stated, contractor past performance is a critical evaluation factor for major source selections and is listed as an evaluation factor under Section M of the solicitation. Ensuring the final contractor performance evaluation is completed during the contract closeout process is critical in ensuring that information is available for use in a future source selection. In acquisitions using a modular open systems approach, a critical proposal evaluation factor listed in Section M of the solicitation should be the contractor's past performance and recent experience in working in an open systems approach environment. Past performance is a mandatory proposal evaluation criterion for major source selections in accordance with FAR 15.304. The Department of Defense (DoD) uses the Contractor Performance Assessment Report (CPAR) to conduct periodic and final evaluation of the contractor's performance. Systems engineering is a major contractor past-performance assessment element, and the CPAR should be used to evaluate the contractor's adherence to open systems standards and MOSA requirements on open systems-based acquisitions. Using the CPAR evaluation tool, the government can document excellent or poor contractor performance in terms of meeting contract “openness” requirements, and this documentation can then be used in future source selections (Office of the Undersecretary of Defense (AT&L), 2005).
The research identified the following characteristics of a successful MOSA program procurement and resulting contract: Early involvement and participation of industry in the development of requirements and acquisition strategy; shared roles between the government and contractors in the development of the system specification and statement of work; the use of a best-value contract strategy consisting of the evaluation of offeror's technical, schedule, and past performance, as well as the offeror's cost and management approach; the use of a contract structure consisting of contractor incentives for meeting higher levels of “openness”; the documentation of contractor's past performance in meeting “openness” requirements, as well as the documentation of lessons learned and best practices on open systems.
Defense acquisition guidebook (Version 1.0). (2004, October). Retrieved from http://akss.dau.mil/dag/. Engelbeck, R.M. (2002). Acquisition management. Vienna, VA: Management Concepts, Inc.
Federal acquisition regulation (FAR). Retrieved from http://farsite.hill.af.mil/VFFARA.HTM.
Garrett, G.A. & Rendon, R.G. (2005). Contract management: Organizational assessment tools. McLean, VA: National Contract Management Association.
Meyers, B.C. & Oberndorf, P. (2001). Managing software acquisition: Open systems and COTS products. Upper Saddle River, NJ: Addison-Wesley.
Office of the Undersecretary of Defense (AT&L). (2005). DRAFT. Guide for contracting for systems engineering. Washington, DC
Open systems joint task force (OSJTF) program manager's guide: A modular open systems approach (MOSA) to acquisition. (2004, September). Retrieved from www.acq.osd.mil/osjtf.
This is an abbreviated version of the complete research report. The complete research report may be accessed from the NPS Acquisition Research Program website www.acquisitionresearch.org.
© 2006, Rene G. Rendon
Originally published as a part of 2006 PMI Global Congress Proceedings—Seattle Washington
What’s your PMTQ? Our Pulse of the Profession® research shows that organizations that combine technical skills with project management approaches drive more successful outcomes.