| FAST HOME | HELP | WHAT'S NEW | COMMENTS | SEARCH |
| GUIDANCE | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Procurement Guidance / T3.2.2 Source Selection
(Revised 07/2003)
A. SOURCE SELECTION 1. Public Announcement and Announcement of Competing Offerors All procurements over $100,000 must be publicly announced on the Internet or through other means. If the Internet is used, as a minimum the announcement should be placed on the Contracting Opportunities page contained in the FAST. This requirement does not apply to emergency single source actions, purchases from an established QVL or FSS, exercise of options, or changes. For actions under $100,000, a public announcement is optional. (Added 12/99) Publicizing the names of offerors competing for FAA contracts can be a method of encouraging small businesses to seek subcontracting opportunities with potential FAA contractors. When appropriate, the Contracting Officer (CO) may publicly announce names and addresses of offerors responding to a screening information request. Also, the CO, after making a down select decision, may announce names and addresses of offerors remaining in the competition leading to award provided the SIR includes a notice to the offerors and no offeror objects to the release of this information. 2. Past Performance (Revised 10/2002) a. General. This guidance on past performance can aid in selecting the contractor who is most likely to perform satisfactorily. To select a high quality contractor, commercial firms generally rely on information about a contractor's past performance as a major part of the evaluation process. In the past, the FAA has successfully used past performance as a factor in evaluating the likelihood of success of offerors, and the Acquisition Management System (AMS) encourages integrated product teams/product teams (IPT/PTs) to continue this practice for all procurements, where appropriate. This guidance discusses how past performance can be used as an effective tool in selecting the contractor who is most likely to perform satisfactorily. b. Instructions for Using Past Performance in Screening Information Request (SIR). (1) General Considerations. Key to the successful use of past performance, and any factor, in the screening process is the establishment of a clear relationship between the statement of work (SOW), the instructions to offerors, and the evaluation criteria. Past performance information that is not important to the current acquisition should not be included. Therefore, the factors chosen for evaluation should be directly related to the requirements in the SOW. They should be reasonable, logical, and coherent. For instance, there would be no point in considering poor subcontract management if there were no subcontract management needed on the contract. On the other hand, if there were a significant amount of software development, it would certainly be important to know the offeror's record with regard to estimating lines of code, providing software builds on time with few errors, and accomplishing the effort within the estimated cost. (2) Responsibility Determination. Where appropriate, the SIR should state that past performance would be used to evaluate the responsibility of the contractor, and as an evaluation factor. A contractor with a record of unsatisfactory past performance should be screened out of the selection process as part of the responsibility determination. If a contractor's past performance record passes the responsibility determination, then the record should be compared to the other responsible offerors to determine the offeror that provides the best value to the government. (3) Past performance as a Separate Non-Cost/Price Factor. It is best to include past performance as a stand-alone factor, as opposed to integrating it with other non-cost/price factors. Making it distinct and identifiable will reduce the chances of its impact being lost within other factors and should make evaluation easier. The relative importance of past performance compared to price or cost and any other evaluation factors is left to the broad discretion of the IPT/PT as is the source and type of past performance information to be included in the evaluation. (4) How to Weigh Past Performance. Past performance should be ranked to ensure that it is meaningfully considered. To be meaningful in the screening process (and to ensure that offerors are aware that actual contract performance will be a significant factor in future awards), it is recommended that past performance normally be at least equal in significance to any other non-cost evaluation factor. Generally, if a numeric weighting system is used, past performance should be rated at 25 percent or more. For example, if there were five non-cost evaluation factors including past performance, then any of the following examples of weightings or relative importance would suffice: Past performance at 25 percent with the other four factors rated at 18.75 percent each (75/4=18.75) Past performance at 25 percent, technical excellence at 25 percent, management at 20 percent, the other two factors at 15 percent each All five factors rated at 20 percent Technical approach rated at 30 percent, past performance rated at 30 percent (to equal the highest rated other non-cost factor), management at 20 percent and the other two factors rated at 10 percent each Technical capability and past performance are considered equal in importance followed by test and evaluation, logistics management, and subcontract management in descending order of importance (5) Non-Relevant Contract Experience/New Contractors. The SIR should state whether new contractors, or contractors with non-relevant contract experience will be considered, or rated negatively. For example, if the offeror has a performance history on non-relevant contracts, i.e., prior government or commercial performance record, but not specifically on the type of work solicited, this information might be used to demonstrate management potential. New contractors may have key management and/or technical/scientific personnel proposed for the contract that have some relevant experience. An evaluation of the performance of the proposed key personnel on relevant contracts can be used, as appropriate, as part or all of the past performance evaluation. In addition, teaming relationships and subcontractors can enhance the capability of potential offerors to perform, depending on the relationships that exist within the teaming process. (6) Time-frame, Size, Scope, Complexity. The SIR should ask the contractor for references for ongoing or contracts completed within a specified period of time. A period of three to five years is considered reasonable, depending on the particular circumstances. For small dollar contracts where there are many actions and contractors that provide the products or services, a shorter period may by appropriate. Offerors may attempt to "cherry pick" references to provide selected information on past history. To minimize this, the IPT/PT should attempt to gather past performance history from sources other than those provided by the offeror. Such sources might include the National Institutes of Health (NIH) Contractor Performance System (CPS) data base for On-Going Efforts, other agency contracting personnel, listings of contract awards posted on the FAA Announcement Data Base and in the Commerce Business Daily. All on-going or completed contracts performed during the identified period, or the last "X" contracts performed by the entity within the identified period should be sought. It is recommended that the instruction to offerors ask only for a list of the previous contracts and contact points and for a description of any quality awards earned by the offeror. It is not necessary to burden the process by asking that the offeror prepare a description of its past performance history in the proposal. The IPT/PT should request references for contracts that are similar in size, scope and complexity to the statement of work in the SIR. Each of these terms should be defined in the SIR to alert the offeror to the type of data that is required. (Revised 10/2002) (7) Discriminators/Sub-factors. (a) Attention should be paid to what discriminates a "good" performer from a "poor" performer for the type of work that will be performed on the specific acquisition. Past performance sub-factors should be shaped by those discriminators, be limited in number, and should be tailored to the key performance criteria in the statement of work (SOW). For certain prime contracts, the ability to manage subcontracts, or software development capability may be important discriminators. The following are some other examples of sub-factors that may be used to evaluate past performance: Quality, timeliness, cost control, business practices, customer satisfaction, key personnel, and/or quality awards and recognition. (b) The sub-factors in the SIR should reflect the questions to be used in interviewing references or reviewing any written evaluations provided by the references. For example, sub-factors with corresponding questions under business practices could include: Management Responsiveness - Is the offeror cooperative, business-like and concerned with the interests of the customer? Contract change proposals - What is the contractor's history on contract change proposals? This includes, changes that lower the overall cost or improve performance - timely and accurate proposals for equitable adjustments - changes that have been withdrawn or dismissed as invalid. (8) Relative Importance. The SIR should state whether all sub-factors are relatively equal, or whether certain sub-factors are more important than others. For example, on a contract where most of the work is done for end users and it is difficult for the contract administration team to observe the contractor's performance in a cost-effective manner, significant weight might be placed on customer (end user) satisfaction ratings from the references. (9) Major Subcontractors. If major subcontractors are likely to perform critical aspects of the contract, the IPT/PTs should evaluate the past performance of these subcontractors to determine the overall likelihood of success of the prime contractor performing the contract. The SIR should state how such information will be evaluated. (10) Affiliates, Divisions, etc. For large organizations with many divisions, it is realistic to consider the past performance of the affiliate, division, etc., that will perform the actual work. In making such decisions, however, an IPT/PT must consider the degree of control that a parent organization will exert over the affiliate. If a parent organization has an excellent or poor performance record and the affiliate is going to be closely controlled and managed by the parent, then the IPT/PT should consider the parent organization's performance record in making the performance evaluation. (11) Number of References. It is important to ask for at least two references for each contract (program/technical and contracts) to assure that all aspects of the offeror's performance will be discussed. The name of the organization providing the report should be released to the offeror; however, the names of individuals should generally not be released without the individual’s consent. (12) Use of Other Sources. The instruction to the offerors should include a statement that the government may use past performance information obtained from other than the sources identified by the offeror, and that the information obtained may be used for both the responsibility determination and the best value decision. For each non-Federal reference, the SIR should include an authorization to release information. (13) Inclusion of Survey Form. The survey form need not be included as an attachment in the SIR. However, if the IPT/PT elects to release the questionnaire, the SIR should note that the questions to be asked will not be limited to those on the questionnaire. (14) Sample SIR Provisions. Appendix Sample 1 contains examples of SIR provisions as well as an example client authorization letter. The example should not be viewed as the only way to include past performance in the SIR. Each SIR must contain instructions and evaluation information that best reflects the individual acquisition. c. Evaluating Past Performance. (1) Applicability. Past performance is one measurement of an offeror’s ability to perform. (2) Relation to SIR. Relation to SIR. Instances of performance, both good or poor, should be noted and related to the SIR requirements. If problems were identified on a prior contract, the role the sponsor may have played in that result should be taken into account. Evaluations should consider the number and severity of problems, the demonstrated effectiveness of corrective actions taken (not just planned or promised), and the overall work record. (3) Disclosure of Negative Information. If the IPT/PT receives negative information that will have a significant impact on the likelihood of award to an offeror, the IPT/PT should disclose the information and provide an opportunity to respond. This is true even if the SIR states that award may be made on initial offers. Therefore, the SIR should include the appropriate provisions notifying the offerors that the FAA retains this option. (4) Current Versus Older Performance. The age of the performance being evaluated may be weighted so that performance on older contracts receives less weight than performance on more recent contracts. More weight may be given to those evaluations on prior FAA or federal contracts as opposed to contracts with states/local governments or private parties or to prior contracts of a similar nature to the SIR. (5) Method of Scoring. The final past performance rating may be reflected by a color, a number, adjectival, or a combination of these methods, depending upon what system is being used overall to indicate the relative ranking of the offerors. A past performance rating is not a precise mechanical or scientific process and must include sound business judgment. Therefore, the documentation of the final rating should include a logical description of the underlying reasons for the conclusions reached. (6) Evaluating Disputed/Negative Information. When the IPT/PT receives negative information, or information that is disputed, the IPT/PT should carefully consider the offeror’s response and determine what weight to apply, based on the facts obtained from the questionnaire, interview, or other sources. The file should be documented to explain why the IPT/PT assigned a particular rating. This is especially important in situations involving unresolved disputes. d. Obtaining Information on an Offeror’s Past Performance. (1) Applicability. There are various methods of obtaining information on a contractor’s past performance. (2) Reference Checks. The most commonly used method of obtaining past performance is to conduct reference checks from a variety of sources, including previous FAA program and contracting personnel, other federal agencies, state and local governments, and commercial contractors. (3) Other Sources. Dun & Bradstreet has the capability to obtain information on past performance on specific contractors for the FAA at a cost identified in the Federal Supply Schedule under contract number GS-22F-9614D. In lieu of the FAA paying for the report, the SIR may require offerors to provide a copy of a recent past performance report prepared by Dun & Bradstreet. In this case, the offerors would see the report and have an opportunity to resolve any disputed data before the report is submitted to the FAA. Using this process could save time and money, but should not be relied on as the only source of data. Quality certifications and awards can also serve as a useful source of past performance information. (4) Timetable. The process of collecting information should begin as soon as the proposal evaluation commences to prevent delays in the selection process. The collection of information can be time consuming inasmuch as researchers must locate and question sources of information, either in person, by telephone or in writing. Obtaining this information as early as possible in the evaluation process gives the IPT/PT invaluable information in determining the viability of the individual offerors. In addition, if the information shows a history of poor performance, the IPT/PT can eliminate the proposal from the competition as non-responsible. It may be best to establish a team devoted entirely to this task during the screening, especially if the FAA anticipates receiving a large number of proposals. (5) Questionnaire or Survey Form. The first step in obtaining information from sources is to develop a questionnaire, or survey form, which reflects the evaluation rating system that will be used to assess the offerors strengths and weaknesses for the contract being considered. Questions should be worded so that interviewees understand precisely what they are being asked to describe. In order to maintain accurate records and facilitate verification, the questionnaire (survey) record form should include: Interviewer’s name, company name, reference’s name (to be held in confidence), full mailing address and telephone number, date and time of the call, and description of the contract effort discussed. Examples of questionnaires suitable for a contract requiring system development and production are provided in Appendix Sample 4. A sample Business Management Past Performance Questionnaire is included in Appendix Sample 3A. (6) Information CollectionInformation Collection. Once the questionnaire is prepared, references should be contacted. For all interviews, the questions should be stated to the interviewees exactly as on the questionnaire. There are various ways to collect the information: Face-to-face interviews, mailing the questionnaires to the references, telephone interviews using the questionnaire, using interactive electronic mail (ensuring security measures are taken), and using some combination of the above. (7) Number of references. At least two references should be contacted on each previous contract effort. As pointed out in Chapter 3, this should be specified in the instruction to offerors. Additional references may often be identified during the interviews. It is also important to survey reasonably large numbers of references in order to look for patterns in their description of performance - individual ratings may be personal and biased. Numerous ratings can show patterns and are therefore much more likely to be a valid indicator. (8) Setting Up Interviews Setting Up Interviews. Being well organized and efficient is important when conducting the interview so as not to waste the interviewee's time. It is helpful to call the reference to make an appointment to conduct an interview, rather than telephoning the references unannounced, thereby catching them unprepared or with little time to respond. If possible, the questionnaire should be mailed or faxed to the reference in advance of the appointment. Interviewers should take copious notes on the questionnaire to ensure that all information is captured. Tape recording is a good means for capturing all of the conversation, however, tape recording the conversation may cause the interviewee discomfort and reduce the amount of information provided. If tape recording is used during the interview, ensure the interviewee is aware of and agrees to the use of recording devices. (9) Conducting Interviews. Evaluators should look for patterns of either favorable or unfavorable overall performance, rather than focusing on individual successes or failures. It is important to look for actions that demonstrate high performance and not just unfavorable performance. This will help to get away from the old responsibility determination mode of just looking at performance problems. There appears to be a tendency for references to give an upward bias to ratings. Therefore, the interviewer should ask enough questions to discriminate between "good" and "excellent." Evaluators should request any existing documentation in support of excellent or negative findings (i.e., correspondence, modifications, determinations, etc.). Investigating negative findings in-depth prior to presenting them to offerors, in discussions if held, will alleviate unnecessary delays. Prior to concluding the interview, the evaluator should ask the reference for a summary opinion, e.g., how would the interviewee rate the contractor's overall performance and would the interviewee like to do business with the contractor again? (10) Concluding Telephonic and Face-to-Face Interviews. Immediately following a telephonic or face-to-face interview, the interviewer should prepare a narrative summary of the conversation and send it to the reference for verification, preferably by certified mail, return receipt requested, fax, or electronic mail. (This can be the questionnaire as filled in by the interviewer.) The narrative should state explicitly that if the reference does not object to its content within the time specified, it will be accepted as correct. If the reference indicates that the narrative is incorrect, then a corrected narrative should be sent for verification. If a reference will not agree to the record and satisfactory corrections cannot be agreed upon, the record cannot be relied upon and should not be included in the offeror's rating. Another source may provide the same information, however. (11) Mailing Questionnaires. If mailing questionnaires is the chosen method for collecting past performance information, mail the questionnaires to the references, provide a time-frame for return of responses, and wait for the responses. If mailed questionnaires are not received in a timely manner, follow-up telephone interviews are suggested. (Following guidance above if telephonic interview occurs.) e. Past Performance Data Base for Ongoing Efforts. (1) NIH Contractor Performance System (CPS). ASU-100 will serve as the FAA liaison to NIH. The CPS will contain performance information on current and previous federal contractors. In general, evaluations should be completed for complex procurements and any procurements identified by the IPT/PTs. These records are for the use of IPT/PTs in screening offerors and assessing the probability of success based upon the offeror’s past record as an FAA contractor. Upon request, the FAA may also supply past performance information to personnel of other government agencies that are evaluating offerors who have performed on FAA contracts (see B.9., Release of Information). (Revised 10/2002) (2) Sample Contractor Performance Report. Included as Appendix Sample 3B is a sample Contractor Past Performance Questionnaire. The description of the sub-factor may also be helpful in preparing questionnaires for verifying source selection information. This form is not intended to represent the only method for evaluating a contractor’s performance on an FAA contract. IPT/PTs that believe other mechanisms would permit more cost-effective evaluation of contractor performance are encouraged to pursue them. (3) Creation and Disposition of Records. Evaluations should be prepared at the completion of contract performance and annually by the anniversary date of the contract, and, if appropriate, after a significant event on a contract or a change in program management or Contracting Officer. Evaluations should generally be prepared by the IPT/PT. The evaluations should be shared with the contractor, and the contractor should be permitted to provide written comments. IPT/PTs should review and resolve contractor’s comments, if requested, by the contractor. Copies of the evaluation, the contractor's response, and review comments, if any, should be marked as "source selection information" and retained the contract file. A summary of evaluation information should be entered into the CPS for future reference. As use of the CPS become common throughout the FAA, SIRs will need only to ask offerors to provide a list, in the proposal, of past contracts that they have performed that were similar to the potential contract. The need for a section in the proposal on the offeror's past performance may not be necessary. Evaluation files from CPS government references will provide much, if not all, of the information necessary to evaluate the offeror on past performance. The need for IPT/PTs to conduct extensive interviews with the contract administrators, or conduct other investigations to verify a offeror's past performance should be greatly reduced. Because the contractor will have been offered the opportunity to comment on the ratings as they were prepared, further comment in the proposal or during discussions, if held, will usually not be necessary. (Revised 10/2002) f. Completion of the Performance Evaluation. (1) Responsibility. The development of the performance evaluation is the responsibility of the IPT/PT. Where the contract provides products or services to end users (persons outside the requiring technical organization), the contract’s administrator is responsible for conducting surveys of these customers and including a summary of the end user ratings in the performance evaluation. This is referred to as the Report Card System on past performance. (2) When to Perform Surveys. End user surveys would apply to computer services contracts, major systems maintenance contracts where work is done in the field, routine services contracts such as janitorial or food service, as well as contracts where products are delivered directly to various sites or where performance cannot be measured until the product is used. Evaluations are required at the time the work under the contract is completed, or work is terminated for convenience or default, or when a decision is made by the IPT/PT not to extend the terms of the contract based upon performance issues. Performance evaluations should be conducted during the contract period of performance in order to provide useful feedback to contractors on their performance and to provide them the opportunity to correct problems before contract completion. The contract file should reflect efforts on the part of the government to provide the contractor with the results of these evaluations. An honest discussion of any contractor problem areas is important to the government which is seeking quality service and equally, if not more so, to the contractor. g. Rating Areas. (1) The sample Contractor Past Performance questionnaire in Appendix Sample 3B may be used by IPT/PTs for evaluating contractors performing on FAA contracts. The description of the sub-factors may also be helpful in developing questionnaires to evaluate past performance during the source selection process. The following areas are some examples of areas to be rated for past performance: Quality, timeliness, cost control, business practices, customer satisfaction, key personnel, and awards and recognition. (2) As pointed out earlier, these are the basic induce of past performance, but other factors such as management of subcontractors or software development capability may be important discriminators for certain contracts. (3) Quality, Timeliness, and Cost Control. Three of the areas, quality, timeliness and cost control, can be rated objectively by members of the IPT/PT. The ratings should reflect how well the contractor complied with the specific contract performance standards for each area. How well the contractor holds up its end of the bargain can, and should, be an essential consideration for future business consideration. The comments should be concise, but provide answers to questions about the performance that would be asked by an evaluator. Here are a few examples: The contractor-provided software met all contract performance requirements for ease of use and output. The financial system package actually exceeded expectations in its speed and accuracy. The contractor met all contract milestones for development and field installation of the systems. Some internal contractor management milestones were missed, but timely identification of problems and corrective actions kept the program on schedule. The contractor's cost management was excellent and resulted in a 2 percent under-run from target cost. (4) Business Practices. Business practices should be evaluated to measure the contractor's customer relations efforts as well as how well the contractor worked with the Contracting Officer and technical representative(s). It is important to note that when dealing with the FAA, there is more than one customer. Accordingly, this rating area evaluates the business practices between the contractor and the contract administration team. This rating should be developed by the IPT/PT. Questions to ask might be as follows: How cooperative was the contractor in working with the government to solve problems? Were contractor-recommended solutions effective? Was the contractor responsive to the administrative issues of the contract? Did the contractor exhibit a propensity to submit unnecessary contract change proposals with cost or price increases? (5) Customer Satisfaction. Customer satisfaction measures the interface with the ultimate end user of the product or service, e.g., the Personal Computer user who needs assistance under a computer services contract, or the person who uses a supply item to complete their work. A contract cannot be considered a success unless the end user is satisfied. After all, support of the end user is the reason for every contract. Accordingly, effort should be made to ascertain whether each customer was satisfied, for satisfaction by one does not necessarily mean satisfaction by all. The best way to measure contractor performance at the end-user level is the customer satisfaction survey. The quality assurance plan prepared to administer a contract should contain the procedures for receiving customer feedback on contractor performance. This can be done through telephone calls by the Contracting Officer Technical Representative (COTR), use of written survey forms, complaint boxes in strategic locations, or other means of measuring end user satisfaction. If it is not cost effective to survey all end users, then a random sample should be selected for the survey. If the IPT/PTs does not have resources, they may be conducted through contracted services. End-users may be unfamiliar with the contract requirements and may hold contractors to an unrealistic standard. The Contracting Officer should evaluate the end users comments to determine if the contractor reasonably tried to meet their demands within the contract requirements. If the contractor met or exceeded contract requirements in an attempt to please the end users, this should be noted on the evaluation form, even if the end users were not totally satisfied with the service. In this case, it may well be that the service for which the FAA has contracted is not the service desired or needed by the customer. An evaluation of the contract requirements should be undertaken with input from the end users. However, IPT/PTs are reminded that FAA does not have any right to require, explicitly or implicitly, or expect benefits not agreed to in the contract. It does mean, however, that "service with a smile" is more than a slogan. A proven rating system for end user satisfaction measures the percentage of end users that rate the product or service satisfactory or better. It should be recognized that no product or service could satisfy everyone. Therefore, an excellent rating may be 95 percent of end users were satisfied with the service. (6) Key Personnel. Identifying how long key personnel stayed on the contract and how well they managed their portion of the contract can be of great benefit to source selection officials. This information is critical when a newly formed company is bidding on a contract and its past performance history is based on the past performance of the key personnel. Key personnel past performance looks at the track record of the principal individuals selected to manage and perform other key aspects of the work on the contract. When firms in the commercial world make decisions about which contractor, consultant, or firm to deal with, they place heavy emphasis on (1) the past performance of the company as a whole and (2) how well the firm's employees have performed. Often, a company will choose to work with the same contractor based solely on the past performance of its employees. Similarly, the past performance of the key management personnel to be assigned to a contract should be looked at as an indicator of how well the contract will be performed. For new companies entering the marketplace, without relevant company experience, it will be the quality of the past performance of their key management personnel that will indicate the risk of good performance and become the basis of the past performance evaluation. (7) Quality Awards and Certifications. The private sector is increasingly establishing partnerships with suppliers and customers to insure continuous improvement in the quality of the end products and services. Many world-class organizations are creating supplier relations that add value. Toyota requires all of its suppliers (and their suppliers) to apply for the Deming Quality Award. Ford and the other US auto companies have followed suit -- Ford's Q1 certification is widely recognized as signifying a high-quality supplier. Other private sector certifications that are widely admired include those of Xerox and Honda of America Manufacturing. Many companies that are winners of the Baldridge Award for their quality programs require their suppliers to apply for the Baldridge Award. The Baldridge Award (named for former Commerce Secretary Malcolm Baldridge) measures companies' progress on a number of quality goals. The company or division must provide evidence that they incorporate quality into management practices; work closely with suppliers, train workers in quality techniques and meet customers' desires. The President's Quality Award as well as agency-specific awards (e.g., within the Air Force) is modeled closely on the Baldridge Award. Several federal agencies have Blue Ribbon Programs built on the premise that past on-time and high-quality performance predicts future performance. The International Standards Organization has proposed a series of quality standards (ISO 9000 series) that are being widely adopted, particularly by nations of the European Community. U.S. industry associations are beginning to use the ISO 9000 series as a baseline for developing US certification programs. Because the ISO standard does not require that organizations be constantly improving their process, it makes an incomplete basis for judging the quality of an organization's process. In seeking past performance information, IPT/PTs are encouraged to ask offerors about any quality certifications or awards. How quality certifications are evaluated is at the discretion of the IPT/PT. A sample evaluation plan for evaluating this sub-factor is provided below. Note: This is for illustrative purposes only and is not intended to indicate a preferred rating system: Excellent (10 percent of total rating or 40 percent of past performance rating): Receipt of a world-class quality award or certification (e.g., Malcolm Baldridge Quality Award) covering the entire organization proposing on the project. The award or certification has been received or renewed within the last three years, or the proposal presents convincing evidence that it still applies. Good (6 percent of total rating or 24 percent of past performance rating: Receipt of a widely respected quality award or certification (e.g., the automobile industry's QS 9000, Sematech's SSQA, or ANSI/EIA-559). Adequate (2 percent of total rating or 8 percent of past performance rating): Receipt of a quality award or certification with a weak relation to future quality (e.g., ISO 9000 registration). h. Contractor Response and IPT/PT Review. (1) While the ultimate conclusion on the performance evaluation is a decision of the IPT/PTs, the contractor should be permitted to comment on the evaluation. Upon completion of any evaluation by the IPT/PT and submission to the Contractor Performance System (CPS), registered contractors will receive an electronic notice. Contractors must be CPS registered prior to receiving electronic evaluations. The contractor should be given a reasonable time to respond to the report. The required turnaround time for contractor response may not be less than thirty days. If the contractor fails to provide a response by the established deadline, IPT/PTs’ comments can stand alone. (Revised 10/2002) (2) If the contractor submits a rebuttal statement for any or all of the ratings and an agreement on the ratings cannot be reached by the contractor and the Contracting Officer, the disagreement should be resolved by the IPT/PT. The IPT/PT decision resulting from the review must be in writing and done in a timely manner. The contractor's statement and IPT/PT review must be attached to the performance evaluation report and must be provided to other parties requesting a reference check. (3) The completed evaluations are to be filed in the contract file and the CPS. The evaluations will be retained in the CPS for not more than three years after completion of contract performance. (Revised 10/2002) (4) When another agency asks for a reference, the responsible IPT/PT or Contracting Officer should provide all evaluations, extracted from the database, for the period desired by the requesting organization. i. Release of Information. Contractor evaluations may be used to support future award decisions. The completed evaluation shall not be released to other than FAA evaluators, other government personnel authorized to receive such reports, and the contractor whose performance is being evaluated. Improper disclosure of such information could cause harm both to the commercial interest of the FAA, and to the competitive position of the contractor being evaluated, as well as, impede the efficiency of FAA operations. 3. Construction Contracting (Revised 01/2002) a. General. (1) Guidance in this section applies to construction contracts, contracts for dismantling, demolition, or removal of improvements, and to the construction portion of contracts for products or services. In the event that the portions of multipurpose contracts are so commingled that priced deliverables for construction, service, or supply cannot be segregated, the FAA guidance applicable to the predominant purpose should be followed. (2) "Construction" means construction, alteration, or repair of buildings, structures, or other real property. For purposes of this definition, the terms "buildings, structures, or other real property" include but are not limited to improvements of all types, such as maintenance facilities, utilities, duct banks, air traffic control facilities, communication towers, radar facilities, office facilities, airport facilities, and navigational aids. (3) The Davis-Bacon Act applies to construction contracts valued in excess of $2,000. (4) Generally, construction should be acquired on a firm-fixed price basis. Pricing may be on a lump sum basis (when a lump sum is paid for the total work or defined parts of the work), on a unit price basis (when a unit price is paid for a specified quantity of work units), or using a combination of the two. (5) When performing contract work in FAA-leased space, the Contracting Officer (CO) should consult with their real estate specialist to determine FAA’s alteration rights and responsibilities. b. Dismantling, Demolition and Removal of Improvements. (1) If a contract is solely for dismantling, demolition, or removal of improvements, the Service Contract Act applies if the contract will exceed $2,500 unless further work which will result in the construction, alteration or repair of a public building or public work at that location is contemplated. If further construction work is intended, even though by separate contract, then the Davis-Bacon Act applies to the contract for dismantling, demolition, or removal. (2) The integrated product team (IPT/PT) should consider the usefulness to FAA of all salvageable property. Any of the property whose usefulness to FAA exceeds its value as salvage to the contractor should be expressly designated in the contract for retention by FAA. The contract may provide that: (a) The FAA pays the contractor for the dismantling or demolition of structures; (b) the contractor pay FAA for the right to salvage and remove the materials resulting from the dismantling or demolition operation; or (c) A combination of both. Care should be taken to ensure compliance with environmental laws and regulations, including handling of hazardous waste. (3) The IPT/PT should determine the fair market value of any property not to be retained by FAA, since the contractor will receive title to this property. Its value will therefore be important in determining what payment, if any, should be made to the contractor, and whether additional compensation will be made if the contract is terminated. Personal Property Managers, in conjunction with the IPT/PT, must approve the disposition of Government property to be transferred to contractors under dismantling, demolition or removal of improvements contracts. c. State Regulation of Federal Construction Projects. (1) FAA contractors may encounter requests from State and local governments for the FAA’s contractors to obtain building permits, zoning approval, sanitation approval, etc.. Based on the "supremacy" clause of Article 6 of the United States Constitution, construction contractors are not required to obtain permits or approvals for work done under government contracts on government projects. The States have enforcement authority for safety and environmental protection as specified by the Occupational Safety and Health Administration (OSHA), the Comprehensive Environmental Response, compensation and Liability (Superfund) Act (CERCLA), and the Resource Conservation and Recovery Act (RCRA). (2). Contractors which encounter attempts by State or local government entities to assess various types of fees should be advised of FAA’s position as noted above. The Contractor should be advised to inform the CO immediately if the assessing entity attempts in any way to prevent or hinder the contractor at the job site. The CO should seek legal advice from the cognizant legal counsel. d. Local Employment in Construction Contracts. Occasionally, efforts are made by State or local governments to have FAA limit employment on construction projects to local residents or firms. Such a restriction has been held to be improper, and should not be used in FAA contracts (reference Washington State Supreme Court case Laborers Local Union No. 374 v. Felton Construction Co., Nov. 24, 1982, and 42 Comp. Gen. 1, B-198952, 81-1 CPD 467). FAA recognizes that Tribal Employment Rights Ordinances (TERO) which affect projects on or near certain Indian reservations may have an affect on contractor labor. FAA should inform offerors of the existence of a TERO in the screening information request (SIR). e. Disclosure of the Size of Construction Projects. When the estimated price of the proposed construction project is $100,000 or more, public announcement (if required) and SIRs should state the size of the requirements in terms of physical characteristics and estimated price range. The estimated price may be described in a price range as determined by the IPT/PT or in terms of one of the following price ranges: (1) Between $50,000 and $100,000; (2) Between $100,000 and $250,000; (3) Between $250,000 and $500,000; (4) Between $500,000 and $1,000,000; (5) Between $1,000,000 and $5,000,000; (6) Between $5,000,000 and $10,000,000; or (7) More than $10,000,000. f. Liquidated Damages. (1) Liquidated damages clauses should be used only when: (1) the time of completion or performance is such an important factor in the award of the contract that FAA may reasonably expect to suffer damage if the completion or performance is delinquent; and (2) the extent or amount of such damage would be difficult or impossible to ascertain or prove. In deciding whether to include a liquidated damages provision in a contract, the IPT/PT should consider the probable effect on such matters as pricing, competition, and the costs and difficulties of contract administration. (2) When administering contracts which include liquidated damages, the CO should take all reasonable steps to adequately warn contractors of the pending assessment when concern of late completion develops. If a basis for termination for default exists, the CO should advise the contractor that the liquidated damages which may continue to be assessed would be damages that may be collected in addition to any re-procurement costs. If completion or performance is desired after termination for default, efforts must be made to obtain the completion or performance elsewhere within a reasonable time. (3) The rate of liquidated damages used must be reasonable, and must be considered on a case-by-case basis, since liquidated damages fixed without any reference to probable actual damages may be held to be a penalty, and therefore unenforceable. The liquidated damages rate should be determined by the IPT/PT, but should, at a minimum, cover the estimated cost of contract administration, including inspection, for each day of delay in completion. In addition, other specific losses anticipated to be incurred as a direct result of the failure of the contractor to complete the work on time should be included. Examples of specific losses are: (a) Additional inspection costs; (b) The cost of substitute facilities; (c) The rental of buildings; or (d) The cost of FAA crews, or hourly paid contract employees, forced on standby. (4) When the "Liquidated Damages" clause will be included in the contract and different completion dates are specified in the contract for separate parts or stages of the work, the CO may revise the clause to state the amount of liquidated damages for late completion of each part or stage of the work. Separate calculation and documentation of the estimated damages should be developed for each amount specified with a differing basis. g. Inspection of Site and Examination of Data. (1) The IPT/PT should make appropriate arrangements for prospective offerors to inspect the work site prior to submission of offers. The IPT/PT should also afford prospective offerors the opportunity to examine data in the possession of FAA which may provide information concerning the performance of the work, such as boring samples, original boring logs, geology reports, and record and plans of previous construction. The SIR should notify offerors of the time(s) and place(s) for the site inspection and data examination, as well as the name and telephone number of the contact point at the facility. A record should be kept of the identity and affiliation of all offerors’ representatives who inspect the site or examine FAA site information. (2) Significant site information should be made available to all offerors, including information regarding any utilities to be furnished during construction. During FAA guided site tours, care must be taken not to provide information contradictory to the SIR. All potential offerors are to be advised of any clarification or correction to the SIR package. h. Preconstruction Conference. The CO may conduct a preconstruction conference (to discuss matters such as labor standards, authority of various personnel, safety, and environmental considerations) when a construction or demolition contract is contemplated. Pre-construction conferences are not a requirement for each project. When deciding on a conference, the CO should weigh the administrative costs, time, and possible travel expenses for all parties involved, against the complexity of the requirement, the impact of the requirement on entities involved with the site, and the past performance and technical knowledge of the contractor. i. Differing Site Conditions. The purpose of the "Differing Site Conditions" clause is to encourage offerors to limit inclusion of contingency costs in their offers for conditions which are not reasonably foreseeable. The clause will also assist FAA and the contractor in complying with the Archaeological Resources Protection Act of 1979 (36 CFR 1214). j. Use and Possession Prior to Completion. Beneficial occupancy occurs when the Government takes possession of, or puts to use, a completed or partially completed part of the work. It does not constitute acceptance. The clause "Use and Possession Prior to Completion" addresses some of the issues associated with beneficial occupancy. If it is foreseen prior to contract inception that beneficial occupancy will become an issue, or if it becomes an issue during contract performance, the CO should consider negotiating contract terms which cover relevant issues for that contract, e.g., date of warranty, builder’s risk coverage, coordination with the contractor, etc. Legal counsel should be consulted on the legal ramifications of beneficial occupancy. Phased (partial) acceptance can be used as an alternative to beneficial occupancy, if the need can be identified sufficiently in advance to structure the contract accordingly, and it is determined in the best interests of the parties. k. Performance of Work by the Contractor. The CO should assure adequate interest in and supervision of work involved in projects. The contractor should be required to perform a significant part of the contract with its own work force and express this requirement in terms of a percentage of the total work. l. Assignment of Performance Inspection and Contract Administration. (1) Due to the locality and complexity of most construction projects, Contracting Officers often accomplish their administrative and inspection functions through utilization of Contracting Officer’s Technical Representatives (COTRs), or Resident Engineers (REs). These personnel are normally present at the job site each day, and are in the best position to observe day-to-day activities and performance. COTRs and REs on site perform such delegated duties as daily performance inspections, Department of Labor Wage Rate interviews with contractor personnel, provide minor clarifications of specifications and drawings, and insure contractor compliance with all safety and labor requirements on site. The duties of these individuals should be clearly annotated by the CO in a designation letter. A copy of the designation letter is provided to the COTRs, REs, and the contractor. A sample designation letter may be found in the procurement toolbox "Contract Administration" section. (2) Only the CO or persons delegated specific authority to execute contract modifications may authorize a change to the original contract. Due to the nature of construction contracts, the CO may find it beneficial for their field representative to have a delegation of change order authority. Requiring office personnel may receive delegation of specific dollar amounts to be used while assigned to construction sites; however, it is the decision of the Chief of the Contracting Office for each individual project to authorize the use of such authority by their field representative during the course of the contract. Consideration should include the likelihood of minor changes within the statement of work, the need for minor changes due to emergencies, and the complexity of the project. Other changes such as changes to the intent of the contract and those for which equitable adjustment cannot be quickly determined to be fair and reasonable, should only be initiated by the CO. In instances where field change order authority will be delegated, the CO should include a clause in the contract outlining the delegation dollar limits, and scope of authority. 4. Canceling a Screening Information Request The CO, with the concurrence of the IPT/PT, may cancel a SIR at any time during the solicitation process. Notification of the cancellation by the CO may be made using the same mechanism as the initial or subsequent SIRs. The CO will document the cancellation for placement into the official contract file. 5. Section 508 of Rehabilitation Act (Revised 07/2001) a Definition. (Revised 07/2001) Electronic and information technology (EIT) means any equipment or interconnected system or subsystem of equipment, that is used in the automatic acquisition, storage, manipulation, management, movement, control, display, switching, interchange, transmission, or reception of data or information. For purposes of the preceding sentence, equipment is used by the FAA if the equipment is used by the FAA directly or is used by a contractor under a contract with the FAA which (i) requires the use of such equipment, or (ii) requires the use, to a significant extent, of such equipment in the performance of a service or the furnishing of a product. EIT includes computers, ancillary equipment, software, firmware and similar procedures, services (including support services) and related resources. Electronic and information technology does not include any equipment acquired by a Federal contractor incidental to a Federal contract.b. Requirements for Accessibility. (Revised 07/2001) Section 508 of the Rehabilitation Act of 1973 specifies that persons with disabilities that are either Federal employees or members of the public seeking information or services from a Federal department are to have the access to and use of information and data comparable to the access and use of the information and data by Federal employees who do not have disabilities. Section 508 is applicable when using contract awards, task orders, delivery orders, orders under Government-wide Schedules and Interagency Agreements. The IPT/PT will insert Section 508 requirements into SIRs that include the development, purchase, maintenance, or use of electronic and information technology unless such requirement imposes an undue burden on the FAA (see c. "Alternative Means" below). Inserting these requirements will assure that electronic and information technology is accessible and useable to groups identified in Section 508. c. Alternative Means. (Revised 07/2001) When application of the requirements of Section 508 (see b "Requirements for Accessibility" above) would impose an undue burden, the FAA may provide individuals with disabilities covered by Section 508, the information and data involved by an alternative means of access that allows the individual to use the information and data. Contracting Officers determine the acceptability of "Undue Burden Rationale". 6. Spare Parts (Added 01/2002) a. Shipping Spare Parts. For all shipments of spare parts, the contractor should include a packing list that includes at least the noun name, part number, Commercial and Government Entity (CAGE) Code, quantity, unit price, and national stock number (if available). Contracts that require shipment of spare parts should include Clause 3.2.2.3-73 to establish this contractual requirement. b. Spare Parts for Nationally Furnished Project Materiel. (1) Requirements. The contracting officer should include coverage for spare parts in the screening information request and subsequent contract that facilitates availability, accessibility and tracking of spare parts. (2) SIR Provision. For contracts that will require the purchase and delivery of spare parts, the contracting officer should establish a discrete contract line item number for initial site and depot-level spare parts list contract line item number (CLIN) and corresponding delivery date. The CO should also include the SIR provision 3.2.2.3-74, "Submission of Initial Site and Depot-level Spare Parts List" as part of the instruction to vendors on the preparation of their SIR submissions to assure that the parts list will be furnished as part of the SIR submission. (3) Contract Requirements. The contracting officer should include a separately priced CLIN for the site and depot-level spare parts list and corresponding delivery due date of this contract deliverable. The list will contain each item's noun name, part number, Commercial and Government Entity (CAGE) Code, unit price, national stock number (if available) and the quantity. 7. Responsibilities (Added 07/2002) The responsibilities listed below are intended to be guidelines to ensure a successful evaluation by the IPT/PT. The IPT/PT must apportion these responsibilities to fit the needs of specific procurements (and IPT/PTs). a. Source Selection Official. The SSO has full responsibility and authority to select the source(s) for award. The SSO’s responsibilities are to: (1) Approve the evaluation plan; (2) Ensure that the IPT/PT is properly constituted and includes all necessary disciplines; (3) Make all screening decisions and selection decisions; and (4) Act as the IPT/PT leader unless designated otherwise. b. Integrated Product Team/Product Team. The IPT/PT is responsible for the proper and efficient conduct of the source selection process. The IPT/PT’s responsibilities and duties are to: (1) Draft all SIRs; (2) Formulate the evaluation plan for the acquisition; (3) Review existing lessons learned reports that provide meaningful insights into the acquisition; (4) Ensure an in-depth review and evaluation of each submitted screening document against the FAA requirements and the stated evaluation criteria; (5) Prepare the evaluation report (including recommendations, if applicable), using sound business judgments to assist the SSO in making the down selection and/or award decisions; conduct all debriefings; (6) Exercise oversight of all procedural and administrative aspects of the procurement; select, as required, advisors to assist the IPT/PT in their evaluation; (7) Prepare the documentation, at the SSO’s request, that provides the SSO’s decision rationale; and (8) Prepare a lessons learned memorandum after the source selection has been accomplished. c. Contracting Officer. The CO’s responsibilities and duties are to: (1) Ensure, when applicable, conflict of interest documentation is obtained from all IPT/PT members, and determine, with legal counsel review, if any conflicts or apparent conflicts of interests exist, and if so, resolve them; (2) Ensure that IPT/PT members are briefed on the sensitivities of the source selection process, the prohibition against unauthorized disclosure of information (including their responsibility to safeguard proposals and any documentation related to the IPT/PT’s proceedings), and the requirements pertaining to conflicts of interest; (3) Coordinate communications with industry; (4) Participate during the screening, selection, and debriefing phases of source selection to ensure fair treatment of all offerors; (5) Issue, as required, letters, public announcements, SIRs, SIR amendments, and other procurement documents; (6) Control all written documentation issued to industry; (7) Ensure that the contract is signed by an official with the authority to bind the contractor; with guidance from legal counsel, assure that all contractual documents are in compliance with applicable laws and regulations; (8) Serve as the SSO if the procurement is not subject to the JRC process or is specifically delegated by the IPT/PT lead; and (9) Execute, administer, and terminate contracts and make related determinations and decisions that are contractually binding. d. The Integrated Product Team/Product Team Leader. The IPT/PT Leader’s responsibilities and duties are to: (1) Serve as the SSO if the procurement is subject to the JRC process or unless otherwise delegated; (2) Assure that the FAA’s program needs are acquired through the source selection process; (3) Assure that the FAA’s SIRs include adequate definition of requirement(s); (4) Assure that the technical evaluation is performed in accordance with the stated evaluation criteria; (5) Assure that qualified technical evaluators, if required, are chosen to assist the IPT/PT in the evaluation; and (6) Assure team competence, cohesiveness, and effectiveness. e. Advisors. Advisors may be appointed by the IPT/PT to provide specific guidance to the IPT/PT when their essential specialized expertise is not available within the IPT/PT. f. Nongovernmental Evaluators and Advisors. Nongovernmental personnel may be used as evaluators and/or advisors, and shall be subject to the conflict of interest and disclosure of information policies stated herein. Notice of any nongovernmental participation will be provided in the SIR. The IPT/PT must apportion these responsibilities to fit the needs of specific procurements (and IPT/PTs). 8. Supplier Process Capability Evaluation and Appraisal (Added 07/2003)a. General. This guidance is designed to assist the Source Selection Official in considering process capability of potential suppliers during proposal evaluations, mitigating process-related risk of the supplier during contract/agreement performance, and for fostering process improvement of the supplier throughout the lifecycle. b. Scope/Applicability. Supplier Process Capability Evaluation and Appraisal are intended for use in new acquisitions and agreements, but may also be incorporated into existing contracts or agreements. c. Expected benefits. (1) Acquirer. (2) Supplier. Suppliers can expect reduced risk in meeting contract requirements by identifying and addressing process deficiencies that might negatively impact project success. Other benefits would include improved performance by identifying and addressing process deficiencies in critical process areas and potential for earning additional award fee where such incentives are part of the contract. d. Pre-award. In the early phase of planning a source selection, the SSO determines whether process capability will be considered as a risk factor for source selection. The following criteria should be considered when making this decision: (1) The performance of specific processes is considered critical to accomplishment of the mission. (2) The product or service being acquired is considered crucial to the FAA. (3) A major component (4) The total estimated value of a contract for research, engineering, and development (R, E&D) is equal to or greater than $70 million, or a contract for acquisition is equal to or greater than $300 million. (5) There is lack of information on offeror’s past performance or process capability data, or the past performance or process capability of the offeror is weak. (6) The product or service is especially complex. e. Post Award. Post award appraisals may be conducted on existing contracts with well-established project(s), or on new contracts using target projects selected from the supplier’s sponsoring organization in accordance with the FAA-iCMM Appraisal Method (FAM) section 3.5. (1) FAA-iCMM Appraisal Method (FAM). The acquirer determines the scope of the appraisal such as the number of process areas, capability levels, and projects. The acquirer also ensures that adequate time and resources are available for conducting a post-award appraisal using the FAA-iCMM as the reference model. An appraisal team lead is identified, who will participate in planning the appraisal, and in appraisal team selection. The scope and magnitude of the appraisal will be determined based on the analysis by the process capability analysis team of information provided by the offeror, and the decision of the SSO. A proposed schedule for post-award appraisal will be provided in the SIR. (2) Formal Appraisal. The Government may require formal appraisal of process capability versus the FAA-iCMM, using the FAA-iCMM Appraisal Method (FAM). This appraisal would be completed 30-60 days after award. The scope of the appraisal would be those areas identified as critical to acquisition success, as determined during the selection process, and will result in identification of strengths and weaknesses, with any critical deficiencies identified. f. Contract/agreement requirements. Considerations in developing contract/agreement requirements include use of trade-off analysis to establish the level of surveillance of strong or weak areas. For example, if a supplier is strong in an area, it is inefficient to check on that area in the same way that would be applied in an area found to be weak. Additional Award fees may also be used as an incentive. Contract/Agreement performance requirements include completion of initiatives to remove critical deficiencies identified. Completion may be a factor in award fees. Depending on the decision of the SSO, contract requirements may include:
Risk mitigation planning describes in detail the schedule and actions that will be taken to remove deficiencies noted during the evaluation and selection process and those uncovered in the appraisal process, if a post award appraisal is performed. g. Additional Resources. Appendix II contains additional instructions, sample language for the SOW and SIR and other references for supplier process capability evaluation and process improvement appraisals. B. CLAUSES See FAST Procurement Toolbox for applicable clauses. C. FORMS See FAST Procurement Toolbox for applicable forms.D. APPENDIX (Revised 07/2003)I.: Samples (Revised 07/2003) Sample 1 - Past Performance Instructions Sample 2 - Past Performance Evaluation Factors Sample 3A - Past Performance Evaluation Record Sample 3B - Past Performance Questionnaire Sample 3C - Business Management Past Performance Summary II.:
Instructions for Supplier Process Capability Evaluation and Process Improvement
Appraisal (Added
07/2003) I : SAMPLES (Revised 07/2003)
Instructions for Providing Past Performance Information Offerors shall submit the following information as part of their proposal for both the offeror and proposed major subcontractors: (The information may be submitted prior to the other parts of the proposal, to assist the government in reducing the evaluation period). A. A list of the last ____ contracts and subcontracts completed during the past three years and all contracts and subcontracts currently in process. Contracts listed may include those entered into by the federal government, agencies of state and local governments, and commercial customers. Offerors that are newly formed entities without prior contracts should list contracts and subcontracts as required above for all key personnel. Include the following information for each contract and subcontract:
B. The offeror may provide information on problems encountered on the contracts and subcontracts identified in A above and corrective actions taken to resolve those problems. Offerors should provide general information on their performance on the identified contracts. General performance information will be obtained from the references. (Use this paragraph if written input from the offeror is desired in addition to the information obtained from the references.) C. The offeror may describe any quality awards or certifications that indicate the offeror possesses a high-quality process for developing and producing the product or service required. Such awards or certifications include, for example, the Malcolm Baldridge Quality Award, other government quality awards, and private sector awards or certifications (e.g., the automobile industry's QS 9000, Sematech's SSQA, or ANSI/EIA-599). Identify what segment of the company (one division or the entire company) that received the award or certification. Describe when the award or certification was bestowed. If the award or certification is over three years old, present evidence that the qualifications still apply. D. Each offeror will be evaluated on his/her performance under existing and prior contracts for similar products or services. Performance information may be used for both responsibility determinations and as an evaluation factor against which offerors' relative rankings will be compared to assure best value to the government. The government will focus on information that demonstrates quality of performance relative to the size and complexity of the procurement under consideration. The Performance Information Form identified in the List of Attachments section will be used to collect this information. References other than those identified by the offeror may be contacted by the FAA with the information received used in the evaluation of the offeror's past performance. E. Offerors should send their listed private sector references a letter to the following effect authorizing the reference to provide past performance information to the government.
Sample Client Authorization Letter (Optional) Dear "Client": We are currently responding to the Federal Aviation Administration’s SIR No.__________________ for the procurement of ________________________. The FAA is placing increased emphasis in its procurements on past performance as an evaluation factor. The FAA is requiring that clients of entities responding to its SIRs be identified and their participation in the evaluation process be requested. In the event you are contacted for information on work we have performed, you are hereby authorized to respond to those inquiries. We have identified Mr./Ms.______ of your organization as the point of contact based on his/her knowledge concerning our work. Your cooperation is appreciated. Any questions may be directed to:________. Sincerely,
SAMPLE 2 - PAST PERFORMANCE EVALUATION FACTORS Past performance will be evaluated as follows: 1. Past performance will receive 35 percent of the non-cost/price factors ratings. Sub-factors A, B, C, D and E are of equal importance and will receive up to 25 percent of the non-cost/price ratings with the other 10 percent allocated to sub-factor G, quality awards. The criteria for a rating of excellent are described with each sub-factor. A. Quality of Product or Service - compliance with contract requirements - accuracy of reports - technical excellence. Excellent = There were no quality problems. B. Timeliness of Performance - met interim milestones - reliable - responsive to technical direction - completed on time, including wrap-up and contract administration - no liquidated damages assessed. Excellent = There were no unexcused delays. C. Cost Control - within budget - current accurate and complete billings - relationship of negotiated costs to actuals - cost efficiencies. Excellent = There were no cost issues. D. Business Practices - effective management - effective small/small disadvantaged business subcontracting program - reasonable/cooperative behavior - flexible - effective contractor recommended solutions - business-like concern for government's interests. Excellent = Response to inquiries, technical/service/administrative issues was effective and responsive. E. Customer Satisfaction - satisfaction of end users with the contractors service. Excellent = 90 percent or more of end users surveyed rated the service as excellent or better. F. Where the offeror has demonstrated an exceptional performance level in any of the above five sub-factors additional consideration can be given by the IPT/PT for that factor. It is expected that this rating will be used in those rare circumstances when contractor performance clearly exceed the performance levels described as "excellent." G. Receipt of widely recognized quality awards or certifications. Excellent = Malcolm Baldridge Quality award, or equivalent award, covering the entity submitting the offer. 2. Assessment of the offeror's past performance will be one means of evaluating the credibility of the offeror's proposal, and relative capability to meet performance requirements. 3. Information utilized will be obtained from the references listed in the proposal, other sources known to the FAA, consumer protection organizations, and others who may have useful and relevant information. Information will also be considered regarding any significant major subcontractors, and key personnel. 4. Award may be made from the initial offers without discussions. However, if discussions are held offerors should be given an opportunity to address negative reports of past performance, if the offeror has not had a previous opportunity to review the rating. Recent contracts will be examined to ensure that corrective measures have been implemented. Prompt corrective action in isolated instances may not outweigh overall negative trends. 5. Lack of past performance history relating to this SIR (state how lack of past performance history will affect the evaluation, e.g. neutral rating).
SAMPLE 3C. - BUSINESS MANAGEMENT PAST PERFORMANCE SUMMARY
SAMPLE 4 - SURVEY FORM
II. Instructions for Supplier Process Capability Evaluation and Process Improvement Appraisal (Added 07/2003) 1. Definitions :
Process appraisal: 2 . Evaluating Process Risks based on Information Provided. A process capability analysis team evaluates the information provided versus the performance objectives and evaluation criteria identified for the project. The team compares claimed process capabilities to practices in the FAA-iCMM, and identifies risks of the supplier being able to fully execute a contract or agreement if awarded to them. This analysis identifies areas of strength and potential areas of weakness in the process capabilities of perspective suppliers and also provides recommendations regarding a post-award appraisal for the selected suppliers. The results of this analysis are incorporated in a report to the Source Selection Official. The awarded contract may include award fee or other payment conditions that provide incentives for the supplier to correct any process weaknesses that are discovered during the selection process or post award appraisal.3. Statement of Work – Sample Language for Process Appraisal (s)Note: where text appears in italics within parentheses, replace the text as appropriate for the specific source selection/ contract / agreement. The supplier shall provide the following information to assist the Government’s preparation for the appraisal:
The supplier shall provide the following to support the appraisal:
The supplier shall also provide a point of contact, address, and phone number to facilitate the Government’s coordination of an appraisal site visit. The Offeror will be notified of the projects to be examined not less than five (5) working days prior to the Site Visit. The Site Visit dates are not subject to discussion. After the Government’s appraisal notification to the Offeror, the Appraisal Team Lead will coordinate all details for the site visit with the Offeror’s point of contact. The site visit will be no more than five (5) days in duration. The Government will prepare an appraisal report on its findings and provide a copy of that report to the supplier. Sixty days following the issuance of that report, the supplier shall present and discuss process improvement activities that address appraisal findings. Follow-up Appraisals: The supplier shall provide a point of contact and phone number for coordination of all follow-up appraisal activities with the Government. The items identified above under Post-award appraisal will also be supplied for any follow-up appraisals. 4. Screening Information Request – Sample Language to Permit Appraisal Use. To permit the use of appraisals, appropriate language is included in the Screening Information Request. Examples of appropriate language that can be tailored as needed to fit the source selection are provided below. When process capability is a stand-alone, separate factor, under the Technical/Management Area, or used as an adjustment to risk at either the area or factor level, the following wording may be included in the SIR. Pre-award:
The Government will analyze the information provided by the offeror in the SIR vs the performance objectives and evaluation criteria identified for the project. The team will compare claimed process capabilities to practices in the FAA-iCMM and identify risks of the supplier being able to fully execute a contract or agreement if awarded to them. This analysis will identify areas of strength and potential areas of weakness in the process capabilities of perspective suppliers. The results of this analysis will be incorporated in a report to the Source Evaluation Board. This report may affect the Source Evaluation Board assessment of the risk associated with a weakness, and will also provide recommendations regarding post-award appraisal for the selected supplier. Post-award: The Government will determine the Offeror’s strengths, weaknesses, and improvement activities in process areas of the iCMM v2 that are considered critical to the success of the acquisition. The post-award appraisal will be completed 30-60 days after award. 5. References: The Federal Aviation Administration Integrated Capability Maturity Model (FAA-iCMM), Version 2.0, Federal Aviation Administration, September 2001. (available at www.faa.gov/aio) The Federal Aviation Administration Integrated Capability Maturity Model (FAA-iCMM) Appraisal Method (FAM), Version 1.0, Federal Aviation Administration, April 1999. (available at www.faa.gov/aio) Federal Aviation Administration Software Capability Evaluation Guidelines, FAA, FAA Acquisition Management System, 1997. SCAMPI V1.1 Use in Supplier Selection and Contract Monitoring, Technical Note CMU/SEI-2002-TN-008, Software Engineering Institute, April 2002. DoD 5000.2-R, June 2001 |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||