Order 8120.23 Certificate Management of Production Approval Holders (Change 3)
This document is cancelled. Cancelled by 8120.23A. Check the official source before relying on it.
CHANGE
U.S. DEPARTMENT OF TRANSPORTATION
FEDERAL AVIATION ADMINISTRATION
Date: 1/22/2016
National Policy
ORDER
8120.23 CHG 3
1. Purpose. This change contains guidance related to specific components of the certificate management process.
2. Who This Change Affects. This change affects all Washington headquarters branch levels of the Aircraft Certification Service, Flight Standards Service, and the Regulatory Support Division; the Aviation System Standards office; the branch level in the Aircraft Certification Service directorates and regional Flight Standards Service divisions; all Aircraft Certification Offices; all Manufacturing Inspection District Offices and Manufacturing Inspection Satellite Offices; all Flight Standards District Offices; the Aircraft Certification Branch and Flight Standards Branch at the Federal Aviation Administration (FAA) Academy; all applicable representatives of the FAA; and all international field offices.
3. Explanation of Changes. This change adds a note in paragraph 1-1 regarding the use of “CMIS,” updates paragraph 3-55 and appendix H to align with changes to Title 14 of the Code of Federal Regulation (14 CFR) part 21, deletes references to “ACSEP,” updates the instructions for preparing FAA Form 8100-6, Noncompliance Record, contained in appendix I, and changes the responsibility for review and updating the Category Parts List (CPL) to AIR-100.
4. Disposition of Transmittal Paragraph. Retain this transmittal sheet until the directive is canceled by a new directive.
5. Effective Date. This change is effective January 4, 2016, with the following exceptions, which are effective March 29, 2016:
a. Applicable changes to paragraph 3-55a;
b. Paragraph 3-55f;
c. Appendix H, criteria 120; and
d. Appendix H, criteria 612, Statement of Condition, paragraph c.
SUBJ: Certificate Management of Production Approval Holders
Distribution: Electronic
Initiated By: AIR-100
PAGE CHANGE CONTROL CHART
Remove Pages Dated Insert Pages Dated ii thru iv vi viii 1-1 3-6 3-31 3-32 thru 3-33 5-1 B-1 B-3 B-5 H-1 H-3 H-11 thru H-23 H-40 thru H-45 H-74 H-76 I-1 I-2 thru I-4
7/25/14 12/30/14 07/25/14 2/25/13 12/30/14 12/30/14 2/25/13 7/25/14 2/25/13 2/25/13 2/25/13 2/25/13 2/25/13 2/25/13 2/25/13 2/25/13 2/25/13 7/25/14 2/25/13
ii thru iv vi viii 1-1 3-6 3-31 3-32 thru 3-33 5-1 B-1 B-3 B-5 H-1 H-3 H-11 thru H-23 H-40 thru H-45 H-74 H-76 I-1 I-2 thru I-4
1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16 1/22/16
Susan J. M. Cabler Acting Manager, Design, Manufacturing, & Airworthiness Division Aircraft Certification Service
CHANGE
U.S. DEPARTMENT OF TRANSPORTATION
FEDERAL AVIATION ADMINISTRATION
Distribution: Electronic
Initiated By: AIR-100
Effective Date:
12/30/2014
National Policy
ORDER
8120.23 CHG 2
1. Purpose. This change contains guidance related to specific components of the certificate management process.
2. Who This Change Affects. This change affects all Washington headquarters branch levels of the Aircraft Certification Service, Flight Standards Service, and the Regulatory Support Division; the Aviation System Standards office; the branch level in the Aircraft Certification Service directorates and regional Flight Standards Service divisions; all Aircraft Certification Offices; all Manufacturing Inspection District Offices and Manufacturing Inspection Satellite Offices; all Flight Standards District Offices; the Aircraft Certification Branch and Flight Standards Branch at the Federal Aviation Administration (FAA) Academy; all applicable representatives of the FAA; and all international field offices.
3. Explanation of Changes. This change updates the corrective action process to align with changes to the compliance and enforcement policy.
4. Disposition of Transmittal Paragraph. Retain this transmittal sheet until the directive is canceled by a new directive.
PAGE CHANGE CONTROL CHART
Remove Pages Dated Insert Pages Dated vi 2/25/13 vi 12/30/14 3-6 7/25/14 3-6 12/30/14 3-31 2/25/13 3-31 12/30/14 3-46 7/25/14 3-46 12/30/14 4-6 thru 4-8 2/25/13 4-6 thru 4-7 12/30/14
SUBJ: Certificate Management of Production Approval Holders
PAGE CHANGE CONTROL CHART
Remove Pages Dated Insert Pages Dated
vi 02/25/2013 vi 12/12/2014
3-6 07/25/2014 3-6 12/12/2014
3-31 02/25/2013 3-31 12/12/2014
3-46 07/25/2014 3-46 12/12/2014
4-6 thru 4-8 02/25/2013 4-6 thru 4-7 12/12/2014
4-9 02/25/2013 4-8 02/25/2013
4-10 07/25/2014 4-9 07/25/2014
4-11 02/25/2013 4-10 02/25/2013
P-1 07/25/2014 P-1 12/12/2014
David W. Hempe signature Manager, Design, Manufacturing, & Airworthiness Division Aircraft Certification Service
U.S. DEPARTMENT OF TRANSPORTATION
FEDERAL AVIATION ADMINISTRATION CHANGE
ORDER 8120.23 CHG 1
National Policy
Effective Date
7/25/14
SUBJ: Certificate Management of Production Approval Holders
1. Purpose. This change contains guidance related to specific components of the certificate management (CM) process.
2. Who This Change Affects. This change affects all Washington headquarters branch levels of the Aircraft Certification Service, Flight Standards Service, and the Regulatory Support Division; the Aviation System Standards office; the branch level in the Aircraft Certification Service directorates and regional Flight Standards Service divisions; all Aircraft Certification Offices; all Manufacturing Inspection District Offices and Manufacturing Inspection Satellite Offices; all Flight Standards District Offices; the Aircraft Certification Branch and Flight Standards Branch at the Federal Aviation Administration (FAA) Academy; all applicable representatives of the FAA; and all international field offices.
3. Explanation of Changes. This change―
a. Incorporates 21 significant and minor changes to components of the CM process. These include amendment of the definition of “inactive” with regard to production approval holders, clarification of how to prepare and document Quality System Audits to reflect current Certificate Management Information System capabilities, and several policy clarifications regarding the supplier audit process.
b. Clarifies policy and details procedures to verify accuracy and completeness of CM files and documentation. This includes updated procedures pertaining to the review and completion of schedules, reports, forms, and retention of objective evidence.
c. Incorporates several changes based on input through the directive feedback system, prior field office reviews, and corrective and preventive action reports.
4. Disposition of Transmittal Paragraph. Retain this transmittal sheet until the directive is cancelled by a new directive.
Distribution: Electronic Initiated By: AIR-100
PAGE CHANGE CONTROL CHART
Remove Pages Dated
i thru v 02/25/2013
viii thru ix 02/25/2013
2-2 thru 2-4 02/25/2013
3-2 02/25/2013
3-3 02/25/2013
3-4 02/25/2013
3-6 thru 3-8 02/25/2013
3-9 thru 3-10 02/25/2013
3-11 02/25/2013
3-13 thru 3-14 02/25/2013
3-16 02/25/2013
3-17 02/25/2013
3-18 thru 3-19 02/25/2013
3-20 thru 3-21 02/25/2013
3-22 02/25/2013
3-25 thru 3-26 02/25/2013
3-27 thru 3-30 02/25/2013
3-31 thru 3-33 02/25/2013
3-37 thru 3-39 02/25/2013
3-41 02/25/2013
3-42 thru 3-43 02/25/2013
3-44 thru 3-46 02/25/2013
4-2 02/25/2013
4-6 02/25/2013
4-10 02/25/2013
5-1 02/25/2013
B-3 02/25/2013
B-5 02/25/2013
E-1 02/25/2013
I-1 02/25/2013
Insert Pages Dated
i thru v 07/25/2014
viii thru ix 07/25/2014
2-2 thru 2-4 07/25/2014
3-2 07/25/2014
3-3 02/25/2013
3-4 07/25/2014
3-6 thru 3-8 07/25/2014
3-9 thru 3-10 02/25/2013
3-11 07/25/2014
3-13 thru 3-14 07/25/2014
3-16 07/25/2014
3-17 02/25/2013
3-18 thru 3-19 07/25/2014
3-20 thru 3-21 02/25/2013
3-22 07/25/2014
3-25 thru 3-26 02/25/2013
3-27 thru 3-30 07/25/2014
3-31 thru 3-33 02/25/2013
3-37 thru 3-39 07/25/2014
3-41 07/25/2014
3-42 thru 3-43 02/25/2013
3-44 thru 3-46 07/25/2014
4-2 07/25/2014
4-6 07/25/2014
4-10 07/25/2014
5-1 07/25/2014
B-3 07/25/2014
B-5 07/25/2014
E-1 07/25/2014
I-1 07/25/2014
ii
Remove Pages Dated
M-1 02/25/2013
N-1 02/25/2013
O-1 02/25/2013
P-1 02/25/2013
R-1 02/25/2013
Insert Pages Dated
M-1 07/25/2014
N-1 07/25/2014
O-1 07/25/2014
P-1 07/25/2014
R-1 07/25/2014
James D. Seipel Acting Manager, Design, Manufacturing, &
Airworthiness Division Aircraft Certification Service
iii
SUBJ: Certificate Management of Production Approval Holders
This order provides guidance and assigns responsibility for the implementation of the Aircraft Certification Service certificate management (CM) of production activities of manufacturers and their suppliers producing products, articles, or parts in accordance with Title 14 of the Code of Federal Regulations.
This order has been organized into three functional components. The first two chapters describe the CM process. Chapter 3 describes ongoing CM practices and includes Quality System Audits (QSA) and related activities. Chapters 4 and 5 describe special CM activities, continuous improvement, and the Certificate Management Information System’s role in QSAs.
ORDER
8120.23 Effective Date:
2/25/2013
National Policy
Distribution: Electronic Distribution Initiated By: AIR-100
Table of Contents
Paragraph Page
Chapter 1. General
1-1. Purpose of This Order … 1-1 1-2. Audience … 1-1 1-3. Where Can I Find This Order … 1-1 1-4. Cancellation … 1-1
Chapter 2. Certificate Management Procedures
3-13.-3-14. Reserved 3-6
Section 1. General Information
2-1. Chapter Information and Format … 2-1 2-2. Overview … 2-1 2-3. Assignment of CM Coordinator … 2-2 2-4. Status of a PAH … 2-2 Figure 2-1. CM Life Cycle Process … 2-4
Chapter 3. Ongoing CM Responsibilities
Section 1. Introduction
3-1. CM Tasks … 3-1 Figure 3-1. CM Responsibilities (Ongoing) Minimum Requirements … 3-1 3-2. CM Plan … 3-2 3-3. Coordination of Requests for Supplier Surveillance Assistance with Other CAAs … 3-2 3-4. Recording Noncompliances … 3-3 3-5.-3-6. Reserved … 3-3
Section 2. Risk-Based Resource Targeting
3-7. RBRT Assessment Tool … 3-4 3-8. Scope … 3-4 3-9. RBRT Risk Levels … 3-4 3-10. RBRT Assessment of Facilities … 3-4 3-11. Modification of RBRT Assessment … 3-5 3-12. Modification of RBRT Assessment Tool … 3-6 3-13.-3-14. Reserved … 3-6
ii
3-38.-3-39. Reserved 3-22
Table of Contents (Continued)
Paragraph Page
Section 3. Quality System Audit
Part 1. QSA Introduction
3-15. General … 3-6 3-16.-3-17. Reserved … 3-6
Part 2. QSA Auditor Appointment and Training
3-18. General … 3-7 3-19. Appointing Officials … 3-7 3-20. Criteria for Candidate Selection … 3-7 Figure 3-2. Criteria for Candidate Selection and Team Member Appointment … 3-8 3-21. Criteria for Appointment … 3-8 Figure 3-3. Criteria for Team Leader Appointment … 3-10 3-22. Review of Appointment … 3-12 3-23. Reinstatement of Auditors Failing to Meet Appointment Review Criteria … 3-12 3-24.-3-25. Reserved … 3-13
Part 3. Selection and Scheduling of QSAs
3-26. QSA Intervals … 3-13 3-27. Selection of Facilities To Be Audited … 3-13 3-28. Scheduling of QSAs … 3-13 3-29. Selection of QSA Auditors … 3-15 Table 3-1. Selecting a PI or AE as an Auditor … 3-17 3-30. Notification of Facilities To Be Audited … 3-18 3-31. Modifications to Scheduled Audits … 3-19 3-32.-3-33. Reserved … 3-19
Part 4. QSA Procedures
Subpart A. QSA Preparation
3-34. Lead Audit Office … 3-19 3-35. ACO, MIO, MIDO, and CMO Managers … 3-19 3-36. Audit Team Leader or Principal Auditor … 3-19 3-37. Audit Team Member … 3-22 3-38.-3-39. Reserved … 3-22
iii
Table of Contents (Continued)
Paragraph Page
Subpart B. Conduct of the Audit
3-40. Team Leader or Principal Auditor Coordination with Facility Representative … 3-22 3-41. Pre-Audit Team Meeting … 3-23 3-42. Pre-Audit Conference … 3-23 3-43. Audit of System Elements … 3-24 3-44. Recording Noncompliances … 3-26 3-45. Audit Meetings … 3-26 3-46. Post-Audit Conference … 3-28 3-47.-3-48. Reserved … 3-29
3-67.-3-68. Reserved 3-41
Subpart C. Post-Audit Activities
3-49. Preparing the QSA Report … 3-29 3-50. Quality Review of the QSA Report … 3-30 3-51. Sending the QSA Report … 3-30 3-52. Requesting Corrective Action … 3-31 3-53.-3-54. Reserved … 3-31
Section 4. Supplier Control
Part 1. Determining Supplier Control by a PAH or Associate Facility
3-55. General PAH Supplier Control Responsibilities … 3-31 3-56. CM Activity … 3-33 3-57. Determination of Supplier Control … 3-33 3-58.-3-59. Reserved … 3-33
Part 2. Supplier Control Audits
3-60. Scheduling … 3-34 3-61. Supplier Selection … 3-34 3-62. Directorate Supplier Control Audit … 3-36 3-63. Coordination of Supplier Control Audits Between Directorates … 3-37 3-64. Handoff Procedures … 3-37 3-65. Notifying a PAH or Associate Facility … 3-39 Figure 3-4. Sample Supplier Control Audit Notification Letter … 3-40 3-66. Conducting and Recording a Supplier Control Audit … 3-41 3-67.-3-68. Reserved … 3-41
iv
Figure 4-1. Sample Letter of Approval for Quality System Changes 4-3
Table of Contents (Continued)
Paragraph Page
Section 5. Principal Inspector Audit
3-69. Scheduling … 3-42 3-70. Recording a PI Audit … 3-43 3-71.-3-72. Reserved … 3-43
Section 6. Product Audit
3-73. Scheduling … 3-43 3-74. Selection of Product Audit Characteristics … 3-43 3-75. Product Audit Areas … 3-44 3-76. Product Audit Criteria … 3-44 Figure 3-5. Applicability of Product Audit Criteria to Product Audit Areas (Minimum) … 3-45 3-77. Recording Product Audit Results … 3-45 3-78. Recording Completion of a Product Audit … 3-46 3-79.-3-80. Reserved … 3-46
Section 7. Special Audit Items
Reserved … 3-46
Chapter 4. Special CM Responsibilities
Section 1. Introduction
4-1. Section Information … 4-1 4-2.-4-3. Reserved … 4-1
Section 2. Audit of Changes to a PAH’s or Associate Facility’s Quality System
4-4. General MIDO/CMO Responsibilities … 4-1 4-5. Prioritization of Review … 4-1 4-6. Review of Changes … 4-1 4-7. Post-Review Actions … 4-2 4-8.-4-9. Reserved … 4-2 Figure 4-1. Sample Letter of Approval for Quality System Changes … 4-3
v
5-4. Use of the Database 5-1
Table of Contents (Continued)
Paragraph Page
Section 3. Investigation of Service Difficulties
4-10. General Service Difficulties Information … 4-4 4-11. Investigation … 4-4 4-12. Corrective Action … 4-5 4-13. Reporting a Service Difficulty Investigation … 4-5 4-14. Foreign Manufacturers … 4-6 4-15.-4-16. Reserved … 4-6
Section 4. PAH Noncompliances and Corrective Action
4-17. PAH Noncompliances … 4-6 4-18. Documenting Noncompliances … 4-6 4-19. Processing Noncompliances … 4-6 4-20. Obtaining Corrective Action … 4-7 4-21.-4-23. Reserved … 4-7
Section 5. Unscheduled Audits or Investigations
4-24. General Unscheduled Audit Information … 4-8 4-25. Non-Scheduled CM Audits … 4-8 4-26. Special Audit Item … 4-9 4-27.-4-29. Reserved … 4-9
Section 6. Providing Guidance to a PAH or Associate Facility
4-30. Guidance … 4-10
Chapter 5. QSA and CMIS
5-1. Purpose … 5-1 5-2. Files … 5-1 5-3. Database Management … 5-1 5-4. Use of the Database … 5-1
vi
Figure E-2. Sample FAA Form 8100-7, QSA Customer Feedback Report E-3
02/25/2013 8120.23
Table of Contents (Continued)
Paragraph Page
Appendix A. RBRT Organizational and Technical Indicators
1. Purpose … A-1 2. Specific Guidance … A-1 Figure A-1. RBRT Indicators … A-2
Appendix B. Category Parts List
1. Purpose … B-1 2. Category Parts List … B-1 3. Review of the CPL … B-1 4. Structure of the CPL … B-1 5. CPL Revision Process … B-1 Figure B-1. Sample Category Parts List … B-4 Figure B-2. CPL Revision Process Flowchart … B-5 Figure B-3. Sample Part Categorization Memo for Requesting an Addition to the CPL … B-6 Figure B-4. Sample Part Categorization Memo for Requesting a Change to the CPL … B-7 Figure B-5. Sample Part Categorization Memo for Requesting Removal of an Assembly/Part from the CPL … B-8
Appendix C. RBRT Assessment Validation Plan
1. Purpose … C-1 2. Validation of Ratings for the RBRT Indicators … C-1
Appendix D. Preparation of Clauses for Contracts for Support Services
1. Purpose … D-1 2. Sample Clauses and Attachment … D-1 Figure D-1. Sample Certificate of Nondisclosure … D-2
Appendix E. Preparation of the Notification Letter to a PAH or Associate Facility
1. Purpose … E-1 2. Information to Include in the Notification Letter … E-1 Figure E-1. Sample Paragraphs for the Notification Letter … E-2 Figure E-2. Sample FAA Form 8100-7, QSA Customer Feedback Report … E-3
vii
Figure J-2.
Table of Contents (Continued)
Paragraph Page
Appendix F. Notification Letter Requirements
1. Purpose … F-1 2. Description … F-1 Figure F-1. Notification Letter Requirements Summary … F-1
Appendix G.
Reserved … G-1
Appendix H. Standardized Audit Criteria for PAHs and Associate Facilities
1. Purpose … H-1 Figure H-1. System Elements … H-1 2. Description of System Elements Section Format … H-1 Sec. 1. Organizational Management … H-2 Sec. 2. Design Control … H-11 Sec. 3. Software Quality Assurance … H-16 Sec. 4. Manufacturing Processes … H-23 Sec. 5. Manufacturing Controls … H-45 Sec. 6. Supplier Control … H-69
Appendix I. Preparation Instructions for FAA Form 8100-6, Noncompliance Record
1. Purpose … I-1 2. Specific Guidance … I-1 Figure I-1. Sample FAA Form 8100-6 … I-4
Appendix J. Preparation Instructions for FAA Quality System Audit Executive Summary
1. Purpose … J-1 2. Specific Guidance … J-1 Figure J-1. Sample Executive Summary for PAHs and Associate Facilities … J-2 Figure J-2. Sample Executive Summary for Facilities with No Noncompliances … J-3
viii
Appendix Q. Definitions
Table of Contents (Continued)
Paragraph Page
Appendix K. Preparation Instructions for Quality System Audit Special Emphasis Items
1. Purpose … K-1 2. Specific Guidance … K-1 Figure K-1. Sample Quality System Audit Special Emphasis Items for PAHs and Associate Facilities … K-2
Appendix L. Preparation Instructions for FAA Form 8100-3, Quality System Audit Report, Cover Pages
1. Purpose … L-1 2. Preparing the Front of the Form … L-1 Figure L-1. Sample FAA Form 8100-3 (Front) … L-2 3. Preparing the Back of the Form … L-3 Figure L-2. Sample FAA Form 8100-3 (Back) … L-4
Appendix M. Process for Sending Quality System Audit Reports
1. Purpose … M-1 2. Description … M-1 Figure M-1. Process for PAHs and Associate Facilities … M-1
Appendix N. Preparation Instructions for FAA Form 8120-14, Production Approval/Certificate Management Activity Report
1. Purpose … N-1 2. Specific Guidance … N-1 Figure N-1. Sample FAA Form 8120-14 … N-3
Appendix O. Forms Listing
1. Purpose … O-1 Table O-1. Forms Available From FAA Logistics Center … O-1 Table O-2. Forms Available Within CMIS … O-1
Appendix P. Acronyms
Appendix Q. Definitions
ix
02/25/2013 8120.23
Table of Contents (Continued)
Paragraph Page
Appendix R. Administrative Information
1. Distribution … R-1 2. Delegation of Authority … R-1 3. Related Publications … R-1 4. Forms … R-1 5. Deviations … R-1 6. Requests for Information … R-1 7. Electronic Signature … R-1 8. Suggestions for Improvement … R-1 9. Records Management … R-2
Appendix S. FAA Form 1320 19, Directive Feedback Information
Appendix S. FAA Form 1320 19, Directive Feedback Information
x
Chapter 1. General
1-1. Purpose of This Order.
a. This order defines the components of the Federal Aviation Administration’s (FAA) certificate management (CM) program for production approval holders (PAH). Section 44713 of Title 49 of the United States Code (49 U.S.C.) requires the FAA to inspect aircraft during manufacture. CM is the FAA’s method for meeting this requirement, and auditing is the key component of CM. The purpose of an audit is to verify that a PAH has established and continues to follow approved procedures in the production of products, articles, and parts that conform to their approved type design and are in an airworthy condition for safe operation.
b. Title 14 of the Code of Federal Regulations (14 CFR) part 21, Certification Procedures for Products and Articles, includes requirements for PAHs and FAA production approval applicants. Specifically, part 21 requires a PAH to obtain FAA approval of a written description of its quality system that ensures each product, article, and part conforms to its approved design and is in a condition for safe operation. This written description must include procedures for each of 14 quality system elements in 14 CFR § 21.137. Sections 21.146, 21.316, and 21.616 also require a PAH to maintain this quality system in compliance with these approved procedures and ensure each completed product, article, or part conforms to its approved design and is in a condition for safe operation.
Note: All references to “CMIS” in this order are now recognized as references to the Aircraft Certification Audit Information System (ACAIS).
c. As some audit processes in the Certificate Management Information System (CMIS) are automated, there may be differences in CMIS processes and the stated manual processes defined in this order. Where this is the case, the automated process in CMIS takes precedence over the manual process stated in this order.
Note: The use of the word “should” throughout this order refers to a recommended practice. The associated activity is not a requirement; therefore, a record of completion is not required.
1-2. Audience. All FAA employees who participate in CM activities conducted at a PAH and its associate facilities and suppliers.
1-3. Where Can I Find This Order. You can find this order at on the Directives Management System website at http://www.faa.gov/tools_resources/orders_notices/. This order is available to the public at http://www.faa.gov/regulations_policies/orders_notices/. This order is also available on the Regulatory and Guidance Library at http://rgl.faa.gov/.
1-4. Cancellation. FAA Order 8100.7E, Aircraft Certification Systems Evaluation Program, dated April 16, 2010, and all associated changes are canceled.
02/25/2013 8120.23
Chapter 2. Certificate Management Procedures
2-1. Chapter Information and Format. Chapter 3 of this order describes ongoing CM responsibilities and chapter 4 describes special CM responsibilities. Chapter 5 defines the role of CMIS regarding Quality System Audit (QSA) data. Appendixes A through S provide specific CM-related references and other administrative and feedback guidance.
2-2. Overview. CM responsibilities for a PAH or an associate facility will be accomplished by the Manufacturing Inspection District Office (MIDO)/Certificate Management Office (CMO) having responsibility of the geographical area in which the PAH or associate facility is located. The FAA remains responsible for CM when a product, article, or its supplied parts are produced in a location other than the United States. CM includes the following two functional responsibilities, each of which is further detailed in chapters 3 and 4 of this order. Figure 2-1 of this chapter depicts the CM life cycle process.
a. Ongoing CM Responsibilities. The MIDO/CMO responsible for a specific PAH or associate facility within its geographical boundaries accomplishes the following tasks on a continuing basis. Any tasks required to be scheduled and conducted at a supplier facility located in another U.S. geographical area should be handled in accordance with paragraph 3-64 of this order. For tasks required to be scheduled and conducted outside the United States, refer also to paragraph 3-3 of this order.
(1) Schedule and conduct Risk-Based Resource Targeting (RBRT) assessments of PAHs and associate facilities to identify any increased potential for producing nonconforming products, articles, or parts.
(2) Schedule and conduct principal inspector (PI) audits and QSAs at PAHs and associate facilities based on RBRT assessments.
(3) Schedule and conduct supplier control audits to determine that PAHs and associate facilities are satisfactorily controlling their suppliers.
(4) Schedule and conduct a product audit for QSA, PI, and supplier control audits in accordance with figure 3-1 of this order.
b. Special CM Responsibilities. The following tasks are accomplished on an as-required basis by the MIDO/CMO responsible for a specific PAH or associate facility within its geographical boundaries. Any tasks required to be scheduled and conducted at a PAH or supplier facility located in another geographical area should be handled in accordance with paragraph 3-64 of this order.
(1) Audit changes to a PAH’s or associate facility’s quality system that may affect the inspection, conformity, or airworthiness of the product, article, or part(s).
(2) Investigate service difficulties that involve quality system problems.
(3) Investigate regulatory violations.
(4) Ensure appropriate corrective actions have been proposed and taken for all noncompliances identified at a PAH or associate facility.
(5) Determine the need for unscheduled PI audits, QSAs, supplier control audits, product audits, and other investigation activity (for example, suspected unapproved part (SUP) investigation) necessary to ensure continued compliance with applicable regulations.
(6) Provide guidance and assistance to the PAH and associate facility as necessary.
2-3. Assignment of CM Coordinator. Many of the tasks identified in this chapter for Manufacturing Inspection Office (MIO), MIDO, or CMO managers are primarily administrative. A high degree of operational efficiency may be achieved by assigning many of these tasks to a designated CM coordinator. Directorate managers should consider whether such an assignment would be beneficial for their organizations. The types of tasks that a CM coordinator could coordinate include—
a. QSA candidate and auditor appointment and training.
b. Audit scheduling and QSA team selection; obtaining additional resources when required (refer to chapter 3 of this order).
c. Maintain supplier control audit list (refer to chapter 3 of this order).
d. Dissemination of general CM-related information.
2-4. Status of a PAH. For purposes of CM, the status of a PAH and its applicable project(s) can be identified as one of the following:
a. Pending. The FAA has received the production approval application and is in the process of auditing it, but has not yet issued the production approval.
b. Active. The FAA has issued the production approval and the PAH has produced and/or shipped products, articles, or parts within the past 12 months.
c. Inactive. The FAA has determined that the PAH has not produced or shipped products, articles, or parts within the past 12 months. A PAH may remain in an inactive status for three RBRT cycles (3 years).
(1) If the determination is to keep the PAH inactive in the third year, it must be approved by the office manager and noted in the PAH’s CMIS file.
(2) If the determination is to keep the PAH inactive in the fourth year, it must be approved by the MIO and noted in CMIS.
(3) An inactive PAH will be cancelled in the fifth year unless approved by a deviation to the order signed by the Aircraft Certification Service Operational Oversight Policy Branch (AIR-140).
d. Canceled. The FAA has completed action to revoke or otherwise terminate the PAH’s production approval.
Note: If the determination is to cancel, the PI should contact the PAH and discuss whether it wishes to voluntarily surrender its production approval. In the event the PAH does not surrender its production approval and has no plans for future production, the PI may seek further guidance from the Office of Chief Council.
Figure 2-1. CM Life Cycle Process
Legend
Action
Feedback
Document Results on
FAA Form(s) 8100-1,
8100-6, & 8120-14
Conduct Supplier
Control Audits
Document Results
on FAA Form(s) 8100-6 & 8120-14
Conduct QSAs
Document Results in
QSA Report
Aviation Industry
Document Results
on FAA Form(s) 8100-6 & 8120-14
Obtain Corrective Action (part of ad hoc
CM responsibilities)
Continuous Improvement
Document Results on
FAA Form(s) 8100-1,
8100-6, & 8120-14
Conduct Supplier
Control Audits
Document Results
on FAA Form(s) 8100-6 & 8120-14
Conduct QSAs
Document Results in
QSA Report
Aviation Industry
Document Results
on FAA Form(s) 8100-6 & 8120-14
Conduct PI Audits
Plan Product Audits
Conduct Product
Audits
Initiate Handoff Procedures as Required
Plan Directorate-led &
AIR-100-led QSAs
Plan Supplier Control
Audits
Notify Facilities Scheduled for QSAs
Plan PI Audits Schedule Product
Audits
Schedule PI Audits Initiate Handoff Procedures as Required
Schedule Supplier
Control Audits
Schedule QSAs &
Appoint Auditors
Select Product Audits Select Supplier
Control Audits Select QSAs
QSAs PI Audits Product Audits Supplier Control
Audits
Ad Hoc CM Responsibilities
Ongoing CM Responsibilities
Conduct RBRT Facility Assessment
Certificate Management Process
CMIS
Initiate Handoff Procedures as Required
02/25/2013 8120.23
Chapter 3. Ongoing CM Responsibilities
Section 1. Introduction
3-1. CM Tasks. Sections 2 through 6 of this chapter provide detailed guidance for accomplishing ongoing CM responsibilities. Figure 3-1 of this order provides a summary of the tasks associated with ongoing CM. These tasks are accomplished on a continuing basis, and are minimum requirements only. Additional CM tasks may be performed at the discretion of the managing office.
Figure 3-1. CM Responsibilities (Ongoing) Minimum Requirements
Risk Level CM Activity
LOW MEDIUM
LOW
MEDIUM
HIGH HIGH
Collection of
Facility Information
During PI audits;
by telephone in
out years
During PI audits During PI audits During PI audits
PI Audits
1 every 24-36 months; audit of top two noncompliant system elements/
subelements applicable at the facility, as identified
annually by each directorate through
an analysis of
CMIS data
1 not to exceed (NTE) every 18 months; audit of all system
elements/ subelements applicable at the
specific facility will be completed
in the interval between QSAs (Refer to Note 1)
1 NTE every 18 months; audit of all system
elements/ subelements applicable at the specific facility will
be completed in
the interval between QSAs (Refer to Note 1)
1 every quarter; audit of all system elements/
subelements applicable at the specific facility will be completed in the
interval between
QSAs
Supplier
Control
Audits
1 supplier NTE every 18 months (Refer to Note 1)
3 suppliers annually (Refer to Note 2)
Product
Audits
1 during every PI audit
1 during every QSA and PI audit
1 during every QSA, PI audit, and
supplier control
audit
1 during every QSA and supplier control
audit; 2 every
12 months in conjunction with
PI audits
QSAs 32-48 months 32-48 months 1 NTE every 24 months (Refer to Note 1)
General Note: Functions associated with shaded blocks are optional based on justified need (for example, audit results, history, investigation, or service difficulties). Note 1: NTE frequency is determined from the ending date of the last audit or, in the case of a new PAH, from its production approval date. Note 2: For PAHs having a screened supplier listing > 50 ≤ 100, conduct 6 supplier control audits annually. For PAHs having a screened supplier listing > 100, conduct 9 supplier control audits annually.
3-2. CM Plan. A CM plan assists the PI in planning and tracking the performance of ongoing CM responsibilities. Within a timeframe established by the MIO, each MIDO/CMO may prepare a CM plan annually for each PAH and associate facility after RBRT assessments have been completed. The MIDO/CMO may subsequently amend the CM plan as necessary to include additional or reduced requirements and schedule changes. As a minimum, the CM plan should include the following:
a. Name of PAH or associate facility.
b. Current RBRT risk level.
c. Schedules for PI audits, QSAs, product audits, and supplier control audits to be conducted within the geographical boundaries of the MIDO/CMO. For supplier control audits, and product audits at suppliers, include the names of the suppliers.
d. List of handoffs or Civil Aviation Authority (CAA) requests sent, including, as a minimum, the name of the geographic MIDO/CMO that has accepted the handoff or the CAA that has accepted the request, the type of audit requested, the name of the facility receiving the audit, and the name of the responsible PAH or associate facility.
e. List of handoffs or CAA requests received, including, as a minimum, the name of the geographic MIDO/CMO or CAA that has requested the handoff, the type of audit or surveillance requested, and the name of the applicable facility.
Note: The scheduling function in CMIS is intended to provide a starting point in the development of the CM plan. Should an inconsistency develop between the CMIS-generated number, frequencies, or scheduled dates of CM activities and the requirements in figure 3-1 of this order, figure 3-1 will take precedence.
3-3. Coordination of Requests for Supplier Surveillance Assistance with Other CAAs. When a supplier to a U.S. PAH is located in a country or jurisdiction having an applicable bilateral agreement with the United States, the FAA may seek supplier surveillance assistance from the bilateral CAA. Such assistance requests may take various forms at the PAH’s supplier (for example, ongoing surveillance, supplier control audits, or product audits), and may or may not be agreed to by the CAA, depending upon its availability of resources, common production approval facilities, etc. Requests for supplier surveillance assistance should be transmitted from the MIO manager of the directorate in which the PAH is located to a counterpart CAA production contact. If the CAA agrees to the request and the assistance is recurring, a management plan must be formulated between the FAA and the supporting CAA. The management plan must outline the details of the type of support requested, the methodology by which it will be performed (this is usually the normal surveillance system, procedures, and documentation of the local CAA), the frequency of the surveillance activity, documentation expectations, etc.
a. The Aircraft Certification Service Design, Manufacturing, and Airworthiness Division (AIR-100) has established management plans with certain European CAAs that permit those CAAs to conduct supplier surveillance activity on the FAA’s behalf, in accordance with
FAA Order 8120.13, International Cooperative Supplier Surveillance Program (ICSSP) Procedures. The management plans with the current ICSSP participants may be found at the Aircraft Certification Service (AIR) Work Tools page on the FAA Employees’ website. Supplier surveillance activity conducted outside the United States will be handled in accordance with FAA Order 8120.13 when the local authority is a program participant.
b. If the FAA must conduct the supplier surveillance activity itself in another country or jurisdiction, for whatever reason(s), the PI will perform the following activities:
(1) Notify the responsible CAA and invite CAA participation as an observer through a formal letter signed by the directorate MIO manager, or delegated signatory. The letter should be addressed to the production contact for the CAA. A list of CAAs and respective contacts is available from the International Policy Office, AIR-40. Send an electronic facsimile (fax), scanned copy, or e-mail of the letter 45 days before the audit, followed by mailing the formal letter. Notify the CAA of any changes in the audit’s schedule. The CAA’s participation in the audit is not mandatory, and the choice to provide an observer is at its discretion. The letter should, at a minimum, include the following information:
(a) Identity of the facility to be audited.
(b) Type of supplier surveillance activity to be conducted (supplier control audit, product audit, ongoing surveillance, etc.). Provide a general outline of what will be included in the scheduled activity.
(c) Date(s) of the scheduled activity.
(d) Number of FAA auditors participating in the scheduled activity.
(e) Name, address, telephone number, and e-mail address of responsible PI.
(2) Provide the PAH’s certificate managing office with details of any noncompliance encountered during the surveillance activity. For example, if there is a trend showing recurring test failures or nonconforming articles, it may be evidence of a system breakdown or a compliance problem at that facility. The PAH’s certificate managing office will determine if there are any system issues or major problems that should be forwarded to the applicable CAA for its consideration because the PAH’s supplier may coincidentally hold a local production approval.
3-4. Recording Noncompliances. The PI will record all noncompliances, including those reported by a CAA while performing CM activities for the FAA, on FAA Form 8100-6, Noncompliance Record, in accordance with the guidelines listed in appendix I to this order. The FAA will notify a PAH of noncompliances found at its supplier. For all other circumstances, the FAA will not reveal noncompliances to a manufacturer other than the particular manufacturer involved unless a formal request has been processed in accordance with the Freedom of Information Act. Refer to FAA Order 1270.1, Freedom of Information Act Program.
3-5. through 3-6. Reserved.
Section 2. Risk-Based Resource Targeting
3-7. RBRT Assessment Tool. The RBRT assessment tool is used to assign risk to a PAH according to the likelihood that it will produce nonconforming products, articles, or parts, and consequential results associated with introducing those products, articles, or parts into the system. RBRT assessments and associated procedures provide a consistent and justifiable basis for effective deployment of FAA resources when performing CM. Each directorate must annually assess PAHs using RBRT assessments.
3-8. Scope. Holders of a production certificate (PC), parts manufacturer approval (PMA), and/or technical standard order (TSO) authorization and their associate facilities are subject to an RBRT assessment. Suppliers, delegated facilities, holders of a letter of TSO design approval, and PAHs in an inactive status are not subject to an RBRT assessment.
3-9. RBRT Risk Levels. The RBRT assessment of each applicable facility is based on organizational and technical indicators that demonstrate a facility’s potential for producing nonconforming products, articles, or parts. Refer to appendix A to this order. The RBRT assessment results in assigning a facility one of the following risk levels:
a. High: Having a facility with the greatest potential to produce nonconforming products, articles, or parts.
b. Medium (Medium Low and Medium High): Having a facility with moderate potential to produce nonconforming products, articles, or parts.
c. Low: Having a facility with low potential to produce nonconforming products, articles, or parts.
3-10. RBRT Assessment of Facilities. The FAA will assess facilities annually using the RBRT assessment tool.
a. The assessment of facilities will be completed annually, and not later than April 30.
b. The accuracy of the information entered into the RBRT assessment tool depends upon the PI’s knowledge, with assistance from others, of the status of each facility being assessed. To this end, the PI should collect the information required to answer the indicator questions when the PI is in the facility, or by telephone for facilities in those years when PI audits are not scheduled. For a new facility, information obtained during the MIDO audit should be used.
c. The PI may use the Category Parts List (CPL) described in appendix B to this order to answer the criticality indicator question.
d. When appropriate, the PI should contact each facility to obtain current or clarifying information relevant to the RBRT indicators being assessed. The PI should contact each facility previously designated as inactive to determine whether the facility’s status has changed.
e. The PI will conduct the RBRT assessment in accordance with the instructions provided in CMIS.
02/25/2013 8120.23
f. The RBRT assessment tool requires an approving official, usually the MIDO/CMO manager or their delegate, to review the calculated risk level and the recommended CM requirements. To the greatest extent possible, the PI and MIDO/CMO manager or their delegate should agree on the final risk level. The MIDO/CMO manager or their delegate will indicate approval in accordance with the instructions provided in CMIS.
3-11. Modification of RBRT Assessment. Circumstances may arise following the annual identification of RBRT risk levels that may challenge the assigned risk level for a specific facility. When any of the following conditions occur at a facility after a risk level has been assigned, the PI should complete a new RBRT assessment in accordance with the instructions provided in CMIS. Refer to appendix A to this order to determine the significance of the following conditions:
a. Changes in unit criticality.
b. Significant quality system changes.
c. Significant change in key management.
d. Significant turnover of critical staff.
e. Significant increase or reduction in workforce.
f. Deliberate non-responsiveness to corrective action requests.
g. Significant service difficulties attributed to manufacturing or quality system problems.
h. Addition of a complex manufacturing process.
i. Addition of a complex product, article, or part(s).
j. Significant change in the use of suppliers/outsourcing.
k. Significant increase in the use of foreign suppliers.
l. Movement or shift of production location or volume.
m. Expiration of a labor contract; potential labor unrest.
Note: When the schedules, as established in the CM plan, for PI audits, QSAs, product audits, and supplier control audits are impacted by a change in the assigned risk level, the PI should adjust the CM plan accordingly. Auditing activity should increase where critical manufacture or processing is occurring (including suppliers of any tier). Auditing activity should decrease for facilities or suppliers engaged in non-critical manufacture or processing.
3-12. Modification of RBRT Assessment Tool. The RBRT assessment tool includes several quasi-quantitative factors that result in the identification of quality systems according to their potential to produce nonconforming products, articles, or parts. AIR-100 will periodically audit the RBRT assessment tool. Any proposed modifications to the RBRT assessment tool require formal Aircraft Certification Management Team approval. AIR-100 will coordinate the implementation of any changes to the RBRT assessment tool, including development and dissemination of revised program guidance, updated CMIS programming, and revised RBRT assessment training materials.
3-13. through 3-14. Reserved.
Section 3. Quality System Audit
Part 1. QSA Introduction
3-15. General. The QSA is a component of CM and is a comprehensive audit program. It is a vital element within the FAA’s mission of continued operational safety and is excluded from the U.S. Department of Transportation’s plan to reduce internal regulations by 50 percent. The QSA—
a. Ascertains whether PAHs and associate facilities meet the applicable requirements of 14 CFR and comply with procedures established to meet those requirements.
b. Applies standardized audit criteria.
c. Populates a database for analyzing audit results and reporting trends.
d. Provides continuous improvement for the FAA by continually auditing customer feedback reports and considering proposed improvements by FAA internal and external customers.
e. Evaluates the continued integrity of the design data at PAHs and associate facilities after initial approval by the FAA. However, the QSA does not reevaluate the approval of previously approved data such as quality manuals or design data.
3-16. through 3-17. Reserved.
Part 2. QSA Auditor Appointment and Training
3-18. General. The appointing officials designated in paragraph 3-19 of this order will select QSA auditor candidates who have attained a specified level of experience, or a combination of experience and education, as engineers, flight test pilots, or aviation safety inspectors (ASI), and who have demonstrated technical knowledge and skills. A candidate will receive QSA training and serve as an auditor-in-training during QSAs under the direct supervision of an appointed QSA team leader, before appointment as a QSA team member. Before appointment, a candidate for auditor team leader will have participated in QSAs as an appointed team member and will perform as a team leader-in-training under the direct supervision of an appointed QSA team leader.
3-19. Appointing Officials. The following directorate and headquarters managers are authorized to select QSA auditor candidates and to appoint qualified candidates as QSA team members or team leaders within their respective organizations:
a. Aircraft Certification Office (ACO) managers and ACO branch managers.
b. MIO, MIDO, and CMO managers.
c. Directorate Standards Staff managers.
d. AIR-100 branch managers.
3-20. Criteria for Candidate Selection. The appointing official will select engineering, flight test or ASI candidates on the basis of the following criteria (refer to figure 3-2):
a. Candidates have attained at least one of the following specified levels of experience or a combination of experience and education in their specific disciplines:
(1) At least 8 years of technical experience in aerospace manufacturing or design, or in the audit thereof.
(2) Technical or trade school certificate with 6 years of technical experience in aerospace manufacturing or design, or in the audit thereof.
(3) Associate’s degree in engineering or science disciplines, with 5 years of technical experience in aerospace manufacturing or design, or in the audit thereof.
(4) Bachelor’s degree or higher in engineering or science disciplines, with 3 years of technical experience in aerospace manufacturing or design, or in the audit thereof.
b. Candidates have demonstrated—
(1) Technical knowledge in aerospace manufacturing or design and understanding of FAA goals and objectives, and
(2) Effective oral, written, communication, and interpersonal skills.
Figure 3-2. Criteria for Candidate Selection
and Team Member Appointment
3-21. Criteria for Appointment. Appointment is the formal process of certifying a QSA candidate as a QSA team member or team leader on the basis of successful completion of all requirements (refer to figures 3-2 and 3-3).
a. Team Member. Candidates must meet the following minimum requirements before appointment as a team member (refer to figure 3-2):
(1) Satisfactory completion of the QSA training course and associated written examination. The course will provide training in the policy established in this order, including the techniques for applying the standardized audit criteria contained in appendix H to this order, and in coordinating team member involvement.
Note: The Planning and Program Management Division, AIR-500, will ensure classes are scheduled in accordance with AIR priorities as identified in the annual call for training.
Bachelor’s degree
in Engineering or Science + 3 years tech experience in
aerospace mfg.
or design, or evaluation?
8 years technical experience in
aerospace manufacturing
or design, or evaluation?
Tech or trade school certificate
+ 6 years tech
experience in aerospace mfg.
or design, or evaluation?
Assoc. degree in
Engineering or Science + 5 years tech experience in
aerospace mfg.
or design, or evaluation?
Satisfactory completion of
QSA training
course?
Participation in
at least two QSA audits as an
auditor-in-
training?
CANDIDATE ELIGIBLE FOR APPOINTMENT AS
QSA TEAM MEMBER
CANDIDATE NOT ELIGIBLE
FOR APPOINTMENT AS
QSA TEAM MEMBER
No No No
No
Yes Yes Yes Yes No
No
Yes
Yes
(2) Participation of the candidate, and demonstration of the knowledge and skills acquired during QSA team training in at least two QSAs as an auditor-in-training.
Note: The candidate’s appointing official must schedule the candidate’s participation as an auditor-in-training to be completed in as short a timeframe as possible to maximize the candidate’s use and retention of acquired knowledge and experience.
(3) The candidate’s appointing official is responsible for performing the following activities in auditing the team member candidate:
(a) Consider the candidate’s previous experience and education.
(b) Consider the product complexity, facility size, and complexity of system elements audited in QSAs in which the candidate participated.
(c) Discuss with team leader(s) audits in which the candidate participated to determine the candidate’s QSA readiness.
(d) Review QSA reports for audits in which the candidate participated.
(e) Review, when necessary, FAA Form(s) 8100-7, QSA Customer Feedback Report, for audits in which the candidate participated.
(f) Interview the candidate.
(g) Discuss with the candidate any weaknesses or deficiencies in their audit readiness identified during the participation phase. Both parties will work to reduce or eliminate these weaknesses or deficiencies through additional training, additional QSAs, Air Transportation Oversight System/Air Carrier Evaluation Program audits, or other similar activities that will increase the candidate’s audit readiness.
(4) On the basis of satisfactory results of the audit of the candidate as listed in paragraph 3-21a(3) of this order, the candidate’s appointing official will appoint the candidate as a team member and add the individual to the auditor’s module of the CMIS program.
b. Team Leader. Candidates must meet the following minimum requirements before appointment as a team leader (refer to figure 3-3):
(1) Current appointment as a QSA team member.
(2) Ability to mentor and instruct team members.
(3) Participation in at least three audits as an appointed QSA team member. The candidate’s appointing official may request reduction of the requirement by providing documented justification to the appointing official’s manager. The responsibility for requesting any reduction of the requirement rests solely with the candidate’s appointing official.
Figure 3-3. Criteria for Team Leader Appointment
Written justification from appointing official
for reduction of
requirement?
Appointment as
QSA team
member?
Participated in at least 3 audits as a
team member?
Participated in at
least 3 audits
as a team leader-in-training?
CANDIDATE ELIGIBLE FOR APPOINTMENT AS
QSA TEAM MEMBER
Written justification from appointing official
for reduction of
requirement?
Manager approval?
CANDIDATE NOT ELIGIBLE
FOR APPOINTMENT AS
QSA TEAM MEMBER
Manager approval?
Yes Yes
Yes
No
No
Yes
No
No
No
No
Yes
Yes Yes
(4) Participation as a team leader-in-training, and demonstration of knowledge and skills acquired during QSA team training in at least three QSAs under the direct supervision of an appointed QSA team leader. The candidate’s appointing official may request reduction of the requirement by providing documented justification to the appointing official’s supervisor. The responsibility for requesting any reduction of the requirement rests solely with the candidate’s appointing official.
Note: The candidate’s appointing official must schedule the candidate’s participation as a team leader-in-training to be completed in as short a timeframe as possible to maximize the candidate’s use and retention of acquired knowledge and experience.
(5) The candidate’s appointing official is responsible for performing the following activities in auditing the team leader candidate:
(a) Consider the candidate’s previous experience and education.
(b) Consider the product complexity, facility size, and complexity of system elements audited in QSAs in which the candidate participated.
(c) Discuss with team leader(s), audits in which the candidate participated to determine the candidate’s team leadership abilities.
(d) Review QSA reports for audits in which the candidate participated.
(e) Review, when necessary, FAA Form(s) 8100-7 for audits in which the candidate participated.
(f) Interview the candidate.
(g) Discuss with the candidate any weaknesses or deficiencies in their team leadership abilities identified during the participation phase. Both parties will work to reduce or eliminate these weaknesses or deficiencies through additional training, additional QSAs, Air Transportation Oversight System/Air Carrier Evaluation Program audits, or other similar activities that will increase the candidate’s leadership abilities.
(6) On the basis of satisfactory results of the audit of the candidate as listed in paragraph 3-21b(5) of this order, the candidate’s appointing official will appoint the candidate as a team leader and update the auditor’s module of the CMIS program.
c. The candidate’s appointing official will document and track the completion of the requirements in paragraphs 3-21a and b of this order for all QSA candidates. Upon successful completion of the requirements, the appointing official will appoint the candidate as a QSA team leader or team member and will formally notify the candidate of his or her appointment through issuance of a formal CMIS-generated acknowledgement letter. The letter will include the individual’s discipline and office identification.
02/25/2013 8120.23
Note: Provide notification of appointment before the auditor’s first scheduled QSA as a team member or team leader.
3-22. Review of Appointment. The cognizant appointing official (1) reviews the participation in QSAs by each auditor under their appointment authority, (2) notifies auditors in writing, of decisions not to continue their appointment, and (3) determines the currency and continued validity of appointments as follows.
a. QSA Team Members. Review QSA team members’ participation annually. Ensure team members have accomplished the following requirements, as a minimum:
(1) Participated at an interval of once or more every 2 fiscal years as a QSA team member or QSA team leader, or conducted PI audits or MIDO audits in accordance with chapter 3, section 5 of this order.
Note: A supplier control audit does not count toward the continued appointment of a QSA team member.
(2) Demonstrated knowledge and skill in QSAs, as determined from sources such as the QSA report, team leaders, cognizant managers, and satisfactory corrective action for any shortcomings in knowledge or skills noted and discussed with the team member during the interim period.
b. QSA Team Leaders. Review QSA team leaders’ participation annually. Ensure team leaders have accomplished, at a minimum the following requirements:
(1) Participated at an interval of once or more every 2 fiscal years as a QSA team leader or as a team leader for a PI audit or MIDO audit with multiple team members in accordance with chapter 3, section 5 of this order.
Note: A supplier control audit does not count toward the continued appointment of a QSA team leader.
(2) Demonstrated knowledge and skill in QSAs, as determined from sources such as the QSA report, cognizant managers, and satisfactory corrective action for any shortcomings in knowledge or skills noted and discussed with the team leader during the interim period.
3-23. Reinstatement of Auditors Failing to Meet Appointment Review Criteria. Appointing officials may reinstate auditors under their appointment authority who have not met the appointment review criteria listed in paragraph 3-22 of this order. Use the following criteria to determine eligibility for reinstatement:
a. Team members and leaders who have not met participation requirements may be reinstated after acceptable participation as an auditor-in-training, or as a team leader-in-training as applicable, in two QSAs.
b. Team members who have not demonstrated QSA knowledge or skills may be considered for reinstatement by repeating the formal QSA team member appointment program listed in paragraph 3-21a of this order.
c. Team leaders who have not demonstrated QSA knowledge or skills may be reinstated as a team member after acceptable participation as an auditor-in-training in two QSAs. Consideration for reinstatement as a team leader must then follow the formal QSA team leader appointment program listed in paragraph 3-21b of this order.
3-24. through 3-25. Reserved.
Part 3. Selection and Scheduling of QSAs
3-26. QSA Intervals. Audit intervals for PAHs and associate facilities are identified in figure 3-1 of this order.
3-27. Selection of Facilities To Be Audited. Procedures for selecting PAHs and associate facilities to be audited are identified in chapter 3, section 1 of this order.
3-28. Scheduling of QSAs. After all facilities have been selected for audit in accordance with paragraph 3-27 of this order, each directorate will be responsible for scheduling QSAs at the selected facilities. Use the following procedures:
a. Estimate the onsite duration of each QSA according to the following information. Consider the quality and/or engineering procedures and processes required to be in place, the number of applicable system elements, when known (refer to appendix H to this order), the size and physical layout of the facility to be audited (single or multiple locations), and product complexity. Allow enough time to ensure that compliance to the applicable 14 CFR and FAA-approved data will be fully audited. Use the following list as a guide for estimating, in terms of facility size only, the onsite duration of the QSA (excluding travel times).
(1) Small facility with fewer than 100 total full-time persons: 1 to 5 working days onsite.
(2) Medium facility with 100 to fewer than 400 total full-time persons: 3 to 5 working days onsite.
(3) Large facility with 400 to fewer than 2,000 total full-time persons: 5 to 10 working days onsite.
(4) Very large facility with 2,000 or more total full-time persons: 7 to 15 working days onsite.
Note: When estimating the onsite duration, include only those persons who are used to support the PAH activity.
b. Assign all scheduled audits a distinct QSA number, consisting of the fiscal year, directorate code (NE—Engine and Propeller Directorate, CE—Small Airplane Directorate, SW—Rotorcraft Directorate, or NM—Transport Airplane Directorate), and the audit order sequence. For example, 09CE123 represents the 123rd audit planned for completion by the Small Airplane Directorate during fiscal year 2009.
Note: Do not reassign QSA numbers from canceled audits. Each scheduled audit must be uniquely identified.
c. Identify the lead audit office for each audit. This office is usually the one that performs CM responsibility at the facility to be audited. For an associate facility subject to CM under the handoff procedure, the lead audit office is the geographic office receiving the handoff. The lead audit office is responsible for—
(1) Coordinating the notification letter (refer to paragraph 3-30 of this order), and
(2) Notifying the selected team leader and team members (refer to paragraph 3-34 of this order).
d. Prepare an audit schedule for the current fiscal year based on the facility selection criteria in paragraph 3-27 of this order and the duration of each audit.
(1) Prepare the schedule using the following guidelines:
(a) QSA number.
(b) Scheduled start date of each audit.
(c) Duration of each audit.
(d) Facilities and types of approvals to be audited.
(e) RBRT risk level.
(f) Product lines or authorized functions at the facilities to be audited.
(g) Number and disciplines of auditors assigned to each audit.
(h) Additional auditors required beyond the directorate’s resources.
(i) Number and disciplines of auditors-in-training and team leaders-in-training.
(j) Total number of audits scheduled for the fiscal year.
(k) Applicable project number(s).
(2) All directorate schedules will be entered into the schedule module of the CMIS program.
02/25/2013 8120.23
(3) The ACO, MIO, MIDO, and CMO managers should schedule approval holders with multiple approvals, such as a PC and a PMA, so as to evaluate all approvals during one audit.
(4) When an approval holder has multiple facilities that require significant resources and time to audit, the ACO, MIO, MIDO, and CMO managers should consider scheduling the facilities individually.
e. Designate an assigned engineer (AE). On the basis of the data collected for paragraphs 3-26 through 3-28d of this order, the ACO manager determines the need to assign an FAA engineer responsibility relating to a scheduled QSA at a particular design approval facility. The AE must answer questions from the auditors regarding the FAA-approved design or the design approval system in place. The AE also must coordinate any corrective action required regarding the FAA-approved design or the design approval system.
3-29. Selection of QSA Auditors. The ACO, MIO, MIDO, and CMO managers select appointed QSA auditors to perform each scheduled audit. To broaden expertise, whenever possible, managers are encouraged to permit auditors to participate in QSAs scheduled within the jurisdiction of other directorates. Determine the number and types of auditors required for each audit according to the following criteria:
a. Number of Auditors Required. Determine the total number of auditors required to ensure that compliance to the applicable 14 CFR and FAA-approved data would be fully verified.
(1) Estimate the number of auditors required according to the following minimum criteria:
(a) RBRT assigned risk level.
(b) Number and complexity of applicable quality, engineering, flight test, and facility procedures and processes in place.
(c) Number of applicable system elements, when known (refer to appendix H to this order).
(d) Number of PAH suppliers expected to receive an onsite visit as part of the PAH QSA supplier control system element, when known.
(e) Size and physical layout of the facility to be audited (single or multiple locations).
(f) Product or design approval system complexity.
(2) Use the following as a guide for estimating the number of QSA auditors required. Increase or decrease the number of estimated auditors shown below, depending on your review of the criteria contained in paragraph 3-29a(1) of this order and your confidence that compliance to the applicable 14 CFR and FAA-approved data will be fully audited:
(a) Small facility with fewer than 100 full-time persons: 1 to 3 auditors (including team leader).
(b) Medium facility with 100 to fewer than 400 total full-time persons: 1 to 5 auditors (including team leader).
(c) Large facility with 400 to fewer than 2,000 total full-time persons: team leader plus 5 to 10 auditors.
(d) Very large facility with 2,000 or more total full-time persons: team leader plus up to 10 auditors.
Note 1: When estimating the number of auditors required, include only those full-time persons who are used to support the PAH facility activity.
Note 2: When necessary, the appropriate ACO and MIO managers will assign additional auditors as needed.
(3) If it is determined that one auditor is required, select an appointed team leader to perform the audit; this auditor is referred to as the principal auditor. If two or more auditors are selected for an audit, they will constitute a QSA team. Select an appointed team leader and the required number of appointed team members.
b. Types of Auditors Required. Use the criteria identified in paragraphs 3-29a(1)(a) through (f) of this order and the following criteria to determine the types of auditors required. Select appointed QSA auditors who have appropriate knowledge of the audit criteria identified in appendix H to this order applicable to the facility to be audited and, as appropriate, to the product(s) authorized by the approval (for example, select a propulsion engineer when an engine manufacturer is to be audited and select a flight test pilot when a flight test program is to be audited). When making this determination, consider the following:
(1) It is not necessary to select both engineers and inspectors for a small facility that does not have both engineering and manufacturing capabilities.
(2) Select appointed QSA auditors, as appropriate, to maintain continued appointment in accordance with paragraph 3-22 of this order.
(3) Do not include any appointed auditors who were previously employed by the facility to be audited within 2 years of the scheduled audit.
(4) Determine whether auditors will be made available throughout the duration of the audit. Each auditor is expected to fully participate in each audit. Base any decision to limit participation on the established AIR priorities. Notify the team leader of any limited participation by auditors.
c. Selection of PI and AE as Team Leaders or Auditors. To the greatest extent practicable, the PI and the AE will not be selected as team leaders on QSAs of facilities for which they have CM or surveillance responsibilities. Use the guidelines in table 3-1 to select the PI and/or AE as auditors:
Table 3-1. Selecting a PI or AE as an Auditor
Number of Persons Performing the Audit PAH Facility Procedure
One- or two-person Do not select the responsible certificate management PI. Do not select the AE if the AE is the engineer assigned design responsibility for the facility to be audited.
Note: For audits with at least three team members, the ACO, MIO, MIDO, and CMO managers, to the greatest extent practicable, will select as auditors the PI, or assistant PI as appropriate, and/or the AE. The ACO, MIO, MIDO, and CMO managers should assess the logistical and personal burden of selecting the PI and/or AE for all applicable audits, and should assign the PI and/or AE to audits through which the greatest benefit may be obtained. Three- or four-person Select as a team member either the responsible certificate management PI or the AE, if the AE is the engineer assigned design responsibility for the facility to be audited. If the AE is not assigned design responsibility, both the AE and the responsible certificate management PI may be selected as team members. Five-person or greater Select as a team member either the responsible certificate management PI or AE, or both.
d. Selection of Auditors-in-Training and Team Leaders-in-Training.
(1) Determine the number of appointed auditors required for the QSA before assigning auditors-in-training. Assign auditors-in-training only to audits for which a team is required. Do not assign auditors-in-training to a principal auditor. Auditors-in-training will supplement appointed auditors. Do not substitute auditors-in-training for appointed QSA auditors, or audit team leaders-in-training for appointed QSA team leaders.
(2) Do not assign more than two auditors-in-training or more than one team leader-in-training to any one audit. Try to assign each auditor-in-training or team leader-in-training to different team leaders during the participation phase of the training.
(3) In cases where auditors-in-training or team leaders-in-training from other directorates or AIR-100 are proposed to be used in an audit, coordinate with the appointing managers to establish their eligibility.
e. Additional Resource Requirements. Additional auditors beyond the directorate’s available resources may be required depending on the size of the facility; type and complexity of product, service, or design approval system; and overall audit objectives. Each directorate should identify the need for these additional resources before the release of the QSA master schedule for the next fiscal year and coordinate the participation of the auditors with the appropriate directorate office and CMIS coordinators. Additional support may also be available from AIR-100, if requested. If these sources of support are not available, the directorate may obtain outside support services to augment directorate resources. Support service personnel will be qualified and credible quality assurance experts and technology specialists and will meet the criteria for candidate selection specified in paragraph 3-20 of this order. Directorates will obtain any required support service personnel in accordance with budgetary directives. Appendix D to this order contains sample contract clauses relating to obtaining support services.
Note: The cognizant directorate will complete all necessary administrative measures required for facility access by support service personnel before the scheduled QSA. The measures may include obtaining any security clearances from the prospective facility, ensuring that personnel have signed a certificate of nondisclosure for confidentiality of information (refer to appendix D to this order), and ensuring that personnel are aware of their limitations (as agreed to between the directorate and the facility to be audited) of access and entry to the facility’s proprietary or sensitive processes or systems.
f. Scheduled Changes. Each directorate must update schedule changes electronically in the CMIS program at least quarterly. Audits added to the master schedule will be assigned a new QSA number in accordance with paragraph 3-28b of this order.
3-30. Notification of Facilities To Be Audited. The lead audit office identified in accordance with paragraph 3-28c of this order will notify facilities using the sample formats in appendixes E and F to this order. Coordinate with the responsible PI to ensure that the letter does not arrive during scheduled shutdown periods or during any other extended periods when the letter may not be acted upon. For notifications of first-time QSAs, inform the facility that QSA reference material is available on the FAA’s website. If the facility cannot access the website, provide the reference material to the facility. Appendix F to this order provides a summary of notification letter requirements. Notify facilities as follows:
a. PAH/Associate Facility. The lead audit office will perform these tasks:
(1) Prepare the notification letter and send it to the facility to be audited no later than 50 calendar days before the audit.
(2) Provide a copy of the notification letter to the designated audit team leader or principal auditors, the PI, and the AE.
b. Changes After Notification Letter Is Sent. As appropriate, notify the facility, responsible PAH or associate facility, requesting MIDO or CMO, AIR-100, and the team leader or principal auditor of any changes to the audit schedule or team composition after the notification letter has been sent.
3-31. Modifications to Scheduled Audits. Every effort will be made to maintain established audit schedules. However, modifications to the audit schedule should be considered under special circumstances. The ACO, MIO, MIDO, and CMO managers will jointly reschedule any affected audit in coordination with the PI, AE, and the team leader or principal auditor, and update the schedule in the CMIS program. Special circumstances that may warrant modifications to the audit schedule include—
a. Risk to auditors’ safety,
b. Change in a facility’s production or delegation status from active to inactive,
c. Involvement of the FAA in a labor-management dispute at a facility, and
d. Reduction in the effectiveness of the audit.
3-32. through 3-33. Reserved.
Part 4. QSA Procedures
Subpart A. QSA Preparation
3-34. Lead Audit Office. Perform, at a minimum, the following QSA preparations:
a. Notify, through CMIS, the selected audit team leader and team members, or the principal auditor, at least 60 calendar days before each directorate QSA. A record of the notification does not need to be retained.
b. Ensure logistical support for an audit within the geographical area.
3-35. ACO, MIO, MIDO, and CMO Managers. At least 60 calendar days before each audit, notify through CMIS all auditors within the directorate selected for AIR-100-led QSAs and QSAs in support of other directorates. A record of the notification does not need to be retained.
3-36. Audit Team Leader or Principal Auditor. Coordinate QSA preparation to enable the audit team to make the most of limited time in the facility. The team leader provides orientation to team members, and assigns system elements to team members. These actions, as appropriate, require coordination with the PI, AE, and the facility to be audited. The team leader or principal auditor will perform the following, as appropriate:
a. Upon receipt of a copy of the notification letter, contact the lead audit office to identify the responsible PI and AE and obtain from the PI and AE such items as the following:
(1) Applicable FAA-approved procedures, including engineering and quality manuals, procedures manuals, and handbooks, when practical. Obtain documentation in electronic format, if available, to simplify copying and distribution to team members. If applicable data are available only electronically, work with the PI or AE to identify relevant documents and to obtain printed copies of only those pages necessary to support the QSA.
(2) Current facility data available in CMIS.
(3) Known or suspected problem areas, including any areas the PI and AE would like special emphasis on during the QSA, such as requests to conduct a product audit. The team leader should also confer with the PI to identify and become familiar with the following quality system attributes as applicable:
(a) Critical processes (including special processes) and critical suppliers.
(b) Recent design changes.
(c) Significant changes in manufacturing personnel, procedures, or inspections.
(d) Rework and scrap data.
(e) Material Review Board history.
(f) Quality escapes.
(g) Any additional relevant correspondence or data pertaining to issues discovered in the course of new product deliveries or acceptance.
(h) Service difficulties.
(i) Airworthiness Directives (AD).
(j) Relevant issues identified in the Monitor Safety Analyze Data (MSAD) database.
Note: The team leader should contact the appropriate facility representative before the audit to arrange to have any information referenced in (a) through (j) above or other relevant quality data, procedures, or records available for the team at the in-briefing as referenced in the facility notification letter and deemed necessary by the team leader.
(4) Recent self-disclosure items reported under FAA Order 2150.3, Compliance and Enforcement Program.
(5) Agreements made between the cognizant ACO, MIO, MIDO, or CMO and the facility to be audited.
(6) Facility access information, including badges and security clearances.
(7) Lodging information.
(8) Any other items necessary to prepare for the audit.
b. Prepare a written audit plan, using the form found in the CMIS program, for conducting the audit. The audit plan includes the following items:
(1) Name and address of the facility to be audited.
(2) Dates of the audit.
(3) Names of the team leader and members (when more than one auditor is selected).
(4) Audit objectives. List the reason for the QSA and what information is expected to be obtained during the audit (for example, establish facility compliance with the procedures established to meet the applicable requirements of 14 CFR or establish cause of repetitive Service Difficulty Reports (SDR)).
(5) Type(s) of approval.
(6) Type certificate (TC) or supplemental type certificate (STC) number, as applicable.
(7) Current product line.
(8) Number of employees associated directly with the production approval activity.
(9) List of top-level FAA-approved procedures (for example, quality manual index of procedures, procedures manual, PMA approval letter, and TC data sheets).
(10) FAA/facility agreements in effect; for example, agreement on frequency of submittal of minor design changes.
(11) Plant layout.
(12) Organizational chart.
(13) Major processes.
(14) Unusual features of the product, manufacturing and inspection methods, or design approval system.
(15) Self-disclosure items under FAA Order 2150.3.
(16) Special emphasis items recommended by the PI and AE.
(17) System element, to include product audit, assignments (when more than one auditor is selected).
(18) Access information, including facility point of contact.
(19) Lodging information.
(20) Equipment required (for example, notebook computer, safety shoes, and coveralls).
c. Coordinate assignments, requirements, and arrangements with team members as far in advance of the audit as possible, but no later than 30 calendar days before the audit. The audit plan may be amended as necessary. Notify team members immediately of changes in schedule, assignments, requirements, and arrangements. Provide copies of all relevant facility documents to team members, when feasible.
d. Forward an FAA certificate of nondisclosure (refer to appendix D to this order) to any outside support service personnel assigned no later than 35 calendar days before the audit. Obtain signed statements no later than 25 calendar days before the audit and forward them to the facility via the PI.
e. Notify the lead audit office immediately of changes in team numbers or composition.
f. Coordinate with the applicable PI or AE, or geographic PI, as necessary.
3-37. Audit Team Member. Perform these tasks:
a. Upon notification by the team leader, confirm availability for the QSA, system elements assigned, and travel arrangements.
Note: Notify the team leader immediately if you become unavailable for the QSA.
b. Before the audit, review all material provided by the team leader, the PI, or the AE appropriate to the assigned system elements. When possible, make a preliminary selection of the procedures you plan to audit.
3-38. through 3-39. Reserved.
Subpart B. Conduct of the Audit
3-40. Team Leader or Principal Auditor Coordination with Facility Representative. The team leader or principal auditor will coordinate with the designated representative of the facility to be audited to ensure that administrative arrangements for items such as team access, escorts, meeting rooms, and safety and security requirements are complete. The team leader should take this opportunity to review the special emphasis areas described in paragraph 3-36a(3) with the facility representative and arrange with the representative to have applicable information available to the FAA at the pre-audit team meeting.
02/25/2013 8120.23
3-41. Pre-Audit Team Meeting. The team leader and all team members meet in advance of starting the audit, usually at the facility to be audited. They review the following audit elements, as appropriate, for proper coordination and understanding:
a. Current quality system or design approval system, and corrective action history of the facility to be audited in the selected areas.
b. Team functional assignments.
c. Audit plan.
d. Audit objectives.
e. Working relationship of the facility to be audited with the FAA.
f. Organizational structure of the facility to be audited.
g. Approved quality system documents, including quality manuals and/or quality data submitted by PAHs to describe their quality systems.
h. Approved design approval system documents, including any procedures manual or handbook.
i. Agreements made between the cognizant ACO, MIO, MIDO, or CMO and the facility to be audited.
3-42. Pre-Audit Conference. Soon after arrival at the facility to be audited, the audit team leader or principal auditor conducts a pre-audit conference with appropriate senior management, cognizant supervisory personnel, and other appropriate personnel of the facility who will be associated with the audit, including escorts. The team leader or principal auditor must perform the following tasks, as appropriate:
a. Introduce team members and support service personnel.
b. Give a brief overview of QSA, highlighting the cooperative intention of the audit.
c. Provide the audit’s scope and objectives.
d. Review details of the audit agenda, including the standardized audit criteria and procedures to be used.
e. Review administrative arrangements for the post-audit conference.
f. Discuss FAA Form 8100-7 sent with the notification letter to the facility being audited. Explain that this form is designed to obtain senior management assessment of the conduct of the QSA and is used by the FAA for continuous quality improvement of the CM program. Encourage senior management to complete the form and send it to the address on the form within 30 calendar days of the post-audit conference.
02/25/2013 8120.23
g. Allow time for a question-and-answer session.
3-43. Audit of System Elements. The QSA team audits up to six system elements and conducts at least one product audit at PAHs and associate facilities. Each system element addresses a specific activity or function that may affect the maintenance of FAA-approved design or quality data. Each system element is defined in appendix H to this order. The QSA team will perform the following tasks, as appropriate:
a. Review FAA-approved quality systems manuals or procedures manuals/handbooks to determine if current data ensure that regulatory requirements are met, if conforming products, articles, and parts are manufactured, and if design approval systems are maintained and controlled.
b. Review design system, design approval system, and quality system data to determine if current data are FAA-approved.
c. Review other facility procedures (related to the production approval facility) that are not part of the facility’s FAA-approved data to determine if the current procedures impact any of the system elements.
d. Review PAH supplier records by selecting a random sample of PAH supplier audit reports. (Refer to appendix H, section 6, paragraph 1a to this order.)
(1) The reports may consist of onsite audits, mail-in surveys, third-party audits, or a combination of all three. The reports must be reviewed for compliance with the PAHs’ quality system requirements. This may include, but is not limited to, the following conditions:
(a) Adherence to scheduled frequency of supplier control audits.
(b) Appropriate documentation of audits. This includes a signature by an appropriate authority, and attachment of required certifications and test documents.
(c) Determination of whether noncompliances provide evidence of root cause, corrective action, followup, and closure.
(d) If a history of similar noncompliances is evident, determination of whether the PAH is appropriately conducting root cause analysis and applying corrective action.
(2) FAA Form 8100-1, Conformity Inspection Record, will be used to record the following information. The completed record will be entered in CMIS as part of the QSA report.
(a) Total number of audit reports reviewed.
(b) Identification of suppliers reviewed.
(c) Total number of noncompliances documented for all supplier reports reviewed.
(3) The component page of the QSA report titled Special Emphasis Items may be used to record any additional or supplemental information pertaining to the supplier audit record review that the auditor considers important. Include this information as a note under the heading, “Note to MIO Manager and Cognizant Principal Inspector”.
Note: The results will be used for two purposes: (1) to identify areas that may require more focused attention during audit of the supplier control system element and (2) as input into the following year’s RBRT assessment of the PAH.
(4) Any noncompliance noted during the review of PAH supplier audit reports will be recorded under supplier control system element criteria number 602. Noncompliance will also be documented in accordance with paragraph 3-38 of this order.
Note: Paragraph 3-43d and appendix H, section 6, paragraph 1a of this order apply only to PAH facilities that use suppliers in the process of manufacturing FAA-approved products. Review of supplier records should be started early in the audit process to allow for additional time in case issues are noted.
e. Audit Compliance to Facility Procedures and Quality Requirements. Prioritize audit according to any special concerns raised by the PI or AE. Use the standardized audit criteria in appendix H to this order to determine the depth of the audit in the subject area. Perform, as necessary, a combination of document and product review to determine if the system element meets applicable requirements.
Note: The standardized audit criteria are a list of questions and related statements of condition in appendix H to this order used primarily to plan and document the results of the audit of each system element in a standardized manner. The criteria are designed to cross all the functional areas within a facility’s organization that have the greatest potential to impact the integrity of the FAA-approved design and product quality. All responses to the questions are direct inputs to the database from which trend analysis is accomplished. Each auditor should be knowledgeable of all the criteria applicable to the system element assigned to be audited and should strive to audit as many of the procedures, requirements, and products related to the criteria as time allows.
f. Select at least one team member to conduct at least one product audit at a PAH or associate facility of a manufactured product (for example, characteristic dimensioning, processing attributes, and physical examination) to determine compliance with current system procedures and quality requirements.
g. On the basis of facility procedures or quality requirements, identify, and document additional standardized audit criteria questions and statement-of-condition practices and principles not contained in appendix H to this order that were required to document what was audited. Write or type additional criteria and statement-of-condition practices and principles, and include the appropriate reference to the facility procedures or quality requirements and the
auditor’s recommendation of the system element to which the criteria and statement of condition apply. Team members must present new criteria and statement-of-condition practices and principles to the team leader as soon as they are completed.
h. Detect and report noncompliances and areas that may require additional audit by the PI or AE.
i. If a supplier audit discloses a noncompliance that may involve other PAHs, the team leader and PI must consider the gravity and potential systemic impact of the noncompliance, and accordingly identify those additional PAHs also affected. The PI will follow up to verify the affected PAHs and notify and apprise the appropriate PIs of the encountered concern.
3-44. Recording Noncompliances. Auditors will record all noncompliances on FAA Form 8100-6, or electronic equivalent, according to the guidelines in appendix I to this order.
Note: Record as a certification-related noncompliance any condition that questions the certification basis. Address the noncompliance on the Executive Summary (refer to paragraphs 3-45b(2)(c) and 3-49b, and appendix J, to this order) and as a special emphasis item in the audit report (refer to paragraphs 3-45b(2)(d) and 3-49c, and appendix K to this order).
3-45. Audit Meetings.
a. Daily Meeting. The team leader or principal auditor holds the following daily meetings, as appropriate:
(1) Meeting with Audit Team Members. The team leader will review and discuss the following with team members:
(a) Status of the audit.
(b) Problems encountered.
(c) Plan of the next day’s audit.
(d) All FAA Form(s) 8100-6, or electronic equivalent, prepared during the day to ensure correctness, adequacy, and completeness.
(2) Meeting/Communication with PI and AE. The team leader or principal auditor ensures that the certificate management PI and AE, and the geographic PI, as applicable, are informed of all discussions concerning the status of the audit. This meeting should occur daily when the PI and AE are part of the audit team. Otherwise, coordinate with the PI and AE to establish the method and frequency at which these discussions should occur.
(3) Meeting with the Audited Facility’s Designated Representative. The team leader or principal auditor holds a brief meeting daily with the audited facility’s designated representative to discuss the progress of the audit, including problems encountered, the status of actions requested by the team, schedule changes, and the coordination of further audit activities.
b. Final Critique Meeting/Audit Wrap-Up. At the conclusion of the audit, the team leader holds a final critique meeting. The principal auditor allows time to finalize the details of the audit. The team leader and members or the principal auditor do the following, as appropriate:
(1) Team Members or Principal Auditor.
(a) Complete all required FAA Form(s) 8100-6, or electronic equivalent. When using an electronic equivalent, print to paper when all information has been entered. Team members discuss Form(s) 8100-6 with the team leader to determine if there are any possible violations of the applicable requirements of 14 CFR. The team leader must resolve any disagreement on noncompliance(s). The lead audit office, or requesting MIDO or CMO, as applicable, must determine the level of corrective action required (refer to paragraph 3-52 of this order).
(b) Ensure that all true copies of objective evidence are included to support the appropriate FAA Form(s) 8100-6, or electronic equivalent, appropriately referenced, and clearly identified in accordance with FAA Order 2150.3.
(2) Team Leader or Principal Auditor.
(a) Resolve team disagreements on specific noncompliances.
(b) Discuss all noncompliances with the certificate management PI or AE, delegated facility AE, and geographic PI, as applicable.
(c) Prepare the QSA Executive Summary (refer to appendix J to this order). Prepare original forms within CMIS as follows:
1 PAH or Associate Facility. Prepare one original summary.
2 Facility with Multiple Production Approvals. Prepare one original summary. For example, if a facility has a PMA and a TSO authorization, prepare one original summary.
(d) Identify and record specific problems or concerns that the QSA team believes require further action and that should be brought to the attention of the ACO, MIO, MIDO, or CMO managers, the geographic PI, the AE, and the Flight Standards principal maintenance inspector (as appropriate). Use the instructions in appendix K to this order to record these special emphasis items. Prepare original documents or electronic equivalents as follows:
1 PAH or Associate Facility. Prepare one original or electronic document.
2 Facility with Multiple Production Approvals. Prepare only one original or electronic document. For example, if a facility has a PMA and a TSO authorization, prepare one original document
(e) Verify that signed original FAA Form(s) 8100-6 or electronic equivalents have been prepared for inclusion, as applicable, in each QSA report to be sent to the responsible certificate management MIDO, CMO, or ACO having delegation oversight. Refer to paragraph 3-49d of this order. Each report to be sent must include all applicable FAA Form(s) 8100-6. When a signed original FAA Form 8100-6 is applicable to two or more reports, do the following:
1 Reproduce the signed original FAA Form(s) 8100-6 as required for inclusion in the applicable QSA report(s) to be sent to the responsible certificate management MIDO or CMO with oversight.
2 Identify all true copies of the signed form in accordance with FAA Order 2150.3.
(f) Provide a copy of the completed final draft FAA Form(s) 8100-6 to the certificate management PI or AE, and the geographic PI, as applicable, when they are present.
(g) Verify that the required number of true copies of objective evidence have been prepared for inclusion, as applicable, in each QSA report to be sent to the responsible certificate management MIDO or CMO having oversight.
(h) Provide all true copies of objective evidence to the certificate management PI or AE, when present. When the PI or AE is not present, forward the copies in accordance with the applicable instructions in paragraph 3-51a of this order. If the objective evidence will be necessary as a reference during preparation of the audit report, make a separate copy and identify each page as “For Reference Only.”
(3) Certificate Management PI or AE, or Geographic PI (When Present). As appropriate, consider providing a copy of the completed final draft FAA Form(s) 8100-6 to the facility’s management. Clearly mark each copy as “DRAFT” before release.
3-46. Post-Audit Conference. The team leader or principal auditor must conduct a post-audit conference with appropriate senior management and cognizant supervisory personnel of the audited facility. The team leader or principal auditor must, as appropriate, do the following:
a. Introduce FAA personnel not previously introduced at the pre-audit conference.
b. Give a brief presentation of the overall results of the audit, using each completed QSA Executive Summary as a reference:
(1) Provide a completed and signed QSA Executive Summary to the audited facility’s designated representative.
(2) Summarize all noncompliances. Mention only noncompliances previously discussed with the certificate management PI and AE, the geographic PI, as applicable, and facility personnel.
c. Explain the purpose and use of the QSA database.
d. Explain corrective action and followup procedures.
Note: Emphasize that the PI or AE may conduct additional investigations into noncompliances reported in the QSA report. The results of these investigations may be included with the letter requesting corrective action for the QSA noncompliances.
e. Remind senior management about FAA Form 8100-7 and encourage them to complete the form and send it to the address on the form within 30 calendar days of the post-audit conference.
f. Request final comments. Clarify any misunderstandings or disagreements before departure.
g. Adjourn the QSA.
3-47. through 3-48. Reserved.
Subpart C. Post-Audit Activities
3-49. Preparing the QSA Report. The team leader or principal auditor must prepare the QSA report. When a facility has one or more production approvals, prepare one audit report. Format and compile each audit report in the CMIS program. The report will consist of the following:
Note: Ensure that the QSA report identifies only noncompliances presented at the post-audit conference.
a. FAA Form 8100-3, QSA Report, or printed copy of electronic equivalent (appendix L to this order). Each completed electronic form or printed copy must be electronically or physically signed. Prepare an original electronic form or printed copy for each PAH affected.
b. QSA Executive Summary or printed copy of electronic equivalent (appendix J to this order). Each electronic copy of the summary must be electronically signed. The printed copy presented to the PAH representative must be physically signed. All other information on electronic copies must be identical to the signed copy as presented to the PAH. Prepare an original summary or printed copy for each PAH affected.
c. QSA Special Emphasis Items or printed copy of electronic equivalent (appendix K to this order). Prepare an electronic listing of special emphasis items or printed copy for each PAH affected.
d. FAA Form 8100-6 or printed copy of electronic equivalent (appendix I to this order). Each report must include all applicable FAA Form(s) 8100-6.
e. FAA Form 8100-1 or printed copy of electronic equivalent. Each report must include documentation of product audits (including onsite QSA supplier audits if applicable), and supplier audit record reviews as applicable.
f. FAA Form 8120-14, Production Approval/Certificate Management Activity Report, or printed copy of electronic equivalent. FAA Form 8120-14 is only used when onsite supplier audits take place.
Note: Do not include reproductions of true copies of objective evidence in an original audit report. Objective evidence must be a true copy signed and dated in accordance with FAA Order 2150.3.
3-50. Quality Review of the QSA Report. The QSA Report contains the data that forms the basis of corrective action requests (refer to paragraph 3-52 of this order) and the QSA national database described in chapter 5 of this order. To this end, the audit report must be accurate and complete. Directorate managers (or delegated individuals) must establish a review process within their directorates that ensures accuracy and completion of the QSA report before distribution.
3-51. Sending the QSA Report. Using CMIS, the team leader or principal auditor and the responsible ACO and MIO managers (or delegated individuals) will process the QSA report as follows (refer to appendix M to this order):
a. Team Leader or Principal Auditor.
(1) Make the audit report available to the responsible MIDO/CMO manager or delegate within 15 working days of the post-audit conference. The manager or delegate must return the report to the team leader or principal auditor for correction and/or continued processing within 5 working days of receipt.
(2) Make the audit report available to the responsible certificate management MIO manager within 5 working days of receipt of the MIDO/CMO manager or delegate comments. Do not send copies of objective evidence to the MIO manager. Send or deliver all true copies of any objective evidence to the attention of the certificate management PI.
(3) Make the audit report available to the cognizant ACO manager and to AIR-100. The copy for the ACO manager may be tailored according to the needs of that manager. Include copies of any objective evidence that the ACO manager may require to investigate identified special emphasis items. These copies must be sent or delivered to the attention of the ACO manager. Do not send copies of objective evidence to AIR-100.
(4) Make the audit report available to the immediate supervisor of any auditors-intraining assigned to the team.
b. Certificate Management MIO Manager.
(1) Make the audit report available to the certificate management PI within 3 working days of receipt of the report from the QSA team leader.
(2) Include any additional audit documents that the team leader provides.
c. Certificate Management ACO Manager.
(1) Make the QSA report available to the AE within 3 working days of receipt of the report from the QSA team leader.
(2) Send or deliver all copies of any objective evidence to the attention of the AE, as applicable; send the true copies of the objective evidence under separate cover.
Note: ACO investigations of special emphasis items identified during the conduct of a QSA should be coordinated with the responsible MIDO or CMO.
3-52. Requesting Corrective Action. The PI must request corrective action in accordance with paragraph 4-20 of this order.
3-53. through 3-54. Reserved.
Section 4. Supplier Control
Part 1. Determining Supplier Control by a PAH or Associate Facility
3-55. General PAH Supplier Control Responsibilities. A PAH or associate facility may use suppliers when it has established an FAA-approved quality system that provides assurance that all articles or services furnished by its suppliers are in compliance with its particular production approval and 14 CFR. The PAH or associate facility should—
a. Ensure each supplier-provided product, article, or service conforms to the PAH’s requirements. This responsibility is applicable regardless of—
(1) Where the supplier or subtier suppliers may be located.
(2) Whether the parts received by the PAH or associate facility are also FAA-approved (PMA or TSO).
(3) Whether materials are accompanied by airworthiness approval tags, or their equivalent, issued by the CAA of a bilateral country.
(4) Whether materials or equipment are supplied by the end product purchaser (customer-furnished equipment, buyer-furnished equipment, or government-furnished equipment).
(5) Whether the FAA performs an audit at the supplier or subtier supplier.
(6) Whether the articles received by the PAH or associate facility are commercial or standard parts.
(7) Whether the supplier or subtier supplier has been delegated major inspection authority.
(8) Whether the quality system data received from the supplier are in English.
b. Place special emphasis on controlling those suppliers that the PAH has authorized to ship directly to a user/operator. Suppliers may ship replacement and modification articles directly to the user/operator without the articles first being processed through the PAH’s or associate facility’s receiving inspection facilities only if the PAH or associate facility:
(1) Authorizes to the supplier, in writing, the authority to ship directly to a user/operator. An individual written authorization is not required for each direct shipment. The authorization may include limitations such as specific part number(s), time periods, or particular user/operators. This authorization will be maintained by the PAH or associate facility for review by the cognizant MIDO/CMO.
(2) Includes, in its FAA-approved quality system, controls to compensate for the absence of inspection normally conducted at the PAH’s or associate facility’s location, for example, receiving inspection and test. Compensating factors should include onsite audits of the supplier and the inspection of the article at the supplier by—
(a) The PAH or associate facility, or
(b) The supplier under a delegated inspection authority from the PAH or associate facility.
(3) Ensures that each article so shipped is accompanied by a shipping ticket, invoice, or other document containing a declaration that the individual article was produced under the terms of the production approval, and that inspection/acceptance has been accomplished by either the PAH/associate facility or by delegated inspection authority. The shipping document for subcomponents manufactured for TSO articles should contain the TSO number. When FAA Form 8130-3, Airworthiness Approval Tag, is used for this purpose, the direct-ship authorization will be annotated in accordance with FAA Order 8130.21, Procedures for Completion and Use of the Authorized Release Certificate, FAA Form 8130-3, Airworthiness Approval Tag.
(4) Provides the appropriate article marking information to the supplier.
(5) Advises its cognizant MIDO/CMO of each direct-ship authorization.
c. Take measures to prevent suppliers from manufacturing articles without proper authority. For example, the PAH could limit projected overruns and request, in its contract with the supplier, that any unnecessary overrun articles be scrapped. The PAH may also include a clause in its contract that no articles are to be sold under any circumstances other than those described in the contract.
d. Make available to the FAA a current list of its suppliers.
e. Notify its suppliers that its facilities are subject to FAA CM.
f. Pursuant to 14 CFR 21.137(c)(2), verify that a supplier-reporting process is in place for products, articles, or services that have been released from or provided by the supplier and subtier supplier(s) and subsequently found not to conform to the PAH’s requirements.
3-56. CM Activity. CM activity will be focused on the PAH’s or associate facility’s control of its suppliers, since the PAH or associate facility is totally responsible for all of its supplier-furnished articles and services.
a. The FAA does not approve suppliers. However, the PI should review a PAH’s or associate facility’s list of suppliers to verify that any suppliers outside the United States have been previously evaluated for undue burden determination as required by FAA Order 8100.11, Decision Paper Requirements for Undue Burden and No Undue Burden Determinations Under 14 CFR Part 21 for Production and Export Airworthiness Approvals.
b. The FAA will determine if a PAH or associate facility is complying with its supplier control system by performing the following activities:
(1) PI Audit. Refer to section 5 of this chapter. Specifically, the PI will use the QSA supplier control system element criteria from appendix H to determine if a PAH or associate facility is complying with its supplier control system.
(2) Supplier Control Audit. Refer to part 2 of this section. Specifically, the PI will determine if the supplier complies with purchase order and/or quality requirements. In some instances, this activity may be handed off to another MIDO/CMO, or may require CAA assistance.
3-57. Determination of Supplier Control. The PI may determine whether a PAH or associate facility is controlling its suppliers by reviewing the results of the PI audit at the PAH or associate facility, when applicable, and the results of the supplier control audits at the selected PAH/associate facility suppliers, including the results of all applicable CAA audits. This review should be accomplished annually, immediately following the last scheduled supplier control audit, PI audit, or CAA audit, whichever occurs last. During the review, the PI should look for evidence that may indicate a system breakdown in supplier control by the PAH or associate facility. When a systemic noncompliance is identified, the PI will prepare FAA Form 8100-6 and retain all applicable objective evidence in accordance with Manual FAA-IR-04-01, AIR Records Management Requirements Manual. The PI will request corrective action for a system breakdown in accordance with chapter 4, section 4, of this order.
3-58. through 3-59. Reserved.
02/25/2013 8120.23
Part 2. Supplier Control Audit
3-60. Scheduling. A supplier control audit is conducted as part of the CM of the PAH or associate facility that evaluates the system established to control the articles, materials, supplies, and services provided by outside sources. This audit is conducted by the MIDO/CMO assigned CM responsibility for the PAH or associate facility. If specific expertise is required during this audit, the PI should advise the MIDO/CMO manager. If a supplier control audit is required in another geographic MIDO/CMO, the PI will comply with the handoff procedures in paragraph 3-64 of this order. A supplier control audit is applicable to suppliers of a PAH or associate facility as determined by the selection process identified in paragraph 3-61 of this order. The supplier control audit will determine that the supplier complies with purchase order and/or quality requirements, including any statistical sampling that may be used. The PI should prepare an audit checklist for each supplier to be audited based on the applicable purchase order and/or quality requirements from the PAH or associate facility. Schedule a supplier control audit in accordance with the results of the latest RBRT assessment as follows:
Note: The scheduling requirements listed in paragraphs a through c below are considered to be the minimum requirements. Refer also to figure 3-1 of this order. A MIDO/CMO may schedule additional supplier control audits at specific facilities when required to ensure continued operational safety.
a. High Risk Facility. For PAHs having a screened supplier listing, as described in paragraphs 3-61e and f of this order, of—
(1) Less than or equal to 50, a supplier control audit will be conducted at 3 suppliers annually.
(2) Greater than 50, but less than or equal to 100, a supplier control audit will be conducted at 6 suppliers annually.
(3) Greater than 100, a supplier control audit will be conducted 9 suppliers annually.
b. Medium Risk Facility.
(1) Medium High. A supplier control audit will be conducted every 18 months.
(2) Medium Low. A supplier control audit is not required.
c. Low Risk Facility. A supplier control audit is not required.
3-61. Supplier Selection. Selection of suppliers subject to supplier control audits will be performed as follows:
Note: The supplier selection process, although automated in CMIS, may be accomplished manually. Therefore, it will be optional for the PI to enter all of the PAH’s suppliers into CMIS.
02/25/2013 8120.23
a. After completing the RBRT assessment, each PI will identify the number of supplier control audits to be performed by using the guidance described in paragraphs 3-60a through c of this order.
b. Next, the PI must obtain access to the PAH’s supplier listing.
c. The PI will select candidates for supplier control audits using a random sampling method to minimize biasing the results. For supplier selection purposes, a random number generator method will be used. In cases in which the supplier selection process automated in CMIS is not used, each MIO will determine the method of generating random numbers, using the Internet as a possible source. The PI will use these randomly generated numbers to determine which suppliers receive an audit. Using the random number generator method, the PI will select the appropriate minimum number of supplier control audits required.
d. The PI will match the randomly generated numbers to the PAH’s or associate facility’s supplier control listing. For example, Company ABC was rated as a High Risk facility and has 40 suppliers on its supplier control listing. The minimum number of supplier control audits for a High Risk facility with 40 suppliers is 3. Using the random number generator method, the PI selects the first 3 numbers from the generated list of 40 random numbers, which for the purpose of this example would be 5, 8, and 24. The PI will then count down the supplier listing and choose the 5th, 8th, and 24th suppliers on the list.
e. The PI will screen each of the suppliers selected, taking into consideration the following factors: article complexity or criticality, recipient of a supplier control audit in the previous year, significant service difficulty activity at a supplier, inspectability upon receipt, delegation of major inspections, direct-ship authority, delegation of a Materials Review Board (MRB), or supplier performance. In addition, the PI must determine if the degree of manufacture that occurs at the supplier justifies expanding the audit activity to their subtier suppliers. If, based on these factors, the PI decides not to audit a selected supplier, the PI should select the next number on the generated list and screen that supplier against the listed factors. Continue this process until the required number of suppliers is selected.
Note: In addition to those factors stated within paragraph 3-61e of this order, the PI is reminded to consider the degree of manufacturing and processing activity that occurs at those suppliers that are candidates for supplier control audits. The PI is also encouraged to consult the CPL in appendix B to this order in prioritizing supplier criticality as part of the screening process.
02/25/2013 8120.23
f. As an alternative to the supplier selection process described above, the PI may apply the screening criteria identified in paragraph 3-61e of this order to all suppliers on the PAH’s supplier listing, thereby compiling a screened list of suppliers suitable for a supplier control audit. The PI will then randomly select the required number of suppliers from the screened list in accordance with the procedures described in paragraphs 3-61c and d of this order.
Note: In cases where the PAH or associate facility supplier base is less than or equal to the minimum number of supplier control audits required, the PI will schedule and conduct a supplier control audit at each of the PAH’s or associate facility’s suppliers. When the results of the supplier control audits indicate a continuing trend of effective supplier control by the PAH or associate facility, the PI may elect to reduce the number of supplier control audits to be conducted.
g. There may be reasons such as article complexity or criticality, size of the PAH’s or associate facility’s supplier base, significant service difficulty activity at a supplier, delegation of major inspections, or supplier performance for which the PI may want to do more than the minimum number of supplier control audits. The PI should remember, however, that the purpose of the supplier control audit is to determine that a PAH or associate facility is satisfactorily controlling its suppliers, not to audit the performance of the supplier. Specific supplier issues should be audited using the product audit described in section 6 of this chapter.
3-62. Directorate Supplier Control Audit. Each MIDO/CMO will schedule supplier control audits annually as described in paragraph 3-61 of this order.
a. The supplier control audit schedule will include the name of the selected supplier, the name of the responsible PAH or associate facility, the scheduled date of supplier control audits to be conducted by the MIDO/CMO, and identification of any supplier control audits that may be handed off to other directorates or may require the assistance of a CAA in a bilateral country.
Note: When feasible, the MIDO/CMO should schedule the supplier control audit for a time when the supplier has an active purchase order from the PAH or associate facility. A supplier control audit may be scheduled in conjunction with a QSA, provided the audit (1) occurs in the same fiscal year, (2) does not divert resources, and (3) is conducted and reported separately from the QSA.
Continue reading ↓ 120 of 429 passages shown