Standards Engineering Measurement Science at the Community College Level—Some Recent Findings by Dave Cunningham

Overview 5. use rigorous logic and methods to In early 2013, Director of the Wash- solve problems ington State Community College Center 6. employ basic statistical concepts into of Excellence for Aerospace and Advanced problem analysis and reporting Manufacturing (CoE) Mary Kaye Bredeson 7. deal with problems involving several met with representatives from The Boeing concrete variables Company to learn about its need for calibra- 8. write accurate and complete reports tion technicians. This meeting led to visits The DACUM took place in May of 9. maintain tools and equipment in ac- to the company and a qualitative research 2013 with attendees from Fluke Manu- cordance with established standards event involving several other manufactur- facturing Corporation, Lockheed Martin 10. read and interpret technical drawings ing companies. The findings confirmed the Company, Puget Sound Naval Shipyard, and documents broader labor market need for people with Northrop Grumman, The National Confer- the knowledge, skills, and abilities (KSAs) ence of Standards Technologies, CIMtech Our research found over 400 manufac- commonly required of calibration techni- Inc., Grayson Industries, and The Boeing turing-related positions advertised in the cians. To develop foundational curriculum Company. Representatives from these com- area, although many of those were at the in Measurement Science that would meet panies and others were asked to continue ‘operator’ level, and little reference was this declared skills gap, the CoE sought and their relationship beyond the DACUM made to the KSAs seen more frequently in received funding from the National Institute by joining an Industry Advisory Group to positions involving calibration. However, it of Standards and Technology (NIST). provide guidance and support as the project was clear that the manufacturing sector was proceeded. All agreed to assist in this way. very active, and new, entry-level employees Introduction were in great demand. As part of the State’s Community and The Labor Market Demand When we searched labor market sources Technical Colleges (CTC) system, the CoE In exploring the labor market demand, for open calibration and/or metrology tech- for Aerospace primarily acts as a broker we found the requirements, responsibilities, nician positions, it was clear the demand between statewide aerospace/manufacturing and KSAs varied a great deal among indus- was extensive. In the Northwest alone, there companies and the two-year college system. tries. For example, in the medical field, correct were 50–100 open positions that involved Like many long-established industry lead- calibration of equipment used to monitor a some level of calibration work. In addition ers, Boeing is keen to replace and replenish medical condition could have life-or-death to manufacturing, we also found the demand an aging and highly skilled workforce. At consequences. Following standard operating in medical research labs, hospitals, ware- the time of this research, Boeing needed ap- procedures for equipment calibration and houses, and food processing plants. And this proximately twenty calibration technicians documentation of the work completed are es- need is not unique to the Northwest—our industry partners are trying to fill these and, not surprisingly, other large Northwest sential work tasks. Similarly, in a manufactur- 1 manufacturing companies reported similar ing setting, failure to follow calibration steps technical positions across the nation. requirements. according to the prevailing standards and In the fall of 2013, the CoE for Aero- Based on these findings, Bredeson and procedures can have equally momentous im- space wrote, submitted, and received a grant her staff conducted a qualitative research plications. However, several common skills from NIST to continue this project and cre- study—Design a Curriculum (DACUM) were found across many job descriptions and ate instructional certificates in Measurement workshop—as the first stage in prepar- industries. These include the ability to: Science. In August 2014, the CoE received ing instructional­ courses and modules for 1. inspect for accuracy and indications of the $65,000 grant and began the project. calibration technician training. A DACUM noncompliance with a required standard workshop begins with an in-depth discussion 2. recognize noncompliance in machine Technical Project Approach, Methodology, with subject-matter experts on the specific or process performance and Project Management Plan job tasks. The second stage of a DACUM 3. clearly and accurately document The grant proposal stated the case for is to map out the KSAs required to perform a. inspection findings funding as follows: this job. The results—a detailed profile of the b. calibrations performed work involved and the KSAs associated with c. problems identified 1 The main sources for this labor market information it—become the foundation for curriculum 4. apply basic math functions to solve included company websites, Monster.com, Indeed development and modification. problems .com, and Simply Hired

8 January/February 2016 Standards Engineering

A training gap exists in measurement • Create curriculum that will be easily conference expenses were covered under science between what is typically taught at recognizable (common certificate with the grant. community and technical colleges, and KSAs course titles/objectives) so that indus- In addition, CoE staff provided exten- required to effectively perform job require- try hiring managers are able to clearly sive logistics support to the whole project. ments within the advanced manufacturing identify the training when it appears on This support included arranging meeting industry. Measurement science is a critical resumes; space, notifying industry partners and tool in manufacturing and has traditionally • Increase the number of community col- college faculty, arranging meeting refresh- been under-addressed in higher education lege students that are qualified to fill ments, managing the project budget, and and should be included in technical training. job openings in measurement science/ providing monthly updates to the NIST proj- Technicians need an understanding of precision measurement/metrology within ect consultant. Bredeson kept local agen- the fundamentals of measurement science, local companies; and cies, colleges and the legislature informed including traceability, standards, and stan- • Provide professional development op- about the project. She also represented and dardization processes, as each applies to the portunities for Design Team faculty reported on the project nationally at several use of measurement and test equipment in to attend industry-led conferences and conferences. an advanced manufacturing environment. seminars for exposure to workplace Including measurement science courses in best practices. Shifts in Focus community and technical college technical Following the DACUM in May 2013, training programs will allow technicians to Possible Future Scenarios the grant’s advisory panel shifted the focus gain both theoretical and practical, hands-on In the grant proposal it was suggested from calibration engineering to technician experience as they focus on design and pro- that future project expansion could: level training in measurement science. The duction processes within the manufacturing • Provide a pathway to incumbent work- latter, it was felt, was a more foundational sector. There is a distinct lack of standards ers who have experience in Measure- level of training and promised a broader base education in advanced manufacturing in the ment Science. Such a pathway would of support from industry. state of Washington. In fact, no community or allow them to earn a certificate or de- A launch meeting in November of 2014 technical college offers a certificate or degree gree to validate that work experience; was attended by company subject-matter in measurement science or metrology. Only • Develop two to three stackable cer- experts (SMEs), Bredeson and her staff, a few colleges in the state offer courses at tificates leading to a two-year AAS or the three consultants, the Workforce deans all and those courses are not standardized to AAS-T degree to be implemented at from the five participating colleges, and common criteria. To meet today’s industry Washington community or technical a policy analyst from the State Board of needs a curriculum must be developed for colleges; Community and Technical Colleges. A very courses and stackable certificates that inte- • House a Bachelor’s of Applied Science important second shift in focus occurred at grate measuring devices, techniques, analy- in Metrology at a community or techni- that meeting. Up until that time, the thinking sis, and plan development. This curriculum cal college in the greater Seattle region had been to organize and guide resources needs to be incorporated into college manu- after research determines that it would and planning toward creating a certificate facturing programs throughout Washington. be viable; and in measurement science that would even- • Provide training that with the 2014- tually grow into a degree in measurement Project Goals NIST-SSCD-01 Everett Community science. This shift expanded the context Under the leadership of the CoE, five col- College/Center of Excellence for Aero- beyond manufacturing to nearly every in- leges—North Seattle College, Everett Com- space and Advanced Manufacturing re- dustry sector. munity College, Lake Washington Institute of quired experience would assist workers Digital technologies, be they in pro- Technology, Olympic College, and Shoreline in successfully passing the ASQ Cali- duction systems, instruments and sensors, Community College—joined the project and bration Technician Certification. communications, tracking and monitoring worked closely on the curriculum design security systems, or LEAN manufactur- team. Support was provided by the State Project Implementation ing methodologies are ubiquitous across Board for Community and Technical Colleges As the project began, the CoE for most industries. Consequently, the systems in Olympia, Washington. The goals of the Aerospace hired three outside consultants: within these systems depend on measure- project for which the Center was funded were: a lead for the Curriculum Design Team; an ment accuracy with implications for safety, • Develop course curriculum with indus- external project evaluator; and a project quality, competitive advantage, profitability, try subject matter experts’ input that can manager. The Design Team, which included and business planning among others. At the be embedded into advanced manufac- six technical faculty from the participating root of it all lies measurement science, a turing/aerospace programs; colleges, met weekly for four months. As wide range of measurement standards and • Develop a series of courses that can preparation for the grant work, members of technologies. be included in a short-term certificate the Curriculum Design Team attended the With this shift in context the project that can be adopted at any of the state’s 2015 Measurement Science Conference potential became statewide. Not only were colleges; in Anaheim, California. Their travel and all manufacturing-related programs at the

(Continued on page 10)

January/February 2016 9 Standards Engineering

(Continued from page 9) thirty-four colleges impacted, but many ees was strong and common across all our MESC 101: Measurement Science: The other professional technical programs as industry partners. The Boeing Company, for Fundamentals of Measurement Science well. We had stumbled on the fact that the example, had to replace a set of wings that had Upon successful completion of the liberal arts community had reached earlier— been installed on a new 787 aircraft simply course, participants will be able to: that standards, particularly standards of because some tools used in the assembly had 1. Demonstrate safe practices and situ- measurement, were fundamental knowledge not been calibrated according to specifica- ational awareness typical of a manu- and skills for citizenship in the technically tions. This error cost the company several facturing environment. dense civilizations of the 21st century. million dollars and delayed delivery of the 2. Recall or recognize terms, definitions, With this in mind, the curriculum de- aircraft. The Puget Sound Naval Shipyard and facts, ideas, materials, patterns, se- sign team began their discussions and first the Lockheed-Martin Company work within quences, methods, and principles, as attempts to create draft course outlines based tight federal regulations. When any parts or applied to metrology and measurement on the learning outcomes in measurement processes are out of compliance in any way science. science that the industry team had outlined. with established regulations, the work must be 3. Read and understand descriptions, com- Although we realized our task had suddenly redone and processes adjusted. Measurement munications, reports, tables, diagrams, expanded, we kept our focus on manufac- science specifications are integral in regula- directions, regulations, standards, etc. turing and, within that, the two dominant tions and guidelines and if employees do not as applied to metrology and measure- disciplines characterized by mechanical have the requisite KSAs in measurement sci- ment science. systems and electronic systems. Given the ence, processes may be compromised, costing 4. Use applied math to solve measure- limited time period for this initial phase a company significant rework expenses. ment related problems. our scope and scale made good sense. The 5. Correctly interpret technical illustra- design team developed three five-credit LEAN Technologies and Their Influence tions and documents for specifications, courses that will be described in more Fluke Manufacturing Company illus- measurements, tolerances, etc. (“Spec- detail later in this article. These courses trates important aspects of measurement smanship”). very broadly were Measurement Science science. The company makes a wide range 6. Appropriately select and use precision Fundamentals (MESC101), Measurement of calibration and test instruments that are measuring and test equipment to in- Science—Electrical Emphasis (MESC 102), used the world over in many industries. spect parts and devices to ensure that and Measurement Science—Mechanical Their product range is broad and the calibra- they conform to specifications. Emphasis (MESC 103). tion division in Everett where many of these 7. Demonstrate soft skills required in an At this same time, a work schedule for test and calibration instruments are manu- industrial environment. the project was developed. This schedule factured is itself measured and monitored 8. Demonstrate the importance of atten- was built from the grant proposal and the according to LEAN manufacturing methods. tion to detail, personal integrity, inter- deliverables expected by NIST at the end of The very principles and practices of LEAN personal skills and effective communi- the project. With a final delivery of June 30, manufacturing methods (which dominate cation. 2015, the time frame was tight and careful all modern manufacturing environments) 9. Demonstrate familiarity with applica- organization was called for. Contracts were are built upon measurement. ble standards including the concept of drawn up for all consultants, a memorandum The Division Director of the Calibra- traceability as it applies to materials, of understanding was developed for each of tion Division at Fluke can log into this calibration and finished products. the five colleges, and a list of expectations system and get a real-time picture of every 10. Appropriately use Excel for data col- for the roles of our industry partners was process underway at any time of the day or lection, analysis, and presentation of created. This was an important step since it night. And paralleling the digital controls information. mapped out roles and responsibilities very that enable such access are performance 11. Translate a measurement problem to clearly in the context of the work plan. standards for everything. So in the modern measureable quantities. Communication protocols were established manufacturing setting the industry standards 12. Estimate whether a quantity is mea- that put the CoE staff at the hub of all com- are maintained by a digital network of con- sureable under certain conditions. munications among the team. This worked trols that alert workers to out-of-compliance well, by and large, and ensured that all team equipment and processes. In such work MESC 102: Measurement Science - members could track progress and address settings it is therefore not surprising that Electronics Emphasis difficulties and obstacles as they arose. measurement science KSAs are seen to be Upon successful completion of the The project manager visited the partici- fundamental; without them, a worker could course, participants will be able to: pating companies and government agencies possibly not be hired. 1. The learning outcomes from MESC 101. early in January of 2015 at the same time as 2. Describe the uses and operating prin- the curriculum design team began their cur- The Results ciples of the following: DMM, oscillo- riculum work. In the course of these visits it The three courses that were devel- scope, power supply, frequency counter, became obvious that the business case for oped had the following student learning function generator, spectrum analyzer, measurement science KSAs for all employ- outcomes. power meter and Fluke calibrators.

10 January/February 2016 Standards Engineering

3. Appropriately select and properly use tions, standards, etc. as applied to me- • If measurement science KSAs are es- the above listed test equipment. chanical measurement. sential in so many fields, a similar com- 4. Demonstrate communications, reports, 10. Use applied math and statistics to doc- mon guide or template may be required tables, diagrams, directions, regula- ument measurement. if all colleges are to include these KSAs tions, standards, etc. 11. Demonstrate soft skills required in an in their programs 5. Use applied math and statistics to doc- industrial environment. • At the very least, a standard must be de- ument measurement. 12. Apply appropriate standards, includ- fined and it does require the support and 6. Inspect circuitry to confirm they con- ing the concept of traceability as it ap- backing of major industry employers if form to specifications. plies to mechanical measurement. colleges are to invest in such training. 7. Demonstrate soft skills required in an 13. Compose reports using Excel and • Unless this occurs, full implementation industrial environment. other industrial software for data col- of this work on the scale that our SMEs 8. Show familiarity with applicable stan- lection, analysis and presentation of envisaged may be stalled. dards, including the concept of trace- information. ability as it applies to electronics test 14. Identify and document out of tolerance Next Steps equipment. results. Following the completion of the three 9. Compose reports using Excel and courses, the workforce deans at each of the other industrial software for data col- Note: It is anticipated that most colleges five colleges involved were visited with lection, analysis and presentation of will offer at least two of these courses de- a view to clarifying how and when each information. pending on the manufacturing programs that college would begin to offer the courses. 10. Identify and document out of tolerance the courses are linked to. MESC 101 is seen The implementation plans for each college results. as the introductory and foundational course were devised and shared with the CoE and for all students of measurement science to be the SMEs from industry at the final meet- MESC 103: Measurement Science - followed by either MESC 102, MESC 103, ing (which was attended remotely by NIST Mechanical Emphasis or both. The colleges that participated in representatives.) Upon successful completion of the the development of these three courses will The Center will be seeking continued course, participants will be able to: be implementing them according to what funding from NIST and other sources in 1. The learning outcomes from MESC best fits the needs of their students and their order to take this work to the next level. The 101 particular program mix. colleges in the state of Washington operate 2. Interpret technical drawings and ap- autonomously within the general guidelines ply inspection tools and techniques to What We Learned set down by the State Board of Community verify the acceptability of machined Several important findings emerged: and Technical Colleges. The current strategy parts. • The process of new curriculum devel- is to have the five partner colleges pioneer 3. Measure using surface plate layouts opment that begins with a DACUM the implementation of the courses and and the coordinate measuring machine workshop and is based on a clear in- demonstrate both their marketing potential (CMM). dustry need does work well. Colleges to students and positive feedback from 4. Demonstrate familiarity with standards respond, and industry collaborates and employers. applicable to manufactured parts. assists; where an inclusive and partici- Within the college system in the state, 5. Demonstrate familiarity with the con- patory communication system is em- the numbering of courses and programs is cepts of traceability as applied to cali- ployed, results are generally achieved. set within a statewide system of codes that bration. • In the absence of standards that have is in transition. This coding matrix is multi- 6. Properly use computer software used been identified, codified, and built into layered and complex and is linked to student in quality management. job descriptions, it can be problematic tuition payments, faculty salaries, state 7. Identify nonconforming instruments, to implement new training across a funding, and other metrics such as student finished parts and assemblies, and ini- complex higher education network of completion rates. Not unlike the tax code in tiate resolution. autonomous colleges. this country, it has its roots in an earlier time, 8. Describe the uses and operating prin- • In health care, nursing certifications are long before the Internet, WIFI technology, ciples of: required for employment. Colleges that and online courses. Its designers have long a. Ruler train nurses do so in the full knowledge since retired. The time is long past to revisit b. Caliper that their nursing graduates must be these structures and systems and bring them c. Micrometer prepared to take and pass these certified up to date with the digital age. d. Surface plate/height gauges examinations. Failure to pass any such The outside influence of industry is e. Indicators certifications automatically precludes critical to bring this about. Without it, the f. Balance/scale employment. Such standards provide out-of-date systems and processes within 9. Demonstrate communications, reports, a common guide or template for nurse the CTC system may remain unchanged tables, diagrams, directions, regula- training and education at every college. and impede the response to industry’s needs.

(Continued on page 12)

January/February 2016 11 Standards Engineering

(Continued from page 11)

­Unless new approaches to meeting the ASTM E2659: A Standard Guiding demands from industry are found colleges may be bypassed as companies seek more relevant and responsive educational partners Certificate Program Development elsewhere. That said, the establishment of industry by Mickie S. Rops, CAE recognized standards for measurement sci- Certification versus Certificate Programs ence that are widely supported by employers An ASTM international standard, and What is a certificate program? In a will be the key pillar by which the KSAs of an ANSI accreditation program citing that certificate program, an individual partici- this project become widely recognized and standard, provide a gauge of the quality of pates in a learning event or series of events supported. a certificate program—whether it addresses designed to assist him or her in achieving This project was made possible by a engineers, physicians, or chefs. ASTM: specified learning outcomes within a defined grant from the National Institute of Stan- E2659, Standard Practice for Certificate scope. The individual receives a certificate dards and Technology (NIST) to the Center Programs, defines certificate programs and only after verification of successful comple- of Excellence for Aerospace and Advanced delineates the characteristics of a high qual- tion of all program requirements (including, Manufacturing in Everett, Washington. ity program. It is the standard against which but not limited to, an evaluation of learner Dave Cunningham, the author of this the ANSI certificate accreditation program attainment of intended learning outcomes). article, is the retired Dean of Workforce measures applicants. What is certification? In certification Training and Continuing Education at an organization grants a credential to an Shoreline Community College. He currently Why a Certificate Standard? individual after verifying that he or she has works on curriculum development and Why Accreditation? met established criteria for proficiency or training programs for community colleges The idea of a certificate program stan- competency, usually through an eligibility in Washington and Idaho. He is a gradu- dard and an accreditation based upon the application and assessment. While certifica- ate in Pure Science from the University standard arose in early 2007 when govern- tion eligibility criteria may specify a certain of Glasgow, Scotland, and has a master’s mental agencies and consumers expressed type or amount of education or training, the degree in Educational Leadership and Policy concern to the American National Standards learning event(s) are not typically provided Studies from the University of Washington. Institute that there was no nationwide regu- by the certifying body. Instead, the certify- He was the lead for the design and facilita- lation, oversight, or monitoring consistently ing body verifies through an application tion of this project. applied to entities that offer education-based certificates. Consumers were often unclear process education or training and experi- about the meaning of certificates, how to dif- ence obtained elsewhere and administers a ferentiate among certificate programs with standardized test of current proficiency or varying levels of rigor, and how certificate competency. programs differ from personnel certifica- In a certificate program (unlike a certifi- tions. Prior to publication of ASTM E2659: cation system), a certificate issuer develops Standard Practice for Certificate Programs, and administers both the learning event(s) there had been no American National Stan- and the assessment(s); there is an essential dard for certificate programs. There was an link between them. The learning event(s) are American National Standard for personnel designed to help participants achieve learn- certification programs—the adoption of ing outcomes and the assessment is designed ISO/IEC 17024, Conformity assessment — to evaluate the learners’ attainment of those General requirements for bodies operating intended learning outcomes. certification of persons. ASTM E2659 There are fundamental differences closes the loop by distinguishing between between the standards-based requirements these two program types and outlining the of certification systems and certificate quality criteria for certificate programs. systems. To conform to the international ASTM E2659, developed by ASTM’s standard ISO/IEC 17024, a certification Subcommittee E36.30 on Personnel Certifi- program must: cate Programs, is a part of Committee E36 • Have ongoing requirements (called re- on Accreditation and Certification, and rep- certification or renewal) and a system resents collaboration across the certificate for revoking the certificate when re- program spectrum, including colleges and quirements are not met; and universities, community colleges and trade • Not have an integrated learning compo- schools, government agencies, nonprofits, nent offered and required by the certify- and for profits. ing body.

12 January/February 2016