Difference between revisions of "User:Shawndouglas/sandbox/sublevel14"

From LIMSWiki
Jump to navigationJump to search
Line 49: Line 49:
Labs can be a hotbed of economic activity, as found with the United States' Argonne National Laboratory in Illinois, which claimed in 2020 to employ more than 3,400 people and have approximately $168 million total economic impact for the state.<ref name="ArgonneOurImpact">{{cite web |url=https://www.anl.gov/argonne-impacts/illinois |title=Argonne Impacts State by State: Illinois |work=Argonne National Laboratory |publisher=UChicago Argonne, LLC |accessdate=28 June 2022}}</ref> Labs can also be a significant source of innovation to society, with the old Bell Telephone Laboratories at its peak employing some 1,200 PhDs and being responsible for the creation of vital technologies such as solid state components, wireless telephony technology, the C programming language, and the Unix operating system (thanks to Bell researchers like Ken Thompson and Dennis Ritchie).<ref name="GertnerTheIdea13">{{cite book |url=https://books.google.com/books?id=OkECDAAAQBAJ |title=The Idea Factory: Bell Labs and the Great Age of American Innovation |author=Gertner, J. |publisher=Penguin |year=2013 |pages=422 |isbn=9780143122791}}</ref> In fact, laboratories are often at the heart of a company's R&D efforts towards bringing people new products. Vehicle<ref name="VolvoMaterials">{{cite web |url=http://www.volvogroup.com/en-en/about-us/r-d-and-innovations/materials-technology.html |archiveurl=https://web.archive.org/web/20170629222307/http://www.volvogroup.com/en-en/about-us/r-d-and-innovations/materials-technology.html |title=Materials Technology |work=Volvo Group |publisher=AB Volvo |archivedate=29 June 2017 |accessdate=22 December 2022}}</ref> and makeup<ref name="LOrealUSAResearch">{{cite web |url=http://www.lorealusa.com/group/discover-l%27or%C3%A9al-usa/l%E2%80%99or%C3%A9al-usa-research-and-innovation |archiveurl=https://web.archive.org/web/20181021232022/http://www.lorealusa.com/group/discover-l'or%C3%A9al-usa/l%E2%80%99or%C3%A9al-usa-research-and-innovation |title=L’Oréal USA Research And Innovation |publisher=L’Oréal Group |archivedate=21 October 2018 |accessdate=22 December 2022}}</ref> users alike are affected by manufacturing laboratories that research, design, test, and [[quality control]] their products. Clinical labs help keep current and future generations healthy, and [[Forensic science#The forensic laboratory|forensic labs]] help bring justice to the wronged. Of course, [[Reference laboratory|calibration laboratories]] are vital to ensuring the precise measurement and production values of any equipment those other laboratories strongly depend on.  
Labs can be a hotbed of economic activity, as found with the United States' Argonne National Laboratory in Illinois, which claimed in 2020 to employ more than 3,400 people and have approximately $168 million total economic impact for the state.<ref name="ArgonneOurImpact">{{cite web |url=https://www.anl.gov/argonne-impacts/illinois |title=Argonne Impacts State by State: Illinois |work=Argonne National Laboratory |publisher=UChicago Argonne, LLC |accessdate=28 June 2022}}</ref> Labs can also be a significant source of innovation to society, with the old Bell Telephone Laboratories at its peak employing some 1,200 PhDs and being responsible for the creation of vital technologies such as solid state components, wireless telephony technology, the C programming language, and the Unix operating system (thanks to Bell researchers like Ken Thompson and Dennis Ritchie).<ref name="GertnerTheIdea13">{{cite book |url=https://books.google.com/books?id=OkECDAAAQBAJ |title=The Idea Factory: Bell Labs and the Great Age of American Innovation |author=Gertner, J. |publisher=Penguin |year=2013 |pages=422 |isbn=9780143122791}}</ref> In fact, laboratories are often at the heart of a company's R&D efforts towards bringing people new products. Vehicle<ref name="VolvoMaterials">{{cite web |url=http://www.volvogroup.com/en-en/about-us/r-d-and-innovations/materials-technology.html |archiveurl=https://web.archive.org/web/20170629222307/http://www.volvogroup.com/en-en/about-us/r-d-and-innovations/materials-technology.html |title=Materials Technology |work=Volvo Group |publisher=AB Volvo |archivedate=29 June 2017 |accessdate=22 December 2022}}</ref> and makeup<ref name="LOrealUSAResearch">{{cite web |url=http://www.lorealusa.com/group/discover-l%27or%C3%A9al-usa/l%E2%80%99or%C3%A9al-usa-research-and-innovation |archiveurl=https://web.archive.org/web/20181021232022/http://www.lorealusa.com/group/discover-l'or%C3%A9al-usa/l%E2%80%99or%C3%A9al-usa-research-and-innovation |title=L’Oréal USA Research And Innovation |publisher=L’Oréal Group |archivedate=21 October 2018 |accessdate=22 December 2022}}</ref> users alike are affected by manufacturing laboratories that research, design, test, and [[quality control]] their products. Clinical labs help keep current and future generations healthy, and [[Forensic science#The forensic laboratory|forensic labs]] help bring justice to the wronged. Of course, [[Reference laboratory|calibration laboratories]] are vital to ensuring the precise measurement and production values of any equipment those other laboratories strongly depend on.  


However, labs can and do fail (completely, or at their tasks)<ref name="AhujaWhy19">{{cite web |url=https://hbr.org/2019/07/why-innovation-labs-fail-and-how-to-ensure-yours-doesnt |title=Why Innovation Labs Fail, and How to Ensure Yours Doesn’t |author=Ahuja, S.B. |work=Harvard Business Review |date=22 July 2019 |accessdate=22 December 2022}}</ref><ref>{{Cite journal |last=Keppel |first=Martin H |last2=Cadamuro |first2=Janne |last3=Haschke-Becher |first3=Elisabeth |last4=Oberkofler |first4=Hannes |last5=Felder |first5=Thomas K |last6=Lippi |first6=Giuseppe |last7=Mrazek |first7=Cornelia |date=2020-06-15 |title=Errors within the total laboratory testing process, from test selection to medical decision-making – A review of causes, consequences, surveillance and solutions |url=https://www.biochemia-medica.com/en/journal/30/2/10.11613/BM.2020.020502 |journal=Biochemia medica |volume=30 |issue=2 |pages=215–233 |doi=10.11613/BM.2020.020502 |pmc=PMC7271754 |pmid=32550813}}</ref><ref name="ParvinMonit15">{{cite web |url=https://www.qcnet.com/resources/qc-articles/learning-from-laboratory-failures |title=Monitoring test system failures and QC performance can help identify opportunities for improvement |author=Parvin, C.A.; Yundt-Pacheco, J.; Quintenz, A. |work=QCNet |date=2015 |accessdate=22 December 2022}}</ref>, like any other business. However, data and quality management are at the heart of aiding not only in reducing errors in laboratory processes but also more rapidly recover from and strengthen the quality of processes.
However, labs can and do fail (completely, or at their tasks)<ref name="AhujaWhy19">{{cite web |url=https://hbr.org/2019/07/why-innovation-labs-fail-and-how-to-ensure-yours-doesnt |title=Why Innovation Labs Fail, and How to Ensure Yours Doesn’t |author=Ahuja, S.B. |work=Harvard Business Review |date=22 July 2019 |accessdate=22 December 2022}}</ref><ref name="KeppelErrors20">{{Cite journal |last=Keppel |first=Martin H |last2=Cadamuro |first2=Janne |last3=Haschke-Becher |first3=Elisabeth |last4=Oberkofler |first4=Hannes |last5=Felder |first5=Thomas K |last6=Lippi |first6=Giuseppe |last7=Mrazek |first7=Cornelia |date=2020-06-15 |title=Errors within the total laboratory testing process, from test selection to medical decision-making – A review of causes, consequences, surveillance and solutions |url=https://www.biochemia-medica.com/en/journal/30/2/10.11613/BM.2020.020502 |journal=Biochemia medica |volume=30 |issue=2 |pages=215–233 |doi=10.11613/BM.2020.020502 |pmc=PMC7271754 |pmid=32550813}}</ref><ref name="ParvinMonit15">{{cite web |url=https://www.qcnet.com/resources/qc-articles/learning-from-laboratory-failures |title=Monitoring test system failures and QC performance can help identify opportunities for improvement |author=Parvin, C.A.; Yundt-Pacheco, J.; Quintenz, A. |work=QCNet |date=2015 |accessdate=22 December 2022}}</ref>, like any other business. This can happen for a number of reasons<ref name="AhujaWhy19" /><ref name="KeppelErrors20" />, though insufficient attention to risk and quality management is usually a major contributor.<ref name="ParvinMonit15" /><ref>{{Cite book |last=Mortimer |first=Sharon T. |last2=Mortimer |first2=David |date=2015 |title=Quality and risk management in the IVF laboratory |chapter=Chapter 4: What is risk? |edition=Second edition |publisher=Cambridge University Press |place=Cambridge, United Kingdom ; New York |pages=39–48 |isbn=978-1-107-42128-8}}</ref><ref name="MurrayRisk16">{{cite web |url=https://clpmag.com/lab-essentials/quality-systems/exploring-risk-management-lab/ |title=Risk-based decisionmaking and appropriate analytical tools can improve lab quality |author=Murray, W. |work=CLP Magazine |date=10 May 2016 |accessdate=22 December 2022}}</ref> In fact, data and quality management are arguably at the heart of aiding not only in reducing errors in laboratory processes but also more rapidly recover from and strengthen the quality of processes.


Labs of all types should be addressing quality within their operations, particularly when those operations affect human and animal health. "Quality management is as applicable for the [[Clinical laboratory|medical laboratory]] as it is for manufacturing and industry," states the [[World Health Organization]] (WHO) in its 2011 ''Laboratory Quality Management System: Handbook''.<ref name="WHOLQMS11" /> While the medical laboratory is better covered by [[ISO 15189]] for its quality needs, the WHO's statement highlights that all laboratories can benefit from implementing quality management principles. This includes food and beverage laboratories, water and wastewater laboratories, and calibration laboratories, among many others.  
Labs of all types should be addressing quality within their operations, particularly when those operations affect human and animal health. "Quality management is as applicable for the [[Clinical laboratory|medical laboratory]] as it is for manufacturing and industry," states the [[World Health Organization]] (WHO) in its 2011 ''Laboratory Quality Management System: Handbook''.<ref name="WHOLQMS11" /> While the medical laboratory is better covered by [[ISO 15189]] for its quality needs, the WHO's statement highlights that all laboratories can benefit from implementing quality management principles. This includes food and beverage laboratories, water and wastewater laboratories, and calibration laboratories, among many others.  

Revision as of 18:18, 22 December 2022

Sandbox begins below

Qualsystem1.png

Title: What is the importance of ISO/IEC 17025 to society?

Author for citation: Shawn E. Douglas

License for content: Creative Commons Attribution-ShareAlike 4.0 International

Publication date: TBD

Introduction

History of ISO/IEC 17025

ISO/IEC 17025's origins go back to the mid-1970s, when a conference on cross-border acceptance of test data led to the International Laboratory Accreditation Cooperation (ILAC) beginning work on what would eventually become ISO Guide 25 Guidelines for assessing the technical competence of testing laboratories, after turning the work over to the International Organization for Standardization (ISO). The intent of developing the guide, published in 1978, was to gain international cooperation towards improving the world's laboratory services by promoting a scheme for accredited laboratory test results, such that the results could be more readily accepted across national borders.[1][2][3] That first guide didn't address the activities of calibration labs, however, and it would require further revisions, as the general guidelines towards proving a lab's technical competence were also inadequate.[2] For the next version, released in 1982 as ISO/IEC Guide 25: General requirements for the technical competence of testing laboratories, the International Electrotechnical Commission (IEC) became involved. That version saw upgrades in proving technical competence, as well as the addition of the requirement for a quality system, though it too didn't address calibration labs.[2] The next version, released in 1990 as ISO/IEC Guide 25 General requirements for the competence of calibration and testing laboratories, finally addressed calibration labs and, with the help of the Council Committee on Conformity Assessment (CASCO), lent "support for national systems, thus easing bilateral agreements" associated with laboratory testing.[1][2][3] It also added notice that by meeting the requirements of ISO/IEC Guide 25, labs would also comply with the ISO 9000 standard. Four years later, CASCO pushed to turn ISO/IEC Guide 25 into a full standard, and by 1999, ISO/IEC 17025:1999 General requirements for the competence of testing and calibration laboratories was born, which also met the requirements of ISO 90001.[1][2][3]

Since then, the standard has seen two additional revisions, one in 2005 and another in 2017.[1][2][3] With the ISO 9001 standard in revision at the same time as ISO/IEC 17025:1999, the standard's take on ISO 9001 when published was antiquated, requiring the 2005 update.[2] The 2017 version included new requirements for competency, impartiality, and consistent laboratory operation and took on a revised structure from it 2005 predecessor, with the 2005 division between technical management and quality management being replaced by "a more unified focus on a laboratory's general responsibility management."[2] (For more on the differences between the 2005 and 2017 version, see the National Association of Testing Authorities' (NATA's) gap analysis document comparing the two.[4]) As of December 2022, ISO/IEC 17025:2017 remains the latest version of the standard, putting a focus on labs developing a more efficient management system (i.e., a quality management system or QMS).


ISO/IEC 17025 vs. ISO 9001: Supporting quality management in the lab

Given the history of ISO/IEC 17025, the uninformed individual may wonder what the difference is between that and the ISO 9000 series of standards. While it is true that ISO 9001 is mentioned in the context of complying with ISO/IEC 17025, there are several differences, though the critical concept of quality management is found in both. Let's first talk about what ISO 9001 and the 9000 series are geared to do and how they address quality management.

The ISO 9000 family of standards addresses the fundamentals of QMSs for an organization[5], including the eight management principles on which the family of standards is based.[5][6] ISO 9001 deals with the requirements that organizations wishing to meet the standard have to fulfill.[7] In turn, third-party certification bodies provide independent confirmation that organizations meet the requirements of the standard.

Quality management is defined by ISO 9000 as a set of "coordinated activities to direct and control an organization with regard to quality.” By extension, those coordinated activities require sufficient "organizational structure, resources, processes and procedures" in order to implement quality management throughout the enterprise, otherwise known as a quality system.[8]

Note that the discussion so far has focused on how the standard addresses the "organization" seeking to improve quality. That's because ISO 9001 is directed at all kinds of organizations operating in any type of industry and sector, whereas ISO/IEC 17025 specifically targets testing, calibration, and sampling laboratories. There are other differences from ISO/IEC 17025 as well, the most significant being that ISO 9001 deals strictly with deploying a QMS in the organization, whereas ISO/IEC 17025 expands into a toolbox of requirements for ensuring not only quality but also the "competence, impartiality, and consistent operation of laboratories."[9]

Finally, accrediting to either of the two standards is also a different process, which highlights the inherent differences between the two standards. As laboratory consultancy Perry Johnson Consulting notes, the difference between the ISO/IEC 17025 and ISO 9001:2015 standards can be found in comparing the accreditation process: "ISO/IEC 17025:2017 accreditation is recognition of a laboratory’s competence to produce technically valid results, while ISO 9001:2015 registration of a laboratory is limited to QMS conformance."[10] They add that ISO/IEC 17025:2017's "technical competency requirements go beyond QMS registration and relate specifically to the qualifications needed with regard to personnel, equipment, facilities, and laboratory methods."[10]

From this, we may conclude that—at least for the laboratory—ISO/IEC 17025 is the quality management standard to comply with, end of story. However, the utility of ISO 9001 to the laboratory should not be completely dismissed. For those struggling with implementing the management system portion of ISO/IEC 17025, additional inspiration and guidance may be found in ISO 9001. For example, ISO 9001:2015 provides additional scope in establishing a QMS, particularly through identifying problematic issues and important stakeholders. It also expands discussion about the importance of leadership establishing quality policy and the organization developing quality objectives, as well as the greater need for identifying organizational knowledge and fully implementing monitoring and measurement mechanisms.[11] From this, the laboratory may gain additional benefits by supplementing their ISO/IEC 17025:2017 compliance with some aspects of ISO 9001:2015, further enabling a more risk-based approach to managing quality in the lab.[11] (For more about how the laboratory benefits from ISO/IEC 17025:2017, see How does ISO/IEC 17025 impact laboratories?.)


How supporting laboratory quality management improves society

The discussion so far has been useful in giving background about standards bodies giving organizations—including laboratories—a framework for improving operational quality, but how does this all relate to the primary question about ISO/IEC 17025 benefiting society? From here, it's useful to examine the importance of the laboratory itself to society. In the guide The Laboratories of Our Lives: Labs, Labs Everywhere!, the first chapter emphasizes the ubiquity of the laboratory in the fabric of society, despite the lab being largely invisible to the average individual[12]:

Laboratories play an integral role in modern life, ubiquitous and often unseen by the average person. They improve quality of life, act as hotbeds of discovery, and help us make sense of our universe, particularly in the capable hands of the tens of thousands of professionals who work in them. But the laboratory as we know it today is actually a relatively new concept. It wasn't always as sectionally organized, well-staffed, and well-equipped. To gain a better sense of how common the laboratory is to our lives, we must first briefly look at the past history of laboratory research and how it developed from a philosophical and more selfish endeavor to one more focused on analysis and the benefits to society.

Labs can be a hotbed of economic activity, as found with the United States' Argonne National Laboratory in Illinois, which claimed in 2020 to employ more than 3,400 people and have approximately $168 million total economic impact for the state.[13] Labs can also be a significant source of innovation to society, with the old Bell Telephone Laboratories at its peak employing some 1,200 PhDs and being responsible for the creation of vital technologies such as solid state components, wireless telephony technology, the C programming language, and the Unix operating system (thanks to Bell researchers like Ken Thompson and Dennis Ritchie).[14] In fact, laboratories are often at the heart of a company's R&D efforts towards bringing people new products. Vehicle[15] and makeup[16] users alike are affected by manufacturing laboratories that research, design, test, and quality control their products. Clinical labs help keep current and future generations healthy, and forensic labs help bring justice to the wronged. Of course, calibration laboratories are vital to ensuring the precise measurement and production values of any equipment those other laboratories strongly depend on.

However, labs can and do fail (completely, or at their tasks)[17][18][19], like any other business. This can happen for a number of reasons[17][18], though insufficient attention to risk and quality management is usually a major contributor.[19][20][21] In fact, data and quality management are arguably at the heart of aiding not only in reducing errors in laboratory processes but also more rapidly recover from and strengthen the quality of processes.

Labs of all types should be addressing quality within their operations, particularly when those operations affect human and animal health. "Quality management is as applicable for the medical laboratory as it is for manufacturing and industry," states the World Health Organization (WHO) in its 2011 Laboratory Quality Management System: Handbook.[8] While the medical laboratory is better covered by ISO 15189 for its quality needs, the WHO's statement highlights that all laboratories can benefit from implementing quality management principles. This includes food and beverage laboratories, water and wastewater laboratories, and calibration laboratories, among many others.


Conclusion

References

  1. 1.0 1.1 1.2 1.3 Squirrell, A. (1 September 2008). "Conformity assessment: providing confidence in testing and calibration" (in en). Accreditation and Quality Assurance 13 (9): 543–546. doi:10.1007/s00769-008-0418-2. ISSN 0949-1775. http://link.springer.com/10.1007/s00769-008-0418-2. 
  2. 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 Miguel, Anna; Moreira, Renata; Oliveira, André (2021). "ISO/IEC 17025: HISTORY AND INTRODUCTION OF CONCEPTS". Química Nova. doi:10.21577/0100-4042.20170726. http://quimicanova.sbq.org.br/audiencia_pdf.asp?aid2=9279&nomeArquivo=AG2020-0467.pdf. 
  3. 3.0 3.1 3.2 3.3 Vehring, S. (June 2020). "Tested & Accepted: Implementing ISO/IEC 17025:2017" (PDF). United Nations Industrial Development Organization. https://www.unido.org/sites/default/files/files/2020-06/Guide%20ISO%2017025-2017_online.pdf. Retrieved 18 December 2022. 
  4. National Association of Testing Authorities (April 2018). "General Accreditation Guidance: ISO/IEC 17025:2017 Gap analysis" (PDF). https://nata.com.au/files/2021/05/17025-2017-Gap-analysis.pdf. Retrieved 21 Decemeber 2022. 
  5. 5.0 5.1 Tsim, Y.; Yeung, V.; Leung, E. (2002). "An adaptation to ISO 9001:2000 for certified organisations". Managerial Auditing Journal 17 (5): 245–50. doi:10.1108/02686900210429669. 
  6. Beattie, K.R. (2010). "Implementing ISO 9000: A study of its benefits among Australian organizations". Total Quality Management 10 (1): 95–106. doi:10.1080/0954412998090. 
  7. "ISO 9001:2015 Quality management systems — Requirements". International Organization for Standardization. September 2015. https://www.iso.org/standard/62085.html. Retrieved 22 December 2022. 
  8. 8.0 8.1 World Health Organization (2011). "Laboratory Quality Management System: Handbook" (PDF). World Health Organization. ISBN 9789241548274. http://apps.who.int/iris/bitstream/handle/10665/44665/9789241548274_eng.pdf?sequence=1. 
  9. "ISO/IEC 17025:2017 General requirements for the competence of testing and calibration laboratories". International Organization for Standardization. November 2017. https://www.iso.org/standard/66912.html. Retrieved 22 December 2022. 
  10. 10.0 10.1 Perry Johnson Consulting, Inc (January 2022). "ISO/IEC 17025:2017 Testing and Calibration Laboratories: An Executive Overview" (PDF). https://www.pjcinc.com/Downloads/ISOIEC17025_exov.pdf. Retrieved 18 December 2022. 
  11. 11.0 11.1 Hammar, M. (11 July 2019). "ISO 17025 vs. ISO 9001 – Main differences and similarities". Advisera Blog. Advisera. https://advisera.com/17025academy/blog/2019/07/11/iso-17025-vs-iso-9001-main-differences-and-similarities/. Retrieved 22 December 2022. 
  12. Douglas, S.E. (July 2022). "1. Laboratories: A historical perspective". The Laboratories of Our Lives: Labs, Labs Everywhere!. LIMSwiki. https://www.limswiki.org/index.php/LII:The_Laboratories_of_Our_Lives:_Labs,_Labs_Everywhere!/Laboratories:_A_historical_perspective. Retrieved 22 December 2022. 
  13. "Argonne Impacts State by State: Illinois". Argonne National Laboratory. UChicago Argonne, LLC. https://www.anl.gov/argonne-impacts/illinois. Retrieved 28 June 2022. 
  14. Gertner, J. (2013). The Idea Factory: Bell Labs and the Great Age of American Innovation. Penguin. pp. 422. ISBN 9780143122791. https://books.google.com/books?id=OkECDAAAQBAJ. 
  15. "Materials Technology". Volvo Group. AB Volvo. Archived from the original on 29 June 2017. https://web.archive.org/web/20170629222307/http://www.volvogroup.com/en-en/about-us/r-d-and-innovations/materials-technology.html. Retrieved 22 December 2022. 
  16. "L’Oréal USA Research And Innovation". L’Oréal Group. Archived from the original on 21 October 2018. https://web.archive.org/web/20181021232022/http://www.lorealusa.com/group/discover-l'or%C3%A9al-usa/l%E2%80%99or%C3%A9al-usa-research-and-innovation. Retrieved 22 December 2022. 
  17. 17.0 17.1 Ahuja, S.B. (22 July 2019). "Why Innovation Labs Fail, and How to Ensure Yours Doesn’t". Harvard Business Review. https://hbr.org/2019/07/why-innovation-labs-fail-and-how-to-ensure-yours-doesnt. Retrieved 22 December 2022. 
  18. 18.0 18.1 Keppel, Martin H; Cadamuro, Janne; Haschke-Becher, Elisabeth; Oberkofler, Hannes; Felder, Thomas K; Lippi, Giuseppe; Mrazek, Cornelia (15 June 2020). "Errors within the total laboratory testing process, from test selection to medical decision-making – A review of causes, consequences, surveillance and solutions". Biochemia medica 30 (2): 215–233. doi:10.11613/BM.2020.020502. PMC PMC7271754. PMID 32550813. https://www.biochemia-medica.com/en/journal/30/2/10.11613/BM.2020.020502. 
  19. 19.0 19.1 Parvin, C.A.; Yundt-Pacheco, J.; Quintenz, A. (2015). "Monitoring test system failures and QC performance can help identify opportunities for improvement". QCNet. https://www.qcnet.com/resources/qc-articles/learning-from-laboratory-failures. Retrieved 22 December 2022. 
  20. Mortimer, Sharon T.; Mortimer, David (2015). "Chapter 4: What is risk?". Quality and risk management in the IVF laboratory (Second edition ed.). Cambridge, United Kingdom ; New York: Cambridge University Press. pp. 39–48. ISBN 978-1-107-42128-8. 
  21. Murray, W. (10 May 2016). "Risk-based decisionmaking and appropriate analytical tools can improve lab quality". CLP Magazine. https://clpmag.com/lab-essentials/quality-systems/exploring-risk-management-lab/. Retrieved 22 December 2022.