LIMS Q&A:What are the key elements of a LIMS for forensics and medical examiners?

From LIMSWiki
Revision as of 15:19, 29 June 2022 by Shawndouglas (talk | contribs) (Created as needed.)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search
Nuclear Forensics (02813659) (14418094348).jpg

Title: What are the key elements of a LIMS for forensics and medical examiners?

Author for citation: Shawn E. Douglas

License for content: Creative Commons Attribution-ShareAlike 4.0 International

Publication date: June 2022

Introduction

A forensics and medical examiners lab may analyze anything from body fluids and bone fragments to metals and fire debris as part of their broad commitment to answering questions of interest to a legal system. These laboratory-based investigations see forensic scientists collect, preserve, and analyze these types of samples (i.e., evidence) using a variety of special laboratory equipment and techniques. Given their role in verifying the status of evidence, the forensics lab will also see its laboratorians take part in legal proceedings, requiring even more strict requirements for data and evidence management (e.g., maintaining chain of custody). This broad array of analytical techniques and set of legal implications means such labs turning to informatics solutions like the laboratory information management system (LIMS) will require their information management solutions to meet the specific needs of their lab.

This brief topical article will examine the typical forensics and medical examiners lab's operations and workload, and suggest a base set of LIMS functionality (i.e., system requirements) that is critical to fulfilling the information management and workflow requirements of this lab type.

Note: Any citation leading to a software vendor's site is not to be considered a recommendation for that vendor. The citation should however still stand as a representational example of what vendors are implementing in their systems.


Forensics laboratory workflow, workload, and information management

The U.S. Department of Justice (DOJ) duly notes the practice of forensic science is multi-disciplinary, spanning from forensic chemistry, molecular biology, and toxicology to anthropology and entomology.[1] This suggests that depending on what a forensics lab or researcher is focusing their efforts on, workflows may differ, sometimes significantly. These workflows may be further complicated by activities outside the laboratory, including collecting evidence, giving testimony, providing forensic psychiatry services, or conducting forensic engineering investigations.[1] This typically results in diverse types of information and data being collected both physically and digitally inside and outside the forensics lab, at all hours of the day. Additionally, the integrity of that information, data, and evidence is vital to establishing legal provenance and positively developing forensic intelligence.[2] This is where a well-developed and -maintained LIMS comes into play.

The use of LIMS in crime labs has grown over time, with the DOJ's Bureau of Justice Statistics (BJS) reporting 75% of publicly funded crime labs using a LIMS in 2002 and 84% in 2009.[3] (A separate survey by Levy in 2011 found 82% of surveyed death investigation offices were using LIMS.[4]) BJS' 2014 report did not discuss this statistic[5], but with the U.S. Drug Enforcement Administration's (DEA's) National Forensic Laboratory Information System (NFLIS) program reporting 88% of labs testing controlled and non-controlled substances secured by law enforcement operations using a LIMS[6], it appears LIMS adoption by forensics and medical examiners labs is continuing to increase. This is important because the processes within these labs match up well with what a LIMS has to offer, with a LIMS capable of enhancing caseload management, reporting, health data security, evidence control (i.e., by maintaining chain of custody), and more.[4][6][7][8]

It's clear that between any two forensics labs, workflows will likely differ, depending on what functions are performed. The 2014 BJS survey found that among publicly funded crime labs, an average of five different forensic functions were performed in or near the lab. The most common activities included identification of drugs and other controlled substances, analysis of biological specimens, analysis of fingerprints, analysis of firearms and toolmarks, and analysis of crime scenes and trace evidence.[5] Some functions, such as toxicology analysis and forensic biology casework, also get outsourced to other labs, with 38% of publicly funded crime labs outsourcing at least one function in 2014.[5] This outsourcing, which may occur as a result of increased forensic testing demand or lack of in-house resources, inevitably puts the forensic workload on other specialty labs that may not necessarily identify purely as forensics labs, muddying the waters further.

Additionally, the workflows of a single lab may change over time as new areas of forensic practice are added to the lab or medical examiners office, requiring additional specialized equipment and LIMS to better manage those new areas of practice.[8] The NFLIS, for example, notes that controlled substance testing labs "are constantly dealing with the need to identify and test for new or emerging drugs," requiring reference spectra, standards, procedures validation, and staff who are familiar or can be trained on the new procedures.[6] It may take time to integrate this sort of new testing into existing workflows; however, a well-maintained configurable LIMS can arguably speed that process along by housing the reference spectra, tracking the inventory of standards, managing the workflows, and documenting staff training on the procedures.

Workflows and workloads can also get altered due to increasing demand for forensic laboratory services, creating backlogs.[5][6][8] These backlogs may occur at no fault of the lab[5][8] and be in part due to a loss of critical staff, an influx of emerging drugs, workload and responsibility increases, lack of funding, and evidence collected for testing that actually doesn't need to be tested.[6][8] Given the state of increasing workloads and backlogs, a LIMS is more important than ever to help improve efficiencies in the laboratory, monitor turnaround times, give insights into backlogs, and better track evidence that doesn't or no longer requires analyses. Of course, as a forensics and medical examiners lab grows and takes on more functions to better meet demand, a highly configurable LIMS also helps integrate those new, related workflows into the dynamics of the lab.

Finally, as noted prior, the integrity of physical evidence and related forensic samples and specimens must me meticulously maintained.[2] An information management system like LIMS is a critical component in maintaining that integrity through mechanisms such as chain of custody and audit trails. This is highlighted in the work of Bollinger et al., who note that "[i]ncorporating a LIMS can help a laboratory achieve and maintain compliance with the accreditation standards (e.g., International Organization for Standardization [ISO] standards, FBI Quality Assurance Standards for DNA) that require laboratories to accurately track and maintain evidence chain of custody throughout the laboratory."


Base LIMS requirements

Given the above, it's clear LIMS adoption and use must continue in crime labs. But a generic LIMS won't do; it's imperative the lab find a solution that meets all or most its workflow requirements. This more often than not requires a configurable solution that enables trained users to quickly make the changes they need, if those changes make sense within the overall data structure of the LIMS.[7]

What follows is a list of system functionality important to most any forensics and medical examiner laboratory, with a majority of that functionality found in many vendor software solutions.[7][8][9][10][11][12][13][14][15][16][17][18][19] In many cases, those solutions aren't necessarily LIMS but rather "case management systems," "medical examiner systems," "medical case management systems," or "coroner management systems." In the end, however, the features across this spectrum of solution types are relatively similar. In some cases, a LIMS will even incorporate the case management features of these specialty systems.

Test, sample and case management

  • Sample, property and evidence log-in and management, with support for unique IDs
  • Support for pre-logging of death and evidence data before physical materials arrive
  • Body reception, location, and disposition support
  • Barcode and RFID support
  • End-to-end sample, body, property, and evidence tracking
  • Custom and industry-specific test and method management, including for breath alcohol and sexual assault testing
  • Test, instrument, subpoena, and other event scheduling
  • Test requesting
  • Configurable screens and data fields
  • Analytical tools, including data visualization, statistical analysis, and data mining tools
  • Data import and export
  • Robust query tools
  • Document and image management
  • Workflow management
  • Case management, including case assignment, reassignment, and prioritization, with support for unique and third-party IDs:
    • Story-related entry for cases
    • Geolocation capture and support
    • Mass casualty event support
    • Cluster and crime scene mapping tools
    • Mobile and offline data entry support for remote work
    • Dashboard view of all pertinent information for a case, including criminal case status
    • Dashboard or other view showing case and test assignment, status, and backlog

Quality, security and compliance

  • Quality assurance / quality control mechanisms
  • Standardized terminology via built-in dictionaries and medical classification codes like ICD
  • National Association of Medical Examiners (NAME) and International Association of Coroners and Medical Examiners (IAC&ME) accreditation support
  • Results review and approval
  • User qualification, performance, and training management
  • Audit trails and chain of custody support
  • Configurable and granular role-based security
  • Configurable system access and use (log-in requirements, account usage rules, account locking, etc.)
  • Electronic signature support
  • Data encryption and secure communication protocols
  • Archiving and retention of case and other data and information
  • Configurable data backups
  • Status updates and alerts

Operations management and reporting

  • Customizable rich-text reporting, with multiple supported output formats
  • Custom and industry-specific forms, including body release, autopsy authorization, media release, cremation authorization, subpoena, etc.
  • Support for state-specific death certificates
  • Industry-compliant labeling
  • Email integration
  • Instrument interfacing and data management
  • Instrument calibration and maintenance tracking
  • Inventory and reagent management
  • Third-party software and database interfacing
  • Integrated (or online) system help
  • Hour, mileage, and expense tracking
  • Turnaround time calculation


Specialty LIMS requirements

As noted previously, the DOJ points out many disciplines and sub-disciplines that are used in and near the forensics laboratory.[1] It is beyond the scope of this article to address the system functionality for each. However, an attempt has been made to cover the most important sub-disciplines associated with forensics and medical examiners labs in regards to LIMS functionality.

Forensic pathology and histology

The workflows of a forensic pathology and histology (or histopathology) lab tend to be marginally different from their purely clinical counterpart. However, the information management needs of the forensic pathology lab will be similar to those found in clinical information management solutions like a laboratory information system (LIS), designed to manage clinical pathology and histology workflows. That said, in addition to the base functionality above, a LIMS that addresses forensic pathology and histology will still need to address (or allow users to)[20][21][22][23][24][25]:

  • Configure the system using templates for histology and cytology case types
  • Add, view, and link pre-generated organ maps and other diagrams
  • Add, view, and link custom annotated pathology imaging
  • Support blocks and slides, as well as whole organs, as specimens, with predefined descriptions
  • Document grossing examinations
  • Print slides and cassettes
  • Provide case management, reporting, and test requisition
  • Provide specialty workflow for autopsy
  • Provide stain panels and histology worksheets
  • Support shared management of tissue samples among departments
  • Support polymerase chain reaction (PCR) workflow and reporting
  • Support pathology-specific reflex testing
  • Create a preliminary findings report for the coroner

Forensic neuropathology

Forensic neuropathology takes many of the aspects of forensic pathology and narrows them down to examinations of the brain and its corresponding structures in the medico-legal context. As such, a forensic LIMS will need to allow users to better perform and manage examinations of head injuries, spinal injuries, infections. and neurological conditions.[26][27][28] This means, in addition to base LIMS and pathology LIMS functionality, forensic neuropathologists need a forensics LIMS that:

  • Comes with pre-configured tests, templates, and case forms specific to neuropathology
  • Fully supports imaging applications and management, typical to forensic neuropathology practice
  • Fully supports a variety of standardized image formats with large file sizes

Forensic toxicology

A 2017 report by NFLIS indicated that among medical examiner/coroner offices surveyed, 96% of them outsourced their toxicology work to an off-site or reference toxicology lab.[29] As such, the toxicology functionality of a forensics LIMS may be of more importance to forensic crime labs than medical examiners offices. That said, such a LIMS should assist the lab with a variety of toxicology, chemistry, and pharmacology test methods. In addition to the base features of a forensics LIMS, the forensic toxicology lab will ask their LIMS to[25][30][31][32][33][34]:

  • Support industry-specific drug, alcohol, chemical (e.g., ethylene glycol) and gas (e.g., carbon monoxide) testing
  • Support customizable drug panels and tests
  • Provide management for compounds and compound grouping
  • Provide toxicology-specific reporting formats supporting best practices
  • Support the management of drug court cases associated with testing
  • Provide trend monitoring

Forensic DNA and molecular testing

Like molecular and genetic diagnostics (i.e., its clinical counterpart), forensic molecular biology turns to a number of chemical, immunological, microscopic, and physical methods for extracting and interpreting DNA and other genetic materials. A wide array of methods encompass these activities, demanding a LIMS that is capable of managing the workflows and tools that assist the forensic molecular biologist. Along with the base LIMS functionality described prior, the forensic molecular biology lab will require its LIMS to[35][36][37][38][39][40][41]:

  • Support common testing for molecular biology, including methods and protocols for serology, short tandem repeat (STR) analyses, and mitochondrial DNA analyses
  • Provide customized workflows for molecular and next-generation sequencing (NGS) testing, including FISH, PCR, gel electrophoresis, cytogenetics, and more
  • Manage sample collection kits
  • Track sample and aliquot lineage for cell lines, tissues, slides, etc.
  • Track nucleic acid quantity and quality of samples or specimens
  • Connect with third-party analytical software systems, e.g., probabilistic genotyping software
  • Provide cleanly formatted rich-text reports customized for molecular diagnostics

Forensic anthropology and entomology

Given the specialized studies involved in these fields, any forensic LIMS will need to address the additional requirements they demand. In the case of forensic anthropology, in addition to base functionality, the LIMS needs to[42][43]:

  • Support high-resolution radiographic imaging
  • Support the workflows and methods of analyzing bones and other hard remains

For the forensic entomology LIMS, it should also[44][45][46][47][48][49]:

  • Provide consistent terminology for insects and their capture methods
  • Offer workflow support in-line with standardized forensic entomology methods
  • Provide sample management and tracking functionality that reduces insect evidence collection errors and provides environmental monitoring of corpse temperatures
  • Be able to differentiate between research activities and casework while still allowing for mining of both types of data and information


Conclusion

This brief topical article sought to answer "what are the key elements of a LIMS for forensics and medical examiners?" It notes that in particular, the forensics and medical examiners lab can be a diverse place, with a wide variety of disciplines and sub-disciplines being practiced inside and outside the lab, creating a wide variety of information and data and requiring a wide variety of methods and procedures. This is the type of environment where a LIMS can really shine when applied well. The LIMS continues to be adopted in these labs for good reason: they can improve efficiencies, manage workflows, improve information and data security, and better provide integrity to evidence and data provenance through chain of custody and audit trail mechanisms. This is especially important as workloads continue to increase for these labs and new drugs and other substances emerge.

A generic LIMS won't do for the forensics and medical examiners lab, however, requiring a software system that takes into account the wide variety of testing and workflow variations within the multi-disciplinary field of forensics. This software system may actually come in the form of a case management system or some variation thereof, but the modern LIMS is gradually starting to include case management functionality, along with sub-disciplinary forensics functionality. When examining the most common sub-disciplines, we find the base forensics LIMS, while useful, may require some additional functionality. The LIMS vendor may bake that into their solution, though they may also leave some aspects of extensibility to the user by making their solution highly configurable. Nevertheless, some LIMS functionality can't be added by the lab, leaving attentive LIMS vendors to include specialty functionality such as support for entomological terminology dictionaries and toxicological trend monitoring.

References

  1. 1.0 1.1 1.2 Office of Legal Policy (26 November 2021). "Forensic Science". U.S. Department of Justice. https://www.justice.gov/olp/forensic-science. Retrieved 13 June 2022. 
  2. 2.0 2.1 McCartney, Carole (2 January 2015). "Forensic data exchange: ensuring integrity" (in en). Australian Journal of Forensic Sciences 47 (1): 36–48. doi:10.1080/00450618.2014.906654. ISSN 0045-0618. http://www.tandfonline.com/doi/abs/10.1080/00450618.2014.906654. 
  3. Durose, M.R.; Walsh, K.A.; Burch, A.M. (August 2012). "Census of Publicly Funded Forensic Crime Laboratories, 2009" (PDF). Bureau of Justice Statistics. https://bjs.ojp.gov/content/pub/pdf/cpffcl09.pdf. Retrieved 14 June 2022. 
  4. 4.0 4.1 Levy, Bruce P. (1 March 2013). "Implementation and User Satisfaction With Forensic Laboratory Information Systems in Death Investigation Offices" (in en). American Journal of Forensic Medicine & Pathology 34 (1): 63–67. doi:10.1097/PAF.0b013e31827ab5c6. ISSN 0195-7910. https://journals.lww.com/00000433-201303000-00016. 
  5. 5.0 5.1 5.2 5.3 5.4 Durose, M.R.; Burch, A.M.; Walsh, K.A.; Tiry, E. (November 2016). "Publicly Funded Forensic Crime Laboratories: Resources and Services, 2014" (PDF). Bureau of Justice Statistics. https://bjs.ojp.gov/content/pub/pdf/pffclrs14.pdf. Retrieved 14 June 2022. 
  6. 6.0 6.1 6.2 6.3 6.4 National Forensic Laboratory Information System (October 2019). "NFLIS-Drug 2019 Survey of Crime Laboratory Drug Chemistry Sections Report" (PDF). U.S. Drug Enforcement Administration. Archived from the original on 18 March 2021. https://web.archive.org/web/20210318022453/https://www.nflis.deadiversion.usdoj.gov/DesktopModules/ReportDownloads/Reports/13121NFLISdrugSurveyRpt6Nov29.pdf. Retrieved 14 June 2022. 
  7. 7.0 7.1 7.2 Bollinger, K.; Salyards, J.; Satcher, R. et al. (August 2020). "A Landscape Study of Laboratory Information Management Systems (LIMS) for Forensic Crime Laboratories" (PDF). Forensic Technology Center of Excellence, U.S. Department of Justice, Office of Justice Programs, National Institute of Justice, Office of Investigative and Forensic Sciences. Archived from the original on 22 March 2021. https://web.archive.org/web/20210322093935/https://forensiccoe.org/private/5ff49f614eb00. Retrieved 13 June 2022. 
  8. 8.0 8.1 8.2 8.3 8.4 8.5 National Institute of Justice (December 2019). "Report to Congress: Needs Assessment of Forensic Laboratories and Medical Examiner/Coroner Offices". U.S. Department of Justice, Office of Justice Programs, National Institute of Justice. https://nij.ojp.gov/library/publications/report-congress-needs-assessment-forensic-laboratories-and-medical. Retrieved 13 June 2022. 
  9. "Alcestis - Features". Michigan Public Health Institute. https://www.alcestis.org/features.htm. Retrieved 13 June 2022. 
  10. "Medical Examiner System". Porter Lee Corporation. 2022. http://www.porterlee.com/mes.html. Retrieved 13 June 2022. 
  11. "CoronerME - Features". CoronerME.com. 2022. https://coronerme.com/features/. Retrieved 13 June 2022. 
  12. "Next Generation Forensic Case Management". NEC Software Solutions UK Limited. 2022. https://www.necsws.com/forensic-case-management/. Retrieved 13 June 2022. 
  13. "Forensic Filer Online". Summit IT Solutions. 2022. https://www.forensicfiler.com/forensic-filer-online.aspx. Retrieved 13 June 2022. 
  14. "Coroner Software Features". Ragefish. 2022. https://www.coronercasemanager.com/features/. Retrieved 13 June 2022. 
  15. "Forensic Advantage Systems". Harris Computer Systems. https://caliberpublicsafety.com/forensic-advantage/. Retrieved 13 June 2022. 
  16. "Cohero - Powerful Features". Cohero. 2022. https://cohero.com/features/. Retrieved 13 June 2022. 
  17. "LIMS-plus". JusticeTrax, Inc. https://justicetrax.com/products-and-services/lims-plus/. Retrieved 13 June 2022. 
  18. "QUINCYTECH". Quincy Technology Solutions, Inc. 2022. https://www.quincytech.com. Retrieved 13 June 2022. 
  19. Douglas, S.E. (May 2022). "21. Forensic case and data management". LIMSpec 2022 R1. LIMSwiki.org. https://www.limswiki.org/index.php?title=LII:LIMSpec/Specialty_Laboratory_Functions#21._Forensic_case_and_data_management. Retrieved 13 June 2022. 
  20. Lau, Gilbert; Lai, Siang Hui (2008). "Forensic Histopathology". Forensic Pathology Reviews 5: 239–265. doi:10.1007/978-1-59745-110-9_13. PMC 7122801. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7122801/. 
  21. "Healthcare - Anatomic Pathology". LabWare, Inc. 2022. https://www.labware.com/industries/healthcare#anatomic. Retrieved 13 June 2022. 
  22. "Sunquest CoPathPlus". CliniSys Group Limited. 2022. https://www.sunquestinfo.com/software-and-services/copathplus/. Retrieved 13 June 2022. 
  23. "NovoPath 360". NovoPath, Inc. 2021. https://www.novopath.com/. Retrieved 13 June 2022. 
  24. "TD HistoCyto". Technidata SAS. 2022. https://www.technidata-web.com/en-gb/solutions-services/solutions/histopathology. Retrieved 13 June 2022. 
  25. 25.0 25.1 "Forensic Science LIMS". Promadis Pty. Ltd. 2022. http://www.promadis.com/go/our-products/forensic-science-lims. Retrieved 14 June 2022. 
  26. Whitwell, Helen L.; Milroy, Christopher; Du Plessis, Daniel, eds. (2021). Forensic neuropathology (Second edition ed.). Boca Raton: CRC Press. ISBN 978-1-4987-0616-2. 
  27. Itabashi, Hideo H., ed. (2007). Forensic neuropathology: a practical review of the fundamentals. Amsterdam ; Boston: Elsevier/Academic Press. ISBN 978-0-12-058527-4. OCLC ocm84612004. https://www.worldcat.org/title/mediawiki/oclc/ocm84612004. 
  28. Schmidt Case, M.E. (18 October 2016). "Forensic Neuropathology". Medscape. WebMD, LLC. https://emedicine.medscape.com/article/1680207-overview. Retrieved 14 June 2022. 
  29. National Forensic Laboratory Information System (August 2018). "2017 Medical Examiner/Coroner Office Survey Report" (PDF). U.S. Drug Enforcement Administration. https://www.nflis.deadiversion.usdoj.gov/nflisdata/docs/NFLIS-MECSurveyReport.pdf. Retrieved 14 June 2022. 
  30. "Easytox: Features". AP Easy Software Solutions. 2020. Archived from the original on 28 October 2020. https://web.archive.org/web/20201028074209/https://easytoxicology.com/features/. Retrieved 14 June 2022. 
  31. "Starfruit Toxicology". Data Unlimited International, Inc. 2017. http://www.duii.com/products/starfruit-toxicology/. Retrieved 14 June 2022. 
  32. "Toxicology LIMS". LabLynx, Inc. 2022. https://www.lablynx.com/industries/forensics/toxicology-lims/. Retrieved 14 June 2022. 
  33. "Online Data Management". DTPM, Inc. 2022. https://www.dtpm.com/online-data-management/. Retrieved 14 June 2022. 
  34. "Pain Management & Toxicology Labs". Orchard Software Corporation. 2022. https://www.orchardsoft.com/solutions/pain-management-toxicology-labs/. Retrieved 14 June 2022. 
  35. Gunn, Peter; Walsh, Simon; Roux, Claude (5 March 2014). "The nucleic acid revolution continues – will forensic biology become forensic molecular biology?". Frontiers in Genetics 5. doi:10.3389/fgene.2014.00044. ISSN 1664-8021. PMC 3942684. PMID 24634675. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3942684/. 
  36. "Sunquest Mitogen LIMS". Sunquest Information Systems, Inc. 2022. https://www.sunquestinfo.com/software-and-services/lims/. Retrieved 14 June 2022. 
  37. "Molecular Diagnostics". XIFIN, Inc. 2021. https://www.xifin.com/industry-solutions/laboratory/molecular-diagnostics. Retrieved 14 June 2022. 
  38. "NucleoLIS - Flexible & Modern LIS". Psyche Systems. 2022. https://psychesystems.com/enterprise-laboratory-information-software/nucleolis-molecular-lab-testing-software/. Retrieved 14 June 2022. 
  39. Myers, C.; Swadley, M.; Carter, A.B. (2018). "Laboratory Information Systems and Instrument Software Lack Basic Functionality for Molecular Laboratories". Journal of Molecular Diagnostics 20 (5): 591–99. doi:10.1016/j.jmoldx.2018.05.011. 
  40. "Forensic Biology Manuals". NYC of Chief Medical Examiner, Department of Forensic Biology. 2022. https://www1.nyc.gov/site/ocme/services/technical-manuals.page. Retrieved 14 June 2022. 
  41. Coble, Michael D.; Bright, Jo-Anne (1 January 2019). "Probabilistic genotyping software: An overview" (in en). Forensic Science International: Genetics 38: 219–224. doi:10.1016/j.fsigen.2018.11.009. https://linkinghub.elsevier.com/retrieve/pii/S1872497318305520. 
  42. "Forensic Anthropology and Bioarchaeology Laboratory". University of Nevada, Reno. https://www.unr.edu/anthropology/research-and-facilities/forensic-anthropology-and-bioarchaeology-laboratory. Retrieved 14 June 2022. 
  43. National Museum of Natural History. "Written in Bone: Forensic Anthropology". Smithsonian. https://naturalhistory.si.edu/education/teaching-resources/written-bone/forensic-anthropology. Retrieved 14 June 2022. 
  44. Ferro, Michael L.; Summerlin, Morgan (8 July 2019). "Developing a standardized list of entomological collection methods for use in databases". ZooKeys 861: 145–156. doi:10.3897/zookeys.861.32347. ISSN 1313-2970. PMC PMC6629709. PMID 31333330. https://zookeys.pensoft.net/article/32347/. 
  45. Stucky, Brian; Balhoff, James; Barve, Narayani; Barve, Vijay; Brenskelle, Laura; Brush, Matthew; Dahlem, Gregory; Gilbert, James et al. (13 March 2019). "Developing a vocabulary and ontology for modeling insect natural history data: example data, use cases, and competency questions". Biodiversity Data Journal 7: e33303. doi:10.3897/BDJ.7.e33303. ISSN 1314-2828. PMC PMC6426826. PMID 30918448. https://bdj.pensoft.net/article/33303/. 
  46. Amendt, Jens; Campobasso, Carlo P.; Gaudry, Emmanuel; Reiter, Christian; LeBlanc, Hélène N.; J. R. Hall, Martin (1 March 2007). "Best practice in forensic entomology—standards and guidelines" (in en). International Journal of Legal Medicine 121 (2): 90–104. doi:10.1007/s00414-006-0086-x. ISSN 0937-9827. http://www.eafe.org/Members_area_files/Best%20Practise.pdf. 
  47. Matuszewski, Szymon (1 April 2021). "Post-Mortem Interval Estimation Based on Insect Evidence: Current Challenges" (in en). Insects 12 (4): 314. doi:10.3390/insects12040314. ISSN 2075-4450. PMC PMC8066566. PMID 33915957. https://www.mdpi.com/2075-4450/12/4/314. 
  48. Lutz, Lena; Verhoff, Marcel A.; Amendt, Jens (9 February 2021). "To Be There or Not to Be There, That Is the Question—On the Problem of Delayed Sampling of Entomological Evidence" (in en). Insects 12 (2): 148. doi:10.3390/insects12020148. ISSN 2075-4450. PMC PMC7915408. PMID 33572161. https://www.mdpi.com/2075-4450/12/2/148. 
  49. Hall, Martin J. R. (17 February 2021). "The Relationship between Research and Casework in Forensic Entomology" (in en). Insects 12 (2): 174. doi:10.3390/insects12020174. ISSN 2075-4450. PMC PMC7922124. PMID 33671186. https://www.mdpi.com/2075-4450/12/2/174.