Workshop
A Summary of the Recommendations Made by the NIST/NIJ Expert Working Group on Human Factors in Forensic DNA Interpretation Workshop
Sunday September 17th, 2023 // 8:30 am - 5:00 pm
Fee includes breakfast, lunch, breaks, and materials.
Description:
The study of human factors in forensic science is an essential element to inform our understanding of the interaction between humans and the systems they use. In understanding human factor issues, we can identify and address the potential for error and bias that can be used to develop ways to shape a positive laboratory culture, enhance staff morale, increase work productivity and quality, and improve the communication of DNA results.
The National Institute of Standards and Technology (NIST)/National Institute of Justice (NIJ) Expert Working Group (EWG) on Human Factors in Forensic DNA Interpretation first convened in February 2020 and was charged with conducting a scientific assessment on the effects of human factors in forensic DNA interpretation with the goal of recommending approaches to improve practice and reduce the likelihood of errors. This EWG has since been evaluating relevant bodies of scientific literature and technical knowledge to develop a report containing these recommendations. This assessment serves to educate members of forensic DNA laboratories and allied criminal justice partners (e.g., legal practitioners, law enforcement investigators, parent organization leadership) alike.
In this workshop, members of this EWG will present, from a human factors perspective, their research and recommendations specific to the following key topic areas of interest:
- Management and leadership in a forensic DNA laboratory.
- Quality Assurance (QA)/Quality Control (QC) in a forensic DNA laboratory.
- The current and ideal future state of education, training, and professional credentialing opportunities for DNA analysts.
- The role of technology in DNA interpretation and the transition from manual to probabilistic methods of DNA interpretation in a forensic DNA laboratory.
- Specific interpretation tasks or decisions that DNA analysts may need to make throughout the course of an analysis from sample receipt through the pre-comparison, comparison, and post-comparison phases of interpretation.
- Written and verbal quantitative and qualitative communication of forensic DNA results.
- Interpretations of DNA results considering alleged activities that aim to contribute to questions about how or when the DNA may have been deposited, including consideration of the transfer, persistence, prevalence, and recovery of DNA.
In completing its charge, this EWG made significant observations regarding these key topic areas of interest. Some of this EWG’s observations and proposed guidance and strategies for mitigating the potential effects of human factors and cognitive biases on the DNA interpretation process to be discussed during this workshop include the following:
- Practical suggestions for how laboratory leadership and management can support implementing the NIST/NIJ EWG on Human Factors in Forensic DNA Interpretation’s recommendations.
- How a post-baccalaureate National Forensic DNA Training Consortium could be implemented, including potential funding sources, curriculum, and providers to fill gaps in these areas and standardize training for DNA analyst onboarding and continuing education opportunities.
- The advantages and drawbacks of certification and licensure of DNA analysts.
- The difficulties surrounding interpretations of DNA results considering alleged activities and the danger of answering questions related to activities during testimony without conducting a formal evaluation that has been technically reviewed by an analyst trained to do so.
- The various views members of this EWG have on the appropriateness for DNA analysts to assist with answering questions considering alleged activities.
Although presented in the context of a forensic DNA laboratory, much of the material to be discussed can apply to policies and practices across any forensic discipline.
Learning Outcomes:
At the end of the workshop, participants will:
- Develop an in-depth knowledge of the NIST/NIJ EWG on Human Factors in Forensic DNA Interpretation’s recommendations relating to a variety of policies and practices within a forensic DNA laboratory. The recommendations discussed will include topics related to management; QA/QC; education, training, and professional credentialing; forensic DNA interpretation; technology implementation; and how these topic areas impact the quantitative and qualitative ways to express forensic DNA results.
- Understand the implications of these recommendations for their own practice and how the recommendations serve to improve the practice of forensic DNA interpretation.
- Possess practical tools to encourage a positive error culture within a forensic DNA laboratory.
- Recognize the importance of human factor considerations in the management of forensic DNA laboratories; in developing a strong quality management system; and in the education, training, and professional credentialing components of current and future DNA analysts and forensic DNA laboratories.
- Be able to identify ways to mitigate bias in education reviews and improve in-house training programs and continuing education opportunities and requirements.
- Acquire practical tools to encourage thoughtful implementation of new techniques, technologies, or methods within a forensic DNA laboratory with the goal of minimizing error, bias, and variability.
- Become familiar with the limitations of and the various views surrounding the evaluation of and answering questions considering alleged activities.
Intended Audience:
- DNA analysts
- Forensic practitioners
- Laboratory management and leadership personnel
- Laboratory Quality Assurance/Quality Control personnel
- Forensic DNA researchers
- Legal practitioners
- Education/Training facilitators
- Certification/Licensure bodies
- Probabilistic Genotyping Software developers
No prerequisite knowledge required.
Speakers

Mikalaa MartinCo-Chair
Forensic Scientist, RTI International
Mikalaa Martin is employed as a Forensic Scientist at RTI International where she supports a variety of multidisciplinary forensic science research projects under the Forensic Technology Center of Excellence, National Sexual Assault Kit Initiative, and various other initiatives funded by the Department of Justice and the National Institute of Standards and Technology. Mrs. Martin serves as a Steering Committee Member for the NIST/NIJ Expert Working Group on Human Factors in DNA Interpretation.
Submit QuestionsNiki OsborneCo-Chair
Forensic Research Scientist | Project Management Support, National Institute of Standards and Technology (Contractor)
Dr. Niki Osborne specializes in understanding and improving human factors issues in forensic evidence interpretation and presentation. Her primary research focus has been on the role of contextual information and potential for cognitive and contextual bias and in bloodstain pattern analysis. From this research, she has developed practical methods to manage contextual information for bloodstain pattern analysis in the laboratory and at the crime scene.
Submit Questions
Hope ZagariaCo-Chair
Research Forensic Social Scientist, RTI International
Hope Zagaria is a Research Forensic Social Scientist at RTI International. She provides support for the National Sexual Assault Kit Initiative as a Forensic DNA subject matter expert and serves as a Steering Committee Member for the NIST/NIJ Expert Working Group on Human Factors in DNA Interpretation.
Submit Questions
Jarrah Kennedy
Senior Biology Criminalist, Kansas City Police Crime Laboratory
Jarrah Kennedy began her career at the Miami-Dade County Crime Laboratory where she spent ~ 1 ½ years as a serologist prior to being called back to the Midwestern US. Since then, she has spent over 16 years at the Kansas City Police Crime Laboratory as a serologist and DNA analyst. Currently, Jarrah serves as a Vice Chair for the Human Forensic Biology Subcommittee (OSAC).
Submit Questions
Michelle Madrid
Senior Criminalist and Assistant DNA Technical Leader, Los Angeles County Sheriff’s Department
Michelle Madrid has 22 years of crime laboratory experience, most of which has been in the DNA and Crime Scene units. She is currently serving as the Assistant DNA Technical Leader for the Los Angeles County Sheriff's Department. Michelle's areas of interest include researching and validating new methods and technologies.
Submit Questions
Tiffany Roy
Consultant, ForensicAid, LLC
Tiffany Roy MSFS, JD is a Forensic DNA expert with over thirteen years of forensic biology experience in both public and private laboratories in the United States. She has processed thousands of DNA samples and thousands of cases over the course of her career. She has provided expert witness testimony in more than one hundred cases in state, federal and international courts. She instructs undergraduates at Palm Beach Atlantic University; University of Maryland Global Campus; and Southern New Hampshire University. She currently acts as a consultant for attorneys and the media in the area of forensic biology through her firm, ForensicAid, LLC.
Submit Questions