Journal:Adapting data management education to support clinical research projects in an academic medical center

From LIMSWiki
Jump to: navigation, search
Full article title Adapting data management education to support clinical research projects in an academic medical center
Journal Journal of the Medical Library Association
Author(s) Read, Kevin B.
Author affiliation(s) New York University School of Medicine
Primary contact Email: kevin dot read at nyumc dot org
Year published 2019
Volume and issue 107(1)
Page(s) 89–97
DOI 10.5195/jmla.2019.580
ISSN 1558-9439
Distribution license Creative Commons Attribution 4.0 International
Website http://jmla.pitt.edu/ojs/jmla/article/view/580/792
Download http://jmla.pitt.edu/ojs/jmla/article/download/580/773 (PDF)

Abstract

Background

Librarians and researchers alike have long identified research data management (RDM) training as a need in biomedical research. Despite the wealth of libraries offering RDM education to their communities, clinical research is an area that has not been targeted. Clinical RDM (CRDM) is seen by its community as an essential part of the research process where established guidelines exist, yet educational initiatives in this area are unknown.

Case presentation

Leveraging my academic library’s experience supporting CRDM through informationist grants and REDCap training in our medical center, I developed a 1.5 hour CRDM workshop. This workshop was designed to use established CRDM guidelines in clinical research and address common questions asked by our community through the library’s existing data support program. The workshop was offered to the entire medical center four times between November 2017 and July 2018. This case study describes the development, implementation, and evaluation of this workshop.

Conclusions

The four workshops were well attended and well received by the medical center community, with 99% stating that they would recommend the class to others and 98% stating that they would use what they learned in their work. Attendees also articulated how they would implement the main competencies they learned from the workshop into their work. For the library, the effort to support CRDM has led to the coordination of a larger institutional collaborative training series to educate researchers on best practices with data, as well as the formation of institution-wide policy groups to address researcher challenges with CRDM, data transfer, and data sharing.

Background

For over 10 years, data management training has been identified as a need by the biomedical research community and librarians alike. From the perspective of biomedical researchers, the lack of good quality information management for research data[1][2] and an absence of training for researchers to improve their data management skills are recurring issues cited in the literature and a cause for concern for research overall.[1][3][4] Similarly, librarians practicing data management have identified that researchers generally receive no formal training in data management[5] yet have a desire to learn[6] because they lack confidence in their skills.

To address this need, librarians from academic institutions have been working to provide data management education and support to their communities. By developing specific approaches to creating data management education, libraries have found successful avenues in implementing stand-alone courses and one-shot workshops[7], integrating research data management into an existing curriculum[8], and offering domain-specific training.[9] Libraries have offered these training programs by providing general data management training to undergraduate and graduate students[10][11][12], doctoral scholars[13], and the general research community[14][15][16][17][18][19][20], whereas domain-specific data management can be seen most prominently in the life sciences[21], earth and environmental sciences[22][23], social sciences[24], and the digital humanities.[25]

While it is clear that libraries have made inroads into domain-specific areas to provide training in data management, the clinical research community—clinical faculty, project, and research coordinators; postdoctoral scholars; medical residents and fellows; data analysts; and medical or doctoral degree (MD/PhD) students—is one that has not received much attention. Clinical research data management (CRDM), an integral part of the clinical research process, differs from the broader concept of research data management because it involves rigorous procedures for the standardized collection and careful management of patient data to protect patient [[Information privacy|privacy] and ensure quality and accuracy in medical care. The clinical research community understands the importance of data standardization[26][27][28][29], data quality[30][31][32][33], and data collection[28][34][35][36] and has established good clinical data management practices (GCDMP)[37] to ensure that CRDM is conducted at the highest level of excellence.

Despite this community-driven goal toward CRDM excellence, there is a dearth of literature about data management training for clinical research, with the only evidence coming from nursing training programs[35][38], whose research practices are further afield in that they focus on quality improvement rather than clinical investigations. This lack of evidence is surprising considering that the need for CRDM training has been communicated.[1][3][4][6]

My library, located in an academic medical center, has supported CRDM through National Library of Medicine informationist projects by collaborating with clinical research teams to improve data management practices[39] and, more recently, by serving as the front line of support for REDCap (an electronic data capture system for storing research data) by offering consultations and comprehensive training.[40] Through REDCap training, I identified a need to expand my knowledge of CRDM to better support the needs of our research community. While REDCap is a tool to help researchers collect data for their studies, the majority of issues that our clinical research community encountered were related to data management. These issues included developing data collection plans, assigning and managing roles and responsibilities throughout the research process, ensuring that the quality of data remains intact throughout the course of the study, and creating data collection instruments. As this recurring thread of issues expanded the learning needs of our community beyond those provided via our REDCap training, I decided to expand my knowledge to address the questions that our researchers asked, to develop a curriculum to support CRDM, and to offer and evaluate CRDM training for our community.

Study purpose

This case study will discuss (a) the development and implementation of a 1.5-hour CRDM workshop for the medical center research community, (b) the results and outcomes from teaching the CRDM workshop, and (c) the next steps for the library in this area.

Case presentation

Workshop development

Gaining skills

Beyond the experience I gained from working closely with researchers on their clinical research projects and through REDCap support, I took two particularly valuable training opportunities that improved my skills in CRDM: the “Data Management for Clinical Research” Coursera course[41] and “Developing Data Management Plans” course[42] offered through the online educational program sponsored by the Society for Clinical Data Management. These two courses provided me with the knowledge that I needed to teach a CRDM workshop but more importantly gave me the confidence to teach it because they provided a depth of knowledge I did not have before. These courses also served to reinforce that the issues and challenges encountered at my own institution were common data management concerns across the broader clinical research community.

Identifying core competencies and building workshop content

The primary focus for developing a 1.5-hour CRDM workshop was to use the GCDMP core guidelines[37] as the baseline structure for the workshop. The core guidelines are separated into chapters in the GCDMP, which were used as the foundation for the core competencies of the workshop. Once this baseline structure was established, my goal was to weave in answers to the common questions that our clinical research community has asked through our existing REDCap training. These questions related to how to create codebooks and data dictionaries for research projects, how to structure roles in a research team, how to use best practices for building data collection instruments, how to protect their data according to Health Insurance Portability and Accountability Act (HIPAA) regulations that they should be aware of, how to improve the quality of their data throughout a study, and how to best document procedures throughout a study.

The goal of the workshop was to tie as many examples back to REDCap as possible, because the use of REDCap was written into institutional policy as the recommended tool for research data collection, which made it essential to highlight its data management capabilities. The core competencies combined with the questions mentioned above served as the foundation for developing the learning objectives and interactive learning activities for the workshop (Table 1).


Table 1. Clinical research data management workshop core competencies
Core competency Learning objectives Interactive learning
Data collection planning ▪ Plan a data collection work flow
▪ Document tools and resources used for data collection
▪ Connect study protocol to data collection plan
▪ Describe study goal
▪ Write down first five steps of the data collection plan
▪ Communicate with partner(s)/team to identify gaps
Data collection instrument design ▪ Describe data collection best practices
▪ Identify common data collection risks and pitfalls
▪ Review data collection form and identify errors
▪ Revise data collection form to collect data according to best practices
Data standards utilization ▪ Define data standards
▪ Describe the benefits of using data standards for research
▪ Locate data standards for use in research study
▪ Navigate the terms of use for specific data standards
▪ Search for relevant data standards in the REDCap Shared Library, National Library of Medicine, and FAIRsharing.org
▪ Explain the terms of use for the chosen data standard
Data quality maintenance ▪ Describe the importance of using data quality measures in a clinical research project
▪ Implement data quality work flows using REDCap
▪ Develop a data quality plan for an existing or prospective research project
▪ Implement the Data Resolution Workflow feature in REDCap
Data storage, transfer, and analysis best practices ▪ Identify institutionally supported data storage and transfer software
▪ Identify the components of a statistical analysis plan
▪ Describe the documentation needed to perform a successful data transfer
▪ Select the appropriate tool for data storage and transfer based on different scenarios
Role and responsibility management ▪ Describe methods for ensuring that roles and responsibilities are clearly assigned
▪ Develop documentation for past, current, and future roles
▪ Assign roles for different project personnel using REDCap
▪ Describe methods used to assign roles with partner(s)/team

The core competencies and learning objectives were designed to make the workshop as practical as possible. While the theoretical components of CRDM are important and are emphasized in the workshop, the main focus was to consistently incorporate interactive learning throughout so that attendees could both apply and contextualize what they learned to their own research. Another goal of this workshop was to encourage communication between attendees to highlight common CRDM errors and provide avenues for attendees to learn about successful and unsuccessful approaches from their peers. To this end, after each core competency was taught, the workshop was designed to have attendees discuss their own experiences.

In addition to the core competencies listed in Table 1, the overarching theme and intention applied across the workshop was the importance of maintaining good documentation throughout a clinical research project (e.g., data collection plan, roles and responsibilities documents, and statistical analysis plan). By stressing the importance of documentation for each competency, I hoped that attendees would understand the value of and be able to develop their own detailed documentation at each stage of the research process. The time dedicated to developing this workshop—which included reviewing the GCDMP core competencies, outlining commonly asked questions from the research community, establishing learning objectives, building the slide deck, and creating the workshop activities—took between 80 and 100 hours to complete.

Workshop implementation

The CRDM workshop was offered broadly throughout the medical center three separate times in November 2017, January 2018, and February 2018. These workshops were promoted using our library’s email discussion list of attendees from previous data classes and the Office of Science and Research and Clinical and Translational Science Institute’s announcements emails. Direct outreach was also extended to residency directors and research coordinators, both of whom regularly attend the library’s REDCap training. A fourth workshop was offered in July 2018 as part of the library’s established Data Day to Day series[43], which the library has substantially marketed through posters, write-ups in institutional newsletters, and broadcast emails.

Workshop evaluation

The CRDM workshop evaluation consisted of both quantitative and qualitative methods using a questionnaire administered at the conclusion of each workshop (see supplemental file "Appendix"). This study was deemed exempt by our institutional review board (IRB). Using Likert scales, questions asked attendees to evaluate the difficulty level of the material presented in the workshop, their willingness to recommend the workshop to others, and their intention to use what they had learned in their work. Free-text questions asked attendees to specify how they would use what they learned in their current roles in the institution and what other course topics they would be interested in learning about. For the question that asked attendees to describe how they would use what they learned in their current roles, I hand-coded responses in a spreadsheet using the emergent coding technique[44] to identify the competencies that attendees stated as the most applicable to their work.

Workshop results

Of the 145 attendees at the four workshops, 113 provided fully or partially completed evaluation forms. Overall registration to and attendance at all four workshops was very high, with substantial wait lists accumulating for each class offered (Figure 1). In fact, the workshop offered in February 2018 was a direct result of having 60 people on the wait list from the January session. Wait lists were useful for identifying communities that I had not reached through training to date as well as for understanding the popularity of the topic for the research community. If the wait list was high in number, it provided another opportunity to offer the workshop or reach out to attendees to see if there was an opportunity to teach a smaller class in their departments.


Fig1 Read JMedLibAssoc2019 107-1.gif

Figure 1. Total attendance, registration, and waitlist numbers for the four clinical research data management (CRDM) workshops

There was a wide range of attendees at these workshops (Figure 2), as there were no restrictions on who could attend. Project/research coordinators (n=38), faculty (n=18), and managers (n=13) were prominent attendees at the workshop, and their comments in the evaluation form reflected its value and the importance of someone from the library teaching this material.


Fig2 Read JMedLibAssoc2019 107-1.gif

Figure 2. Roles of attendees of the four CRDM workshops

Research coordinators and project managers specifically indicated that the CRDM workshop was helpful in multiple ways for their roles, including how to set up the organization of their data collection procedures, how to establish and clarify roles in a research team, and how to develop documentation for both data collection and the roles and responsibilities of their staff. Research coordinators also indicated that no other stakeholders in the institution taught this kind of material and that this type of training was essential for their work.

Faculty indicated that the workshop was beneficial for developing project management skills, gaining an awareness of the benefits of using REDCap to both collect and manage data, and clarifying the roles and responsibilities of statisticians on their team. They also mentioned the benefits of their study team taking a workshop of this kind at the beginning of a study.

Attendees more generally described the value of the resources presented in the workshop, specifically stating that using REDCap, locating resources for identifying relevant data collection standards, gaining awareness of institutional data storage options, and using the workshop slide deck to guide their CRDM processes were particularly helpful.

Overall, the evaluation data indicated positive results, with the majority of those who responded (94%) indicating the level of material was just right, and almost all who responded stating they would recommend the class to others (99%) and would use what they learned in their work (98%). Additionally, responses from attendees who indicated how they would use what they learned and apply it to their current role helped provide additional context for the benefits of the CRDM workshop (Figure 3) with improving documentation (37%), planning work flows (34%), using REDCap (22%), and assigning roles and responsibilities (17%) being the most prominent applications of the core competencies learned.


Fig3 Read JMedLibAssoc2019 107-1.gif

Figure 3. How attendees would use what they learned in their current roles

Finally, attendees expressed interest in many additional topics that they would like to see taught in future classes. These topics included statistics, research compliance, the legal implication of data sharing, and IRB best practices for study design. It is important to mention that attendees indicated that they would like to see these additional topics taught in tandem with the CRDM workshop so that they could gain a better understanding of CRDM from the perspective of an established institutional work flow for clinical research projects.

Discussion

Considering that this was the first time that I had offered CRDM training to our research community, the overall attendance, high wait list numbers, and percentage of attendees who said the course content was at the appropriate level validated the educational approach that I used. One major concern during the workshop development phase was that the content would be too rudimentary for our research community; however, the evaluations suggested that this was not the case. Furthermore, since one of the central goals of the CRDM workshop was to emphasize the importance of documentation for each core competency, the fact that this was the most commonly cited application of what attendees learned was further validation of the CRDM workshop’s course content.

While my approach was to utilize REDCap as a resource to demonstrate good CRDM practices because it served a direct purpose for our research community, this workshop can be taught without reference to it. The core competencies of this workshop (Table 1) are based on fundamental guidelines of good CRDM practice, and these competencies and skills are applicable to any stakeholder who participates in clinical research, no matter what tool or format they decide to use to collect their data.

The positive reviews of the four broadly offered courses led to seven additional CRDM training sessions that were requested by specific departments and research teams, indicating a strong need from our research community for this material. Evaluation forms were not distributed during these seven sessions due to the consult-like nature of these requests. During these sessions, several research coordinators indicated that the CRDM workshop should be required for all clinical research teams before their studies begin. This call for additional training presents an opportunity for our library to incorporate CRDM education into existing institutional initiatives. Specifically, I identified our institutional education and training management system, residency research blocks, and principal investigator training as logical next steps for integrating CRDM education into institutional research work flows.

The evaluation data initiated the development of partnerships with other institutional stakeholders to better support clinical research training efforts. Our library has begun conversations with stakeholders from research compliance, general counsel, the IRB, the Office of Science and Research, and information technology (IT) to identify ways to better address the needs of clinical researchers. The CRDM workshop highlighted a level of uncertainty on the part of clinical researchers about how best to conduct research in the medical center and whom to contact when faced with certain questions or issues.

Subsequent discussions with the aforementioned stakeholders have emphasized a need to provide more clarity to our community about the research process. To this end, our library is leading the coordination of these groups to offer a comprehensive clinical data education series with representatives from each major department providing their own training to complement the library’s existing REDCap and CRDM workshops. This training series will likely be offered through our library’s existing “Data Day to Day” series so that the research community can take all of the classes within a short time span.

The lack of institutional clarity that attendees and the aforementioned stakeholders identified has also led to policy discussions related to data transfer, sharing, and compliance, as our current institutional procedures are unclear and poorly utilized. Through the development of new standard operating procedures and increased educational initiatives, our library is driving awareness of institutional best practices with the hopes of improving clinical research efficiency. Members from our library now sit on institutional policy working groups that are working to improve institutional data transfer and data sharing workflows.

Just as librarians at the University of Washington carved out a role for themselves in supporting clinical research efforts[45], we seized the opportunity to do the same by offering CRDM education. As the first line of defense for teaching researchers, identifying their data management issues, and hearing their concerns, our library is serving as the conduit for ensuring clinical research is conducted according to GCDM practices at our institution. Establishing partnerships with research compliance, general counsel, the Office of Science and Research, and IT provides us with additional knowledge of their institutional roles and subsequently enables us to send researchers in the right direction to receive the necessary expertise and support. As this service model develops, our library plans to monitor and assess referrals to these other departments to demonstrate the value of increasing compliance in the institution and to integrate CRDM education services into any newly developed policy (which we were successful in doing for the new institutional data storage policy and REDCap). With our library serving as the driving force behind the improvement of CRDM support, the ultimate goal is that these new partnerships will result in our research community being better trained, more compliant, and increasingly aware of established institutional workflows for clinical research.

Data availability statement

The workshop evaluation form, resulting data, and slide deck from the “Clinical Research Data Management” workshop are available in Figshare at DOI: http://dx.doi.org/10.6084/m9.figshare.7105817.v1.

Supplemental file

Appendix: Evaluation form

References

  1. 1.0 1.1 1.2 Anderson, N.R.; Lee, E.S.; Brockenbrough, J.S. et al. (2007). "Issues in biomedical research data management and analysis: Needs and barriers". JAMIA 14 (4): 478–88. doi:10.1197/jamia.M2114. PMC PMC2244904. PMID 17460139. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC2244904. 
  2. Wang, X.; Williams, C.; Liu, Z.H.; Croghan, J. (2019). "Big data management challenges in health research—A literature review". Briefings in Bioinformatics 20 (1): 156–67. doi:10.1093/bib/bbx086. PMID 28968677. 
  3. 3.0 3.1 Barone, L.; Williams, J.; Micklos, D. (2017). "Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators". PLoS Computer Biology 13 (10): e1005755. doi:10.1371/journal.pcbi.1005755. PMC PMC5654259. PMID 29049281. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5654259. 
  4. 4.0 4.1 Johansson, B.; Fogelberg-Dahm, M.; Wadensten, B. (2010). "Evidence-based practice: The importance of education and leadership". Journal of Nursing Management 18 (1): 70-7. doi:10.1111/j.1365-2834.2009.01060.x. PMID 20465731. 
  5. Federer, L.M.; Lu, Y.L.; Joubert, D.J. (2016). "Data literacy training needs of biomedical researchers". Journal of the Medical Library Association 104 (1): 52–7. doi:10.3163/1536-5050.104.1.008. PMC PMC4722643. PMID 26807053. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC4722643. 
  6. 6.0 6.1 Scaramozzino, J.M.; Ramírez, M.L.; McGaughey, K.J. (2012). "A Study of Faculty Data Curation Behaviors and Attitudes at a Teaching-Centered University". College & Research Libraries 73 (4): 349–65. doi:10.5860/crl-255. 
  7. Carlson, J.; Johnston, L.; Westra, B.; Nichols, M. (2013). "Developing an Approach for Data Management Education: A Report from the Data Information Literacy Project". International Journal of Digital Curation 8 (1): 204–17. doi:10.2218/ijdc.v8i1.254. 
  8. MacMillan, D. (2015). "Developing data literacy competencies to enhance faculty collaborations". LIBER Quarterly 24 (3): 140–60. doi:10.18352/lq.9868. 
  9. Wittenberg, J.; Elings, M. (2017). "Building a Research Data Management Service at the University of California, Berkeley: A tale of collaboration". IFLA Journal 43 (1): 89–97. doi:10.1177/0340035216686982. 
  10. Piorun, M.E.; Kafel, D.; Leger-Hornby, T. et al. (2012). "Teaching Research Data Management: An Undergraduate/Graduate Curriculum". Journal of eScience Librarianship 1 (1): 8. doi:10.7191/jeslib.2012.1003. 
  11. Reisner, B.A.; Vaughan, K.T.L.; Shorish, Y.L. (2014). "Making Data Management Accessible in the Undergraduate Chemistry Curriculum". Journal of Chemical Education 91 (11): 1943–6. doi:10.1021/ed500099h. 
  12. Adamick, J.; Reznik-Zellen, R.C.; Sheridan, M. (2013). "Data Management Training for Graduate Students at a Large Research University". Journal of eScience Librarianship 1 (3): e1022. doi:10.7191/jeslib.2012.1022. 
  13. Fransson, J.; Lagunas, P.T.; Kjellberg, S.; Toit, M.D. (2016). "Developing integrated research data management support in close relation to doctoral students' research practices". Proceedings of the Association for Information Science and Technology 53 (1): 1–4. doi:10.1002/pra2.2016.14505301094. 
  14. Clement, R.; Blau, A.; Abbaspour, P. et al. (2017). "Team-based data management instruction at small liberal arts colleges". IFLA Journal 43 (1): 105–18. doi:10.1177/0340035216678239. 
  15. Johnston, L.; Jeffryes, J. (2014). "Steal this idea: A library instructors’ guide to educating students in data management skills". College & Research Libraries News 75 (8): 431–4. doi:10.5860/crln.75.8.9175. 
  16. Johnston, L.; Lafferty, M.; Petsan, B. (2012). "Training Researchers on Data Management: A Scalable, Cross-Disciplinary Approach". Journal of eScience Librarianship 1 (2): 2. doi:10.7191/jeslib.2012.1012. 
  17. Muilenburg, J.; Lebow, M.; Rich, J. (2014). "Lessons Learned From a Research Data Management Pilot Course at an Academic Library". Journal of eScience Librarianship 3 (1): 8. doi:10.7191/jeslib.2014.1058. 
  18. Southall, J. Scutt, C. (2017). "Training for Research Data Management at the Bodleian Libraries: National Contexts and Local Implementation for Researchers and Librarians". New Review of Academic Librarianship 23 (2–3): 303–22. doi:10.1080/13614533.2017.1318766. 
  19. Tammaro, A.M.; Casarosa, V. (2014). "Research Data Management in the Curriculum: An Interdisciplinary Approach". Procedia Computer Science 38: 138–42. doi:10.1016/j.procs.2014.10.023. 
  20. Verbakel, E.; Grootveld, M. (2016). "‘Essentials 4 Data Support’: Five years’ experience with data management training". IFLA Journal 42 (4): 278–83. doi:10.1177/0340035216674027. 
  21. DeBose, K.G.; Haugen, I.; Miller, R.K. (2017). "Information Literacy Instruction Programs: Supporting the College of Agriculture and Life Sciences Community at Virginia Tech". Library Trends 65 (3): 316–38. doi:10.1353/lib.2017.0004. 
  22. Fong, B.L.; Wang, M. (2015). "Required Data Management Training for Graduate Students in an Earth and Environmental Sciences Department". Journal of eScience Librarianship 4 (1): 3. doi:10.7191/jeslib.2015.1067. 
  23. Hou, C.-Y. (2015). "Meeting the Needs of Data Management Training: The Federation of Earth Science Information Partners (ESIP) Data Management for Scientists Short Course". Issues in Science & Technology Librarianship Spring 2015 (80). doi:10.5062/F42805MM. 
  24. Thielen, J.; Hess, A.N. (2017). "Advancing Research Data Management in the Social Sciences: Implementing Instruction for Education Graduate Students Into a Doctoral Curriculum". Behavioral & Social Sciences Librarian 36 (1). doi:10.1080/01639269.2017.1387739. 
  25. Dressel, W.F. (2017). "Research Data Management Instruction for Digital Humanities". Journal of eScience Librarianship 6 (2): 5. doi:10.7191/jeslib.2017.1115. 
  26. Bruland, P.; Breil, B.; Ritz, F.; Duggas, M. (2012). "Interoperability in clinical research: from metadata registries to semantically annotated CDISC ODM". Studies in Health Technology and Informatics 180: 564–8. PMID 22874254. 
  27. Gaddale, J.R. (2015). "Clinical Data Acquisition Standards Harmonization importance and benefits in clinical data management". Perspectives in Clinical Research 6 (4): 179–83. doi:10.4103/2229-3485.167101. PMC PMC4640009. PMID 26623387. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC4640009. 
  28. 28.0 28.1 Krishnankutty, B.; Bellary, S.; Kumar, N.B. (2012). "Data management in clinical research: An overview". Indian Journal of Pharmacology 44 (2): 168–72. doi:10.4103/0253-7613.93842. PMC PMC3326906. PMID 22529469. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC3326906. 
  29. Leroux, H.; Metke-Jimenez, A.; Lawley, M.J. (2017). "Towards achieving semantic interoperability of clinical study data with FHIR". Journal of Biomedical Semantics 8 (1): 41. doi:10.1186/s13326-017-0148-7. PMC PMC5606031. PMID 28927443. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5606031. 
  30. Arthofer, K.; Girardi, D. (2017). "Data Quality- and Master Data Management - A Hospital Case". Studies in Health Technology and Informatics 236: 259–66. doi:10.3233/978-1-61499-759-7-259. PMID 28508805. 
  31. Callahan, T.; Barnard, J.; Helmkamp, L. et al. (2017). "Reporting Data Quality Assessment Results: Identifying Individual and Organizational Barriers and Solutions". EGEMS 5 (1): 16. doi:10.5334/egems.214. PMC PMC5982990. PMID 29881736. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5982990. 
  32. Houston, L.; Probst, Y.; Yu, P.; Martin, A. (2018). "Exploring Data Quality Management within Clinical Trials". Applied Clinical Informatics 9 (1): 72–81. doi:10.1055/s-0037-1621702. PMC PMC5801732. PMID 29388180. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5801732. 
  33. Teunenbroek, T.V.; Baker, J.; Dijkzeul, A. (2017). "Towards a more effective and efficient governance and regulation of nanomaterials". Particle and Fibre Toxicology 14 (1): 54. doi:10.1186/s12989-017-0235-z. PMC PMC5735801. PMID 29258600. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5735801. 
  34. Ohmann, C.; Banzi, R.; Canham, S. et al. (2017). "Sharing and reuse of individual participant data from clinical trials: Principles and recommendations". BMJ Open 7 (12): e018647. doi:10.1136/bmjopen-2017-018647. PMC PMC5736032. PMID 29247106. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5736032. 
  35. 35.0 35.1 Polancich, S.; James, D.H.; Miltner, R.S. et al. (2018). "Building DNP Essential Skills in Clinical Data Management and Analysis". Nurse Educator 43 (1): 37–41. doi:10.1097/NNE.0000000000000411. PMID 28665824. 
  36. Sirgo, G.; Esteban, F.; Gómez, J. et al. (2018). "Validation of the ICU-DaMa tool for automatically extracting variables for minimum dataset and quality indicators: The importance of data quality assessment". International Journal of Medical Informatics 112: 166–72. doi:10.1016/j.ijmedinf.2018.02.007. PMID 29500016. 
  37. 37.0 37.1 "GCDMP". Society for Clinical Data Management. 2017. https://www.scdm.org/publications/gcdmp/. 
  38. Sylvia, M.; Terhaar, M. (2014). "An approach to clinical data management for the doctor of nursing practice curriculum". Journal of Professional Nursing 31 (1): 56-62. doi:10.1016/j.profnurs.2013.04.002. PMID 24503316. 
  39. Read, K.B.; LaPolla, F.W.; Tolea, M.I. et al. (2017). "Improving data collection, documentation, and workflow in a dementia screening study". JMLA 105 (2): 160–66. doi:10.5195/jmla.2017.221. PMC PMC5370608. PMID 28377680. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5370608. 
  40. Read, K.; LaPolla, F.W.Z. (2018). "A new hat for librarians: Providing REDCap support to establish the library as a central data hub". JMLA 106 (1): 120–26. doi:10.5195/jmla.2018.327. PMC PMC5764577. PMID 29339942. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5764577. 
  41. Duda, S.; Harris, P. (2017). "Data Management for Clinical Research". Coursera, Inc. https://www.coursera.org/learn/clinical-data-management. 
  42. Walden, A. (2017). "Developing Data Management Plans". Society for Clinical Data Management. http://portal.scdm.org/node/1006. 
  43. Surkis, A.; LaPolla, F.W.; Contaxis, N.; Read, K.B. (2017). "Data Day to Day: building a community of expertise to address data skills gaps in an academic medical center". JMLA 105 (2): 185–91. doi:10.5195/jmla.2017.35. PMC PMC5370612. PMID 28377684. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC5370612. 
  44. Stuckey, H. (2015). "The second step in data analysis: Coding qualitative research data". Journal of Social Health and Diabetes 3 (1): 7. http://go.galegroup.com/ps/anonymous?id=GALE%7CA383423301. 
  45. Bardyn, T.P.; Patridge, E.F.; Moore, M.T.; Koh, J.J. (2018). "Health Sciences Libraries Advancing Collaborative Clinical Research Data Management in Universities". Journal of eScience Librarianship 7 (2): e1130. doi:10.7191/jeslib.2018.1130. PMC PMC6124496. PMID 30197832. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pmcentrez&artid=PMC6124496. 

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added.