Difference between revisions of "Journal:Implementing an institution-wide electronic laboratory notebook initiative"

From LIMSWiki
Jump to navigationJump to search
(Created stub. Saving and adding more.)
 
(Saving and adding more.)
Line 39: Line 39:
Despite these purported advantages, numerous barriers may discourage researchers from transitioning from paper notebooks to ELNs. One primary challenge is cost; unless these tools are licensed by their home institutions, research labs or groups find themselves shouldering the cost of a license for these products. For some, this is a possibility via research funds; however, most find themselves unable or unwilling to cover such a cost. [3, 7, 8, 9] While many ELN products offer a “freemium” model whereby a given number of people or a given amount of storage is free, the limitations of the free versions rarely meet the needs of researchers over time. Additionally, features like institutional single sign-on and integration with an institution's [[Cloud computing|cloud storage]] subscriptions (e.g., Google Drive, Box, Microsoft OneDrive) are often only available with institutional licensing. This is particularly notable for providing additional data security measures important to protecting research [[information]], as well as enabling [[Data retention|retention]] of this information and data by academic institutions.
Despite these purported advantages, numerous barriers may discourage researchers from transitioning from paper notebooks to ELNs. One primary challenge is cost; unless these tools are licensed by their home institutions, research labs or groups find themselves shouldering the cost of a license for these products. For some, this is a possibility via research funds; however, most find themselves unable or unwilling to cover such a cost. [3, 7, 8, 9] While many ELN products offer a “freemium” model whereby a given number of people or a given amount of storage is free, the limitations of the free versions rarely meet the needs of researchers over time. Additionally, features like institutional single sign-on and integration with an institution's [[Cloud computing|cloud storage]] subscriptions (e.g., Google Drive, Box, Microsoft OneDrive) are often only available with institutional licensing. This is particularly notable for providing additional data security measures important to protecting research [[information]], as well as enabling [[Data retention|retention]] of this information and data by academic institutions.


Due to research universities' growing concerns over institutional [[cybersecurity]] and protecting data assets, universities increasingly require their researchers to ensure the security of their research data. This emphasis on data security—which includes guidance on entering, storing, and retaining data with third parties—can further complicate ELN adoption since these products often process and store data in the cloud. [6, 10] This highlights the importance of auditing an ELN product to ensure that third-party companies' data practices are compliant with university standards. This step is easily overlooked when individual research labs or groups purchase licenses for ELN use outside of institutional units (e.g., Procurement Office) or use the free version of an ELN for academic research. Communicating the importance of the institutional security review and its function to protect research data and information long-term for both researchers and the institution is crucial, as is ensuring that the security review process itself is well documented and timely in its completion.
Due to research universities' growing concerns over institutional [[cybersecurity]] and protecting data assets, universities increasingly require their researchers to ensure the security of their research data. This emphasis on data security—which includes guidance on entering, storing, and retaining data with third parties—can further complicate ELN adoption since these products often process and store data in the cloud. [6, 10] This highlights the importance of auditing an ELN product to ensure that third-party companies' data practices are compliant with university standards. This step is easily overlooked when individual research labs or groups purchase licenses for ELN use outside of institutional units (e.g., Procurement Office) or use the free version of an ELN for academic research. Communicating the importance of the institutional security review and its function to protect research data and information long-term for both researchers and the institution is crucial, as is ensuring that the security review process itself is well-documented and timely in its completion.
 
The learning curves posed by integrating new software into researcher [[workflow]]s create additional barriers to widespread ELN adoption. For researchers accustomed to paper notebooks, taking the time to implement and learn a new method of doing something as fundamental as recording and entering data may seem daunting. As with any tool, different tools and user interface learning curves contribute to the difficulty of adopting use of ELNs consistently across research labs or groups. As Argento notes, "One challenge that remains for the success of data management is the slow adoption of the ELN by research staff, partly because the ELN is still a work in progress, partly because old working habits are slow to change." [10] ELNs are promoted as improving efficiency in access to research data, data management, communication, and information sharing, but often these efficiencies are not immediately evident, especially if the adoption of an ELN within a research group or lab is not thoughtfully and systematically approached.
 
Many researchers expect that ELNs must prove easier than using paper in order to justify changing an established workflow. However, an evaluation that only views ELNs through their functions for recordkeeping is incomplete, as ELNs offer functionality beyond documenting experiments and observations. Others have addressed this point by suggesting that ELNs should be viewed as a supplement to print lab notebooks but more dynamic. [8]
 
A last point made by Rudolphi and Goossen is that academia tends to be more decentralized and diverse, which is something that many ELNs don't take into account; also, IT in academia is diverse with many storage/operating systems. [11] While this will likely be an ongoing challenge with ELN adoption in academia, libraries may offer assistance, particularly when it comes to helping researchers integrate an ELN into their research groups or labs from a research workflow and institutional policy perspective. The role that libraries play in supporting ELNs within academia is not well documented, even less so when it comes to academic medical libraries. A 2018 scan by Sayre ''et al.'' of 35 top academic research institutions found that 10 libraries out of the 35 institutions provided ELN support of some kind. [12] Support came in the forms of instruction and consultations, library (or non-library) developed guides or web pages about a particular ELN product, or ELNs in general. For those libraries that support research data services, Sayre ''et al.'' noted that ELNs provide a way of expanding support to encompass other areas, such as intellectual property, licensing, and digital preservation. [12]
 
This was a perspective also shared by Grynoch, who compared 25 academic institutional policies related to data retention and data transferal, specifically in how these policies referenced ELNs. [13] In particular, their paper mentioned how the University of Massachusetts Medical Library worked closely with university IT to develop language around ELN transferal, as well as a process for retaining ELNs when researchers depart the institution. This guidance is intended to clearly communicate how researchers can “take” a copy of their ELN and research data and information with them, while also ensuring the university retains the original. While this type of partnership with IT and development of policy and procedure (P&P) is not inherently built into many library research data services, it is natural in many ways by balancing the user-facing interaction of the library with the technical ability and infrastructure support offered by IT. Libraries engaging with campus ELN efforts can play a large role in contributing to decision-making on campus infrastructure and policy, as these areas are highly relevant to the adoption and use of an ELN at an institution.
 
In order to provide a solution to the information and data management challenges facing the institution and their researchers, the [[Indiana University – Purdue University Indianapolis|Indiana University School of Medicine]] (IUSM) adopted an ELN system. [[LabArchives, LLC|LabArchives]] was the ELN selected for an institutional license, chosen based on an assessment of six other major universities. The identified universities in the assessment support (or supported) institutional licenses of LabArchives. IUSM is the largest medical school in the United States and supports a large research enterprise across its nine campuses in Indiana. The ELN initiative is led by the Ruth Lilly Medical Library and its librarians, who serve all campuses of IUSM and are based in Indianapolis. The medical library was chosen to lead this initiative due to the presence of a library data services program and a data librarian position, as well as the library's role supporting researchers across all disciplines at IUSM.
 
==Case presentation==
===Pilot phase (September 2018–March 2019)===
Upon identifying LabArchives for piloting, 15 [[principal investigator]]s (PIs) volunteered to test out LabArchives in their respective labs following a call for early adopters from the IUSM Office of Research Affairs. From September 2018 to March 2019, these labs were trained in the use of LabArchives and began the process of adopting the ELN within their labs. Initial trainings were held by the vendor (i.e., LabArchives), with the Ruth Lilly Medical Library staff taking over training beginning in October 2018.
 
A user survey to these early adopter groups was distributed in March 2019 (Supplement 1). The survey was anonymous and distributed to the 15 labs (consisting of 67 individual users), with 21 users fully completing the survey (31% response rate). Of the respondents, the majority (67%, ''n'' = 14) used LabArchives 50% to 100% of the time as opposed to another notebook (e.g., paper, other ELN). Twenty of the respondents (95%) also indicated that they adopted specific information and data management practices in their use of LabArchives, including:
 
* Templates for consistently documenting activities like experiments (Supplement 2);
* Shared protocols in LabArchives notebooks;
* Naming convention adoption and establishment; and
* Widget use for routine entries (e.g., calculating amounts, etc.).
 
Lastly, 16 respondents (73%) agreed that use of LabArchives improved their labs' efficiency.
 
===Launch (April 2019)===





Revision as of 18:35, 24 October 2022

Full article title Implementing an institution-wide electronic laboratory notebook initiative
Journal Journal of the Medical Library Association
Author(s) Foster, Erin D.; Whipple, Elizabeth, C.; Rios, Gabriel R.
Author affiliation(s) University of California Berkeley, Indiana University School of Medicine
Primary contact Email: grrios at iu dot edu
Year published 2022
Volume and issue 110(2)
Page(s) 222–7
DOI 10.5195/jmla.2022.1407
ISSN 1558-9439
Distribution license Creative Commons Attribution 4.0 International
Website https://jmla.pitt.edu/ojs/jmla/article/view/1407
Download https://jmla.pitt.edu/ojs/jmla/article/view/1407/2055 (PDF)

Abstract

Background: To strengthen institutional research data management practices, the Indiana University School of Medicine (IUSM) licensed an electronic laboratory notebook (ELN) to improve the organization, security, and shareability of information and data generated by the school’s researchers. The Ruth Lilly Medical Library led implementation on behalf of the IUSM’s Office of Research Affairs.

Case presentation: This article describes the pilot and full-scale implementation of an ELN at IUSM. The initial pilot of the ELN in late 2018 involved 15 research labs, with access expanded in 2019 to all academic medical school constituents. The Ruth Lilly Medical Library supports researchers using the ELN by (1) delivering trainings that cover strategies for adopting an ELN and a hands-on demo of the licensed ELN, (2) providing one-on-one consults with research labs or groups as needed, and (3) developing best practice guidance and template notebooks to assist in adoption of the ELN. The library also communicates availability of the ELN to faculty, students, and staff through presentations delivered at department meetings and write-ups in the institution's newsletter, as appropriate.

Conclusion: As of August 2021, there are 829 users at IUSM. Ongoing challenges include determining what support to offer beyond the existing training, sustaining adoption of the ELN within research labs, and defining “successful” adoption at the institution level. By leading the development of this service, the library is more strongly integrated and visible in the research activities of the institution, particularly as related to information and data management.

Keywords: electronic laboratory notebook, institutional collaborations, information management

Background

Research institutions are currently facing a variety of information and data management challenges, such as increasing amounts of data regenerated, a greater need for data storage, demand for replicability and reproducibility, funder mandates for data sharing, and acts of research misconduct. Within university settings, electronic laboratory notebooks (ELNs) are marketed as an improvement to paper notebooks, including improved information retrieval and data sharing. [1–5] Additionally, ELNs can ingest and store large(r) amounts of data, with many also offering integrated options fordata backup and data security. [6] Lastly, ELNs may promote research reproducibility by providing improved documentation of research processes, particularly through features such as versioning and revision tracking. [6, 7, 8]

Despite these purported advantages, numerous barriers may discourage researchers from transitioning from paper notebooks to ELNs. One primary challenge is cost; unless these tools are licensed by their home institutions, research labs or groups find themselves shouldering the cost of a license for these products. For some, this is a possibility via research funds; however, most find themselves unable or unwilling to cover such a cost. [3, 7, 8, 9] While many ELN products offer a “freemium” model whereby a given number of people or a given amount of storage is free, the limitations of the free versions rarely meet the needs of researchers over time. Additionally, features like institutional single sign-on and integration with an institution's cloud storage subscriptions (e.g., Google Drive, Box, Microsoft OneDrive) are often only available with institutional licensing. This is particularly notable for providing additional data security measures important to protecting research information, as well as enabling retention of this information and data by academic institutions.

Due to research universities' growing concerns over institutional cybersecurity and protecting data assets, universities increasingly require their researchers to ensure the security of their research data. This emphasis on data security—which includes guidance on entering, storing, and retaining data with third parties—can further complicate ELN adoption since these products often process and store data in the cloud. [6, 10] This highlights the importance of auditing an ELN product to ensure that third-party companies' data practices are compliant with university standards. This step is easily overlooked when individual research labs or groups purchase licenses for ELN use outside of institutional units (e.g., Procurement Office) or use the free version of an ELN for academic research. Communicating the importance of the institutional security review and its function to protect research data and information long-term for both researchers and the institution is crucial, as is ensuring that the security review process itself is well-documented and timely in its completion.

The learning curves posed by integrating new software into researcher workflows create additional barriers to widespread ELN adoption. For researchers accustomed to paper notebooks, taking the time to implement and learn a new method of doing something as fundamental as recording and entering data may seem daunting. As with any tool, different tools and user interface learning curves contribute to the difficulty of adopting use of ELNs consistently across research labs or groups. As Argento notes, "One challenge that remains for the success of data management is the slow adoption of the ELN by research staff, partly because the ELN is still a work in progress, partly because old working habits are slow to change." [10] ELNs are promoted as improving efficiency in access to research data, data management, communication, and information sharing, but often these efficiencies are not immediately evident, especially if the adoption of an ELN within a research group or lab is not thoughtfully and systematically approached.

Many researchers expect that ELNs must prove easier than using paper in order to justify changing an established workflow. However, an evaluation that only views ELNs through their functions for recordkeeping is incomplete, as ELNs offer functionality beyond documenting experiments and observations. Others have addressed this point by suggesting that ELNs should be viewed as a supplement to print lab notebooks but more dynamic. [8]

A last point made by Rudolphi and Goossen is that academia tends to be more decentralized and diverse, which is something that many ELNs don't take into account; also, IT in academia is diverse with many storage/operating systems. [11] While this will likely be an ongoing challenge with ELN adoption in academia, libraries may offer assistance, particularly when it comes to helping researchers integrate an ELN into their research groups or labs from a research workflow and institutional policy perspective. The role that libraries play in supporting ELNs within academia is not well documented, even less so when it comes to academic medical libraries. A 2018 scan by Sayre et al. of 35 top academic research institutions found that 10 libraries out of the 35 institutions provided ELN support of some kind. [12] Support came in the forms of instruction and consultations, library (or non-library) developed guides or web pages about a particular ELN product, or ELNs in general. For those libraries that support research data services, Sayre et al. noted that ELNs provide a way of expanding support to encompass other areas, such as intellectual property, licensing, and digital preservation. [12]

This was a perspective also shared by Grynoch, who compared 25 academic institutional policies related to data retention and data transferal, specifically in how these policies referenced ELNs. [13] In particular, their paper mentioned how the University of Massachusetts Medical Library worked closely with university IT to develop language around ELN transferal, as well as a process for retaining ELNs when researchers depart the institution. This guidance is intended to clearly communicate how researchers can “take” a copy of their ELN and research data and information with them, while also ensuring the university retains the original. While this type of partnership with IT and development of policy and procedure (P&P) is not inherently built into many library research data services, it is natural in many ways by balancing the user-facing interaction of the library with the technical ability and infrastructure support offered by IT. Libraries engaging with campus ELN efforts can play a large role in contributing to decision-making on campus infrastructure and policy, as these areas are highly relevant to the adoption and use of an ELN at an institution.

In order to provide a solution to the information and data management challenges facing the institution and their researchers, the Indiana University School of Medicine (IUSM) adopted an ELN system. LabArchives was the ELN selected for an institutional license, chosen based on an assessment of six other major universities. The identified universities in the assessment support (or supported) institutional licenses of LabArchives. IUSM is the largest medical school in the United States and supports a large research enterprise across its nine campuses in Indiana. The ELN initiative is led by the Ruth Lilly Medical Library and its librarians, who serve all campuses of IUSM and are based in Indianapolis. The medical library was chosen to lead this initiative due to the presence of a library data services program and a data librarian position, as well as the library's role supporting researchers across all disciplines at IUSM.

Case presentation

Pilot phase (September 2018–March 2019)

Upon identifying LabArchives for piloting, 15 principal investigators (PIs) volunteered to test out LabArchives in their respective labs following a call for early adopters from the IUSM Office of Research Affairs. From September 2018 to March 2019, these labs were trained in the use of LabArchives and began the process of adopting the ELN within their labs. Initial trainings were held by the vendor (i.e., LabArchives), with the Ruth Lilly Medical Library staff taking over training beginning in October 2018.

A user survey to these early adopter groups was distributed in March 2019 (Supplement 1). The survey was anonymous and distributed to the 15 labs (consisting of 67 individual users), with 21 users fully completing the survey (31% response rate). Of the respondents, the majority (67%, n = 14) used LabArchives 50% to 100% of the time as opposed to another notebook (e.g., paper, other ELN). Twenty of the respondents (95%) also indicated that they adopted specific information and data management practices in their use of LabArchives, including:

  • Templates for consistently documenting activities like experiments (Supplement 2);
  • Shared protocols in LabArchives notebooks;
  • Naming convention adoption and establishment; and
  • Widget use for routine entries (e.g., calculating amounts, etc.).

Lastly, 16 respondents (73%) agreed that use of LabArchives improved their labs' efficiency.

Launch (April 2019)

References

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. To more easily differentiate footnotes from references, the original footnotes (which were numbered) were updated to use lowercase letters. Most footnotes referencing web pages were turned into proper citations.