Difference between revisions of "Journal:Recommended versus certified repositories: Mind the gap"

From LIMSWiki
Jump to navigationJump to search
(Created stub. Saving and adding more.)
 
(Saving and adding more.)
Line 31: Line 31:
==Introduction==
==Introduction==
Data sharing and data management are topics that are becoming increasingly important. More information is appearing about their benefits, such as increased citation rates for research papers with associated shared datasets.<ref name="PiwowarDataReuse13">{{cite journal |title=Data reuse and the open data citation advantage |journal=PeerJ |author=Piwowar, H.A.; Vision, T.J. |volume=1 |pages=e175 |year=2013 |doi=10.7717/peerj.175 |pmid=24109559 |pmc=PMC3792178}}</ref><ref name="PiwowarSharing07">{{cite journal |title=Sharing detailed research data is associated with increased citation rate |journal=PLoS One |author=Piwowar, H.A.; Day, R.S.; Fridsma, D.B. |volume=2 |issue=3 |pages=e308 |year=2007 |doi=10.1371/journal.pone.0000308 |pmid=17375194 |pmc=PMC1817752}}</ref> A growing number of funding bodies such as the NIH and the Wellcome Trust<ref name="NIHGrants15">{{cite web |url=https://grants.nih.gov/grants/policy/nihgps/nihgps.pdf |format=PDF |title=NIH Grants Policy Statement |publisher=National Institutes of Health |date=2015 |accessdate=27 January 2017}}</ref><ref name="WellcomePolicy">{{cite web |url=https://wellcome.ac.uk/funding/managing-grant/policy-data-software-materials-management-and-sharing |title=Policy on data, software and materials management and sharing |publisher=Wellcome Trust |accessdate=27 January 2017}}</ref>, as well as several journals<ref name="BorgmanTheConun12">{{cite journal |title=The conundrum of sharing research data |journal=Journal of the American Society for Information Science and Technology |author=Borgman, C.L. |volume=63 |issue=6 |pages=1059-1078 |year=2012 |doi=10.1002/asi.22634}}</ref>, have installed policies that require research data to be shared.<ref name="MayernikPeer14">{{cite journal |title=Peer Review of Datasets: When, Why, and How |journal=Bulletin of the American Meteorological Society |author=Mayernik, M.S.; Callaghan, S.; Leigh, R. et al. |volume=96 |issue=2 |pages=191–201 |year=2014 |doi=10.1175/BAMS-D-13-00083.1}}</ref> To be able to share data, both now and in the future, datasets not only need to be preserved but also need to be comprehensible and usable for others. To ensure these qualities, research data needs to be managed<ref name="DobratzTheUse10">{{cite journal |title=The Use of Quality Management Standards in Trustworthy Digital Archives |journal=International Journal of Digital Curation |author=Dobratz, S.; Rödig, P.; Borghoff, U.M. et al. |volume=5 |issue=1 |pages=46–63 |year=2010 |doi=10.2218/ijdc.v5i1.143}}</ref>, and data repositories can play a role in maintaining the data in a usable structure.<ref name="AssanteAreSci16">{{cite journal |title=Are Scientific Data Repositories Coping with Research Data Publishing? |journal=Data Science Journal |author=Assante, M.; Candela, L.; Castelli, D. et al. |volume=15 |issue=6 |pages=1–24 |year=2016 |doi=10.5334/dsj-2016-006}}</ref> However, using a data repository does not guarantee that the data is usable, since not every repository uses the same procedures and quality metrics, such as applying proper metadata tags.<ref name="MersonAvoid16">{{cite journal |title=Avoiding Data Dumpsters--Toward Equitable and Useful Data Sharing |journal=New England Journal of Medicine |author=Merson, L.; Gaye, O.; Guerin, P.J. |volume=374 |issue=25 |pages=2414-5 |year=2016 |doi=10.1056/NEJMp1605148 |pmid=27168351}}</ref> As many repositories have not yet adopted generally accepted standards, it can be difficult for researchers to choose the right repository for their dataset.<ref name="DobratzTheUse10" />
Data sharing and data management are topics that are becoming increasingly important. More information is appearing about their benefits, such as increased citation rates for research papers with associated shared datasets.<ref name="PiwowarDataReuse13">{{cite journal |title=Data reuse and the open data citation advantage |journal=PeerJ |author=Piwowar, H.A.; Vision, T.J. |volume=1 |pages=e175 |year=2013 |doi=10.7717/peerj.175 |pmid=24109559 |pmc=PMC3792178}}</ref><ref name="PiwowarSharing07">{{cite journal |title=Sharing detailed research data is associated with increased citation rate |journal=PLoS One |author=Piwowar, H.A.; Day, R.S.; Fridsma, D.B. |volume=2 |issue=3 |pages=e308 |year=2007 |doi=10.1371/journal.pone.0000308 |pmid=17375194 |pmc=PMC1817752}}</ref> A growing number of funding bodies such as the NIH and the Wellcome Trust<ref name="NIHGrants15">{{cite web |url=https://grants.nih.gov/grants/policy/nihgps/nihgps.pdf |format=PDF |title=NIH Grants Policy Statement |publisher=National Institutes of Health |date=2015 |accessdate=27 January 2017}}</ref><ref name="WellcomePolicy">{{cite web |url=https://wellcome.ac.uk/funding/managing-grant/policy-data-software-materials-management-and-sharing |title=Policy on data, software and materials management and sharing |publisher=Wellcome Trust |accessdate=27 January 2017}}</ref>, as well as several journals<ref name="BorgmanTheConun12">{{cite journal |title=The conundrum of sharing research data |journal=Journal of the American Society for Information Science and Technology |author=Borgman, C.L. |volume=63 |issue=6 |pages=1059-1078 |year=2012 |doi=10.1002/asi.22634}}</ref>, have installed policies that require research data to be shared.<ref name="MayernikPeer14">{{cite journal |title=Peer Review of Datasets: When, Why, and How |journal=Bulletin of the American Meteorological Society |author=Mayernik, M.S.; Callaghan, S.; Leigh, R. et al. |volume=96 |issue=2 |pages=191–201 |year=2014 |doi=10.1175/BAMS-D-13-00083.1}}</ref> To be able to share data, both now and in the future, datasets not only need to be preserved but also need to be comprehensible and usable for others. To ensure these qualities, research data needs to be managed<ref name="DobratzTheUse10">{{cite journal |title=The Use of Quality Management Standards in Trustworthy Digital Archives |journal=International Journal of Digital Curation |author=Dobratz, S.; Rödig, P.; Borghoff, U.M. et al. |volume=5 |issue=1 |pages=46–63 |year=2010 |doi=10.2218/ijdc.v5i1.143}}</ref>, and data repositories can play a role in maintaining the data in a usable structure.<ref name="AssanteAreSci16">{{cite journal |title=Are Scientific Data Repositories Coping with Research Data Publishing? |journal=Data Science Journal |author=Assante, M.; Candela, L.; Castelli, D. et al. |volume=15 |issue=6 |pages=1–24 |year=2016 |doi=10.5334/dsj-2016-006}}</ref> However, using a data repository does not guarantee that the data is usable, since not every repository uses the same procedures and quality metrics, such as applying proper metadata tags.<ref name="MersonAvoid16">{{cite journal |title=Avoiding Data Dumpsters--Toward Equitable and Useful Data Sharing |journal=New England Journal of Medicine |author=Merson, L.; Gaye, O.; Guerin, P.J. |volume=374 |issue=25 |pages=2414-5 |year=2016 |doi=10.1056/NEJMp1605148 |pmid=27168351}}</ref> As many repositories have not yet adopted generally accepted standards, it can be difficult for researchers to choose the right repository for their dataset.<ref name="DobratzTheUse10" />
Several organizations, including funding agencies, academic publishers, and data organizations provide researchers with lists of supported or recommended repositories, e.g., BioSharing.<ref name="McQuiltonBioSharing16">{{cite journal |title=BioSharing: curated and crowd-sourced metadata standards, databases and data policies in the life sciences |journal=Database |author=McQuilton, P.; Gonzalez-Beltran, A.; Rocca-Serra, P. et al. |volume=2016 |pages=baw075 |year=2016 |doi=10.1093/database/baw075 |pmid=27189610 |pmc=PMC4869797}}</ref> These lists vary in length, in the number and type of repositories they list, and in their selection criteria for recommendation. In addition, recommendations for data and data sharing are emerging, such as the [[Journal:The FAIR Guiding Principles for scientific data management and stewardship|FAIR Data Principles]], guidelines to establish a common ground for all data to be findable, accessible, interoperable, and reusable.<ref name="WilkinsonTheFAIR16">{{cite journal |title=The FAIR Guiding Principles for scientific data management and stewardship |journal=Scientific Data |author=Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J. et al. |volume=3 |pages=160018 |year=2016 |doi=10.1038/sdata.2016.18 |pmid=26978244 |pmc=PMC4792175}}</ref> Some data repositories are beginning to incorporate the FAIR principles into their policies, such as the UK Data Service<ref name="UKDSTheFair16">{{cite web |url=https://www.ukdataservice.ac.uk/news-and-events/newsitem/?id=4615 |title=The 'FAIR' principles for scientific data management |publisher=UK Data Service |date=08 June 2016 |accessdate=28 October 2016}}</ref> and several funders such as the EU Horizon 2020 program and the NIH.<ref name="ECGuide16">{{cite web |url=http://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-data-mgt_en.pdf |format=PDF |title=Guidelines on FAIR Data Management in Horizon 2020 |publisher=European Commission |date=26 July 2016 |accessdate=27 October 2016}}</ref><ref name="NIHBigData17">{{cite web |url=https://commonfund.nih.gov/bd2k |title=Big Data to Knowledge |publisher=National Institutes of Health |date=2017}}</ref> Lists of recommended repositories and guidelines such as these can help researchers decide how and where to store and share their data.


==References==
==References==

Revision as of 21:16, 17 October 2017

Full article title Recommended versus certified repositories: Mind the gap
Journal Data Science Journal
Author(s) Husen, Sean Edward; de Wilde, Zoë G.; de Waard, Anita; Cousijn, Helena
Author affiliation(s) Leiden University, Elsevier
Primary contact Email: s dot e dot husen at hum dot leidenuniv dot nl
Year published 2017
Volume and issue 16(1)
Page(s) 42
DOI 10.5334/dsj-2017-042
ISSN 1683-1470
Distribution license Creative Commons Attribution 4.0 International
Website https://datascience.codata.org/article/10.5334/dsj-2017-042/
Download https://datascience.codata.org/articles/10.5334/dsj-2017-042/galley/710/download/ (PDF)
This article should not be considered complete until this message box has been removed. This is a work in progress.

Abstract

Researchers are increasingly required to make research data publicly available in data repositories. Although several organizations propose criteria to recommend and evaluate the quality of data repositories, there is no consensus of what constitutes a good data repository. In this paper, we investigate, first, which data repositories are recommended by various stakeholders (publishers, funders, and community organizations) and second, which repositories are certified by a number of organizations. We then compare these two lists of repositories, and the criteria for recommendation and certification. We find that criteria used by organizations recommending and certifying repositories are similar, although the certification criteria are generally more detailed. We distill the lists of criteria into seven main categories: “Mission,” “Community/Recognition,” “Legal and Contractual Compliance,” “Access/Accessibility,” “Technical Structure/Interface,” “Retrievability,” and “Preservation.” Although the criteria are similar, the lists of repositories that are recommended by the various agencies are very different. Out of all of the recommended repositories, less than six percent obtained certification. As certification is becoming more important, steps should be taken to decrease this gap between recommended and certified repositories, and ensure that certification standards become applicable, and applied, to the repositories which researchers are currently using.

Keywords: data repositories, data management, certification, data quality, data fitness

Introduction

Data sharing and data management are topics that are becoming increasingly important. More information is appearing about their benefits, such as increased citation rates for research papers with associated shared datasets.[1][2] A growing number of funding bodies such as the NIH and the Wellcome Trust[3][4], as well as several journals[5], have installed policies that require research data to be shared.[6] To be able to share data, both now and in the future, datasets not only need to be preserved but also need to be comprehensible and usable for others. To ensure these qualities, research data needs to be managed[7], and data repositories can play a role in maintaining the data in a usable structure.[8] However, using a data repository does not guarantee that the data is usable, since not every repository uses the same procedures and quality metrics, such as applying proper metadata tags.[9] As many repositories have not yet adopted generally accepted standards, it can be difficult for researchers to choose the right repository for their dataset.[7]

Several organizations, including funding agencies, academic publishers, and data organizations provide researchers with lists of supported or recommended repositories, e.g., BioSharing.[10] These lists vary in length, in the number and type of repositories they list, and in their selection criteria for recommendation. In addition, recommendations for data and data sharing are emerging, such as the FAIR Data Principles, guidelines to establish a common ground for all data to be findable, accessible, interoperable, and reusable.[11] Some data repositories are beginning to incorporate the FAIR principles into their policies, such as the UK Data Service[12] and several funders such as the EU Horizon 2020 program and the NIH.[13][14] Lists of recommended repositories and guidelines such as these can help researchers decide how and where to store and share their data.

References

  1. ↑ Piwowar, H.A.; Vision, T.J. (2013). "Data reuse and the open data citation advantage". PeerJ 1: e175. doi:10.7717/peerj.175. PMC PMC3792178. PMID 24109559. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3792178. 
  2. ↑ Piwowar, H.A.; Day, R.S.; Fridsma, D.B. (2007). "Sharing detailed research data is associated with increased citation rate". PLoS One 2 (3): e308. doi:10.1371/journal.pone.0000308. PMC PMC1817752. PMID 17375194. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1817752. 
  3. ↑ "NIH Grants Policy Statement" (PDF). National Institutes of Health. 2015. https://grants.nih.gov/grants/policy/nihgps/nihgps.pdf. Retrieved 27 January 2017. 
  4. ↑ "Policy on data, software and materials management and sharing". Wellcome Trust. https://wellcome.ac.uk/funding/managing-grant/policy-data-software-materials-management-and-sharing. Retrieved 27 January 2017. 
  5. ↑ Borgman, C.L. (2012). "The conundrum of sharing research data". Journal of the American Society for Information Science and Technology 63 (6): 1059-1078. doi:10.1002/asi.22634. 
  6. ↑ Mayernik, M.S.; Callaghan, S.; Leigh, R. et al. (2014). "Peer Review of Datasets: When, Why, and How". Bulletin of the American Meteorological Society 96 (2): 191–201. doi:10.1175/BAMS-D-13-00083.1. 
  7. ↑ 7.0 7.1 Dobratz, S.; Rödig, P.; Borghoff, U.M. et al. (2010). "The Use of Quality Management Standards in Trustworthy Digital Archives". International Journal of Digital Curation 5 (1): 46–63. doi:10.2218/ijdc.v5i1.143. 
  8. ↑ Assante, M.; Candela, L.; Castelli, D. et al. (2016). "Are Scientific Data Repositories Coping with Research Data Publishing?". Data Science Journal 15 (6): 1–24. doi:10.5334/dsj-2016-006. 
  9. ↑ Merson, L.; Gaye, O.; Guerin, P.J. (2016). "Avoiding Data Dumpsters--Toward Equitable and Useful Data Sharing". New England Journal of Medicine 374 (25): 2414-5. doi:10.1056/NEJMp1605148. PMID 27168351. 
  10. ↑ McQuilton, P.; Gonzalez-Beltran, A.; Rocca-Serra, P. et al. (2016). "BioSharing: curated and crowd-sourced metadata standards, databases and data policies in the life sciences". Database 2016: baw075. doi:10.1093/database/baw075. PMC PMC4869797. PMID 27189610. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4869797. 
  11. ↑ Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J. et al. (2016). "The FAIR Guiding Principles for scientific data management and stewardship". Scientific Data 3: 160018. doi:10.1038/sdata.2016.18. PMC PMC4792175. PMID 26978244. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4792175. 
  12. ↑ "The 'FAIR' principles for scientific data management". UK Data Service. 8 June 2016. https://www.ukdataservice.ac.uk/news-and-events/newsitem/?id=4615. Retrieved 28 October 2016. 
  13. ↑ "Guidelines on FAIR Data Management in Horizon 2020" (PDF). European Commission. 26 July 2016. http://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-data-mgt_en.pdf. Retrieved 27 October 2016. 
  14. ↑ "Big Data to Knowledge". National Institutes of Health. 2017. https://commonfund.nih.gov/bd2k. 

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. The original article lists references alphabetically, but this version — by design — lists them in order of appearance.

Retrieved from "https://www.limswiki.org/index.php?title=Journal:Recommended_versus_certified_repositories:_Mind_the_gap&oldid=31863"