Journal:The evolution, use, and effects of integrated personal health records: A narrative review

From LIMSWiki
Jump to navigationJump to search
Full article title The evolution, use, and effects of integrated personal health records: A narrative review
Journal electronic Journal of Health Informatics
Author(s) Zieth, Caroline R.; Chia, Lichun Rebecca; Roberts, Mark S.; Fischer, Gary S.; Clark, Sunday; Weimer, Melissa; Hess, Rachel
Author affiliation(s) Center for Research on Health Care, University of Pittsburgh; University of Pittsburgh School of Medicine;
Weil Cornell Medical College; University of Pittsburgh Graduate School of Public Health
Primary contact Caroline Zieth - Email: ziethcr@upmc.edu
Year published 2014
Volume and issue 8 (2)
Page(s) e17
DOI None
ISSN 1446-4381
Distribution license Creative Commons Attribution-NonCommercial-ShareAlike 3.0
Website http://www.ejhi.net/ojs/index.php/ejhi/article/view/247
Download http://www.ejhi.net/ojs/index.php/ejhi/article/download/247/169 (PDF)

Abstract

Objective: To present a summarized literature review of the evolution, use, and effects of Personal Health Records (PHRs).

Methods: Medline and PubMed were searched for ‘personal health records’. Seven hundred thirty-three references were initially screened resulting in 230 studies selected as relevant based on initial title and abstract review. After further review, a total of 52 articles provided relevant information and were included in this paper. These articles were reviewed by one author and grouped into the following categories: PHR evolution and adoption, patient user attitudes toward PHRs, patient reported barriers to use, and the role of PHRs in self-management.

Results: Eleven papers described evolution and adoption, 17 papers described PHR user attitudes, 10 papers described barriers to use, and 11 papers described PHR use in self-management. Three papers were not grouped into a category but were used to inform the Discussion. PHRs have evolved from patient-maintained paper health records to provider-linked electronic health records. Patients report enthusiasm for the potential of modern PHRs, yet few patients actually use an electronic PHR. Low patient adoption of PHRs is associated with poor interface design and low health and computer literacy on the part of patient users.

Conclusion: PHR systems that account for patient’s needs and skills can facilitate their adoption. Common barriers are avoidable when patients receive adequate guidance on useful features as well as technical support. When implemented effectively, PHRs can increase patient participation in health management, and improve patient-physician communication and health related decision making.

Keywords: Personal Health Records; Electronic Health Records; Electronic Medical Records

Introduction

Involving patients in their health care using information technology (IT) such as interoperable personal health records (PHRs) may increase healthcare efficiency and improve quality while reducing medical errors.[1] The idea behind a PHR has existed for decades.[2][3] Initially, PHRs were in the form of paper medical records created and maintained by patients and used to augment healthcare provided in person.[4] These records, compiled and stored on paper by patients and families, allowed individuals to preserve their complete medical history.[3] As IT evolved, patients and families began to electronically store many health-related documents, including clinical notes from different health care providers, laboratory test results, and medication prescription records, essentially creating electronic versions of paper PHRs.[3][4]

Early patient-initiated PHRs have evolved into a wide variety of computer-based applications that allow patients to securely store health-related information such as laboratory test results; these can be maintained solely by patients or by both patients and clinicians.[3][5] Currently, employers, healthcare providers, and third party organizations have deployed a variety of electronic PHRs differing in architecture and function.[6][7] These PHRs range from original, stand-alone applications where patients enter the majority of their medical information to those integrated into the clinical health record.[4] In beginning to create standards for PHRs, the Markle Foundation’s Connecting for Health Collaborative defined a PHR as “an electronic application through which individuals can access, manage and share their health information, and that of others for whom they are authorized, in a private, secure, and confidential environment".[8] Currently, an estimated 70 million insured patients have access to some form of electronic PHR and those who do not would like access.[9][10]

When integrated with provider-maintained electronic health records (EHRs), PHRs are electronically linked to clinical information in the EHRs, which are repositories of all electronically available patient medical information from multiple sources, and which are updated by health care providers.[11][12] With integrated PHRs, patients can view automatically populated medical information, such as laboratory test results.[4][6][11] They have advantages over stand-alone PHRs by allowing securely linked patient-provider communication outside traditional clinical encounters. Integrated PHRs provide a means to create a shared patient record through evolving features including patient-physician collaborative tools and interactive decision-making tools, personalized management tools for chronic conditions, integrated and linked health information resources, and patient-entered information.[3][4][11][13][14][15][16]

To inform healthcare decision-making, PHR development, and future research on clinical outcomes, this literature review summarizes the evolution, use, and effects of PHRs, with a focus on integrated PHRs. Four broad areas are address: (1) the characteristics of PHR use, including their evolution and adoption, (2) patient and provider attitudes toward PHRs, (3) barriers to PHR adoption and use, and (4) the effects of PHRs on patient management and outcomes.

Methods

Medline and PubMed were searched to identify English-language articles focused on PHRs and published between 1970 and 2011. Studies were included based on the content of titles and abstracts, removing those for which the abbreviation PHR did not stand for ‘personal health record’. Of the 733 retrieved references initially identified in the search, 230 studies were selected as relevant based on initial title and abstract. Two independent reviewers (LRC and RH) screened these and a single reviewer (CRZ) verified the studies contained information regarding PHR evolution, consumer attitudes, barriers to use, and/or self-management through in-depth investigation of study content. Information from the final 52 papers, representing both qualitative and quantitative studies, was placed into four main categories: (1) the characteristics of PHR use, including their evolution and adoption, (2) patient and provider attitudes toward PHRs, (3) barriers to PHR adoption and use, and (4) the effects of PHRs on patient management and outcomes. Papers could contribute information to multiple categories (Tables 1-3).

Results

Evolution and adoption of PHRs

Eleven papers described the evolution of PHRs and the settings in which they are used. Early examples of PHRs were paper-based and patient-maintained.[3] Use of paper-based PHRs has continued even after computerized information systems had become available. For example, parents have routinely collected their children’s basic medical information and tracked their child’s development and immunizations using baby books or have carried wallet cards containing basic personal medical data (i.e., emergency contacts, blood types and allergy information).[3][17] Patients continue to keep some paper records despite the rise of electronic PHRs.[18] Currently almost half (42%) of Americans keep some form of a PHR, defined in this article as any single place where medical information is kept, and the majority (87%) are paper-based.[19]

As IT developed, patients began creating digital rather than paper records. Electronic PHRs evolved as patients started entering their health information into computer-based applications.[3][4] PHR functionality expanded to give patients the ability to view personal health information stored in their health care provider’s records.[4] Web-based PHRs originated in the emergency room and included online emergency medical records.[3][5] As practice and hospital-based EHRs evolved, they merged with PHRs and have become a major source of the information contained within integrated PHRs. Patients now have access to integrated PHRs through their insurers or healthcare providers; however, patient adoption of PHRs has lagged behind this access. Preliminary estimates from the National Ambulatory Medical Care Survey (NAMCS) found that 51% of physicians reported providing patients with access to an integrated or partially integrated PHR (i.e. an electronic medical record (EMR) or EHR linked PHR).[20] In a 2010 Consumer and Health Information Technology survey, however, only 7% of Americans reported having used either a stand-alone or an integrated PHR; a 2008 Markle Foundation survey reported fewer than 3%.[13][21][22][23]

Attitudes toward adoption and use of PHRs

Seventeen papers described patient or provider attitudes toward electronic and paper-based PHRs (Table 1). Patients are eager to use PHRs for their potential to improve health care delivery and outcomes but these positive attitudes do not translate into use.[24][25][26][27][28][29] Patients have mixed reasons for using or not using a PHR some of which are tied to their motivation to improve health outcomes and their relationship with their physician. Understanding patient motivation is important, particularly when designing and adopting PHRs.[24] Patients seek the ability to control access to their health information and believe they should have access.[30][31] Patients view integrated PHRs favorably with one report finding that 60% of patients indicate they would use an integrated PHR to look up test results and record their medication, and another survey finding that 75% of patients would communicate with physicians electronically if given the option.[10][13] Patients’ motivation to participate in their health care fosters their interest in viewing their PHRs and viewing PHRs influences patients’ care-related decision-making.[24][27][32] Diabetic patient users of an integrated PHR reported receiving care more quickly, and connecting with their doctor more easily.[15] An integrated PHR with features such as secure patient-physician messaging, medication history updating, and online requests for medication renewals was highly valued by elderly and disabled patients, patients with chronic conditions, and middle-aged female patients.[33][34][35] The ability to contact health care providers through secure messaging in an integrated PHR provided a feeling of security for patients in the Netherlands.[26] Patients want to view their records in order to have detailed information about their health, and those using an integrated PHR reported feeling more in control of their chronic conditions and a sense of illness-ownership, which motivated them to contribute information to their EHR.[24][27][36] Patients’ satisfaction with their physicians influenced their use of an integrated PHR. Patients expressing satisfaction with their patient-provider relationship were less likely to use an integrated PHR than patients expressing dissatisfaction.[25] Those expressing dissatisfaction viewed access to their PHR as a means of gaining knowledge or control over their health.

Five studies reported on ease of use for patients accessing an integrated PHR.[26][28][33][34][35] More than 60% of patients with head or neck cancer in the Netherlands and the majority of middle-aged adult patients in the United Kingdom found an integrated PHR easy to navigate.[26][28] Female patients who used an integrated PHR rated various functions easier to use than males.[33] Several studies, however, reported that patients did not maintain health information in their PHRs despite ease of use. Elderly patients found value in using an integrated PHR for updating medications, health problems, and lab test information, yet failed to annotate certain health information such as immunizations and laboratory test results, which the authors attributed to difficulties with the user interface of the integrated PHR.[34]


Table 1: Attitudes toward Adoption and Use of PHR
Authors/Year Population Design Results Implications According to Authors
Krist et al. (2012)[13] n=4,500, patient users of an interactive PHR (IPHR) from 8 primary care practices EMR and survey data were analyzed to determine IPHR effectiveness •Patients (25% ) who used the IPHR were up-to-date on all services; double the rate for non-users Practices need to inform patients about PHR’s value and relevance to care
Witry et al. (2010)[16] n=28, physicians from 4 family medicine practices 4 focus groups to explore physician views of PHRs •Physicians thought PHRs beneficial for certain patient populations (e.g., mobile populations)
•Physicians expressed doubt about the likelihood of patients updating their PHRs
Providers are unfamiliar with electronic PHRs; physician use of electronic PHRs may increase with exposure
Tobacman et al. (1996) [17] n=100, patient users of a standalone PHR Telephone questionnaire to determine acceptance, usefulness, and impact of PHR •Adult patients were interested in PHRs There is an unmet need among patients for PHR access
Winkelman et al. (2005)[24] =12, inflammatory bowel disease patient users of an EMR linked PHR in Canada Qualitative study using in-depth interviews and focus groups •PHR access promoted a sense of illness ownership, healthy practices, and participation in illness management Direct patient participation is crucial for developing and designing a PHR system
Zickmund et al. (2007)[25] n=39, diabetic patient users of an integrated PHR from 4 primary care practices 10 focus groups conducted to determine impact of an electronic PHR on patient-physician relationship •Patients appreciated having access to lab results
•Patients appreciated using the PHR to communicate directly with their PCP
A good patient-provider relationship may diminish the perceived utility of a PHR
Brink et al. (2005)[26] n=36, cancer patient users of an electronic PHR and (n=36) general practitioners in the Netherlands Questionnaires completed on PHR use after 6 week period •PHR system was highly valued by patients
•Patients (64%) reported increased knowledge of illness and treatment
Using electronic PHR in conjunction with clinical practice is recommended
Jones et al. (1999)[27] n=783, general medicine and dental practitioners, and patient users of an electronic, stand-alone medical-dental PHR in the United Kingdom 3 part study: survey, randomized trial, and assessment of PHR records Patients felt positively about the PHR and recognized their role in maintaining information within
•Dentists and doctors expressed positive attitudes towards the PHR
Patient’s positive attitudes towards PHRs may increase after extended utilization
Pyper et al. (2004)[28] n=606, patient users of an integrated PHR in the United Kingdom Postal distribution of questionnaire •Patients concerned with the security and privacy of the PHR
•Majority of patients wanted access to their records
The ideal PHR should be developed by a patient-physician partnership
Zayas-Caban et al. (2007)[29] n=7, patient users of a hypothetical PHR system 2-part interviews conducted to determine how well patients understand PHRs •Adult patients expressed positive attitude concerning access to electronic PHR
•Patients understood how they would use PHR to manage their health
Patients’ needs should be addressed in the design of and education about PHRs
Cox et al. (2008)[30] n=1202, stakeholders, healthcare consumers, and patient users of an integrated PHR Telephone, paper and web surveys plus focus groups assessed consumer’s views •Stakeholders trusted a PHR developed by a not-for-profit over one developed by government or private-sector organizations
•Consumers expressed privacy concerns
A community outreach and communications program may inform the development of a PHR
Keselman et al. (2007)[32] n=103, chronic disease patient users of both paper-based and electronic PHRs Survey to determine patient needs and experiences with their health records for optimizing PHR design •Patients felt a secure, online PHR provided easy access to EHR
•Patients felt medical records should be reviewed and discussed with health professionals to enhance patient comprehension
PHRs should offer the ability to view radiology reports, physicians’ notes, and diagnostic images
Hassol et al. (2004)[33] n=1,421, patient users of an integrated PHR and (n=10) primary care physicians Online survey and focus groups with patients; one-on-one interviews with physicians •Positive patient reports on ease of use and satisfaction with PHR PHRs improve efficiency and effectiveness of health care
Kim et al. (2007)[34] n=46, Elderly and disabled patient users of an electronic PHR PHR database log analyzed to determine patient usage patterns •Amount of activity by participants suggests that users found the electronic PHR valuable Information for behavior of users/nonusers should be studied to optimize electronic PHRs for underserved populations
Hess et al. (2007)[35] n=39, patient users of an integrated PHR Focus groups, patient’s reactions to an electronic PHR in diabetes self-management •Trusted, centralized health information was useful to patients
•Participants most appreciated electronic communication feature and health-related management tools
•Frequent users reported a sense of empowerment
Patients highly valued the secure, electronic messaging feature of the electronic PHR
Cimino et al. (2002)[36] n=13, patient and physician users of an integrated PHR PHR log file, online questionnaire, and telephone interview data analyzed •Patients felt increased ownership of their health
•Patients were impressed with the PHR
•Physicians reported improved communication with patients
PHR systems may improve health outcomes for select groups of patients
Wiljer et al. (2010)[38] n=250, cancer patient users of an integrated PHR in Canada Log files analyzed to assess the impact of electronic PHR access •Patients preferred receiving PHR support by phone as opposed to email Optimizing PHR functionality may decrease human error
Pyper et al. (2004)[52] n=100, patient users of an integrated PHR in the United Kingdom Interviews conducted to evaluate first-time patient-users’ experience with an electronic PHR •Patients found the PHR useful and easy to use PHR access may improve patient care; requires additional resources to support future demand

Barriers toward adoption and use of PHRs

Ten papers described patient or physician barriers to using electronic and paper-based PHRs (Table 2). A broad range of barriers to PHR adoption exists, many of which may be overcome by providing adequate technical support. Trends noted with paper-based PHRs, such as failure to document adult immunizations, laboratory test results, allergies and blood sugar, continued into electronic PHRs.[17] Difficult concepts, unfamiliar medical terms, and unknown abbreviations are commonly cited barriers.[32] Low computer literacy, low health literacy, and computer anxiety are additional patient-reported barriers in accessing electronic PHRs.[37] The time requirement for learning and, when information is not tightly linked between the PHR and EHR, entering personal health information into an electronic PHR system is problematic for patients as well as health care support staff.[25][37] Nearly all breast cancer patients (98%) in one Canadian study required technical support when accessing their electronic PHR.[38] Barriers to using an integrated PHR included lost or unknown user names and passwords, and patients’ lack of awareness of useful features.[35]

Patients are better able to access and maintain a PHR when given tailored education, technical assistance, self-management support, consumer-friendly PHR interface design, and access to trained staff.[4][29][32][37][38] Implementing these support mechanisms may require additional resources. Patients battling cancer found learning how to use an integrated PHR system was not difficult after receiving personal instruction.[26] Integrated PHRs could alleviate comprehension barriers by providing online terminology support such as using a text translator to clarify medical terms.[32][39] In addition, offering patients emotional, informational and/or tangible support when accessing EHR/EMR data may increase the perceived and actual utility of an integrated PHR.[24]


Table 2: Barriers toward Adoption and Use of PHRs
Authors/Year Population Design Results Implications According to Authors
Tobacman et al. (1996) [17] n=100, patient users of a standalone PHR Telephone questionnaire to determine acceptance, usefulness, and impact of PHR •Patients failed to record medical information Patient use of a PHR may increased over time
Zickmund et al. (2007)[25] n=39, diabetic patient users of an integrated PHR from 4 primary care practices 10 focus groups conducted to determine impact of an electronic PHR on patient-physician relationship •Patients expressed privacy concerns with email feature
•Patients who expressed satisfaction with their physician were less likely to want PHR access
Educating patients about e-mail security and offering direct provider e-mail may encourage patient use
Brink et al. (2005)[26] n=36, cancer patient users of an electronic PHR and (n=36) general practitioners in the Netherlands Questionnaires completed on PHR use after 6 week period •Patients (25%) encountered technical difficulties while using the PHR
•General practitioners questioned PHR utility; the majority did not use the PHR
Integrated PHRs may increase patient and provider use
Keselman et al. (2007)[32] n=103, chronic disease patient users of both paper-based and electronic PHRs Survey to determine patient information needs and experiences with their health records •Lack of patient comprehension of medical terms/abbreviations, medical record information, and lab test results Patients need carefully designed PHRs and comprehensive patient data
Hassol et al. (2004)[33] n=1,421, patient users of an integrated PHR and (n=10) primary care physicians Online survey and focus groups with patients; one-on-one interviews with physicians •Patients reported problems with information accuracy and completeness in their medical records Patient and provider needs are best met when EHR data is accurate and complete
Kim et al. (2007)[34] n=46, Elderly and disabled patient users of an electronic PHR PHR database log analyzed to determine patient usage patterns •Patients did not fill certain fields in their PHRs with ’Immunizations’ being the least updated information category Analyzing system usage logs led to improvements of the studied PHR
Hess et al. (2007)[35] n=39, patient users of an integrated PHR Focus groups, patient’s reactions to an electronic PHR in diabetes self-management •Patients reported not knowing their username, password, and features included in access to PHR
•Patients reported inaccurate information and missing lab results
Patients may abandon PHRs if their expectations are not met
Lober et al. (2006)[37] n=38, elderly, disabled patient users of an integrated PHR Surveys distributed to measure patient barriers with an electronic PHR system •Patients experienced computer literacy issues and computer anxiety
•Cognitive impairments among participants affected their ability to maintain information in their PHRs
Patients could create and maintain PHRs with assistance from registered nurses
Wiljer et al. (2010)[38] n=250, cancer patient users of an integrated PHR in Canada Log files analyzed to assess the impact of access to an electronic PHR •Patients experienced technical difficulties and required technical support while using their PHRs PHR access requires technical and healthcare staff support
Pyper et al. (2004)[52] n=100, patient users of an integrated PHR in the United Kingdom Interviews conducted to evaluate first-time patient-users’ experience with an electronic PHR •Patients requested explanation of medical terms and tests/results
•Patients (70%) found errors in their medical records
Patients need time and assess to support staff when using their PHRs

Role of PHRs in self-management

Eleven papers examined patient use of electronic and paper-based PHRs in self-management (Table 3). PHR functions helping patients to better manage their health care allow them to enter, record, and track their own health information. Interactive features within EHR-linked PHRs have the potential to increase patient participation in illness management, improve patient-physician communication, and increase a patient’s sense of illness-ownership.[14][32][36] As it stands, there is currently a lack of concrete evidence that PHRs fulfilled the expectations set for them. While several studies have reported on improved clinical markers for patients with chronic conditions using integrated PHRs, few have demonstrated effects on clinical outcomes.[15][23] This may be due to the inherent complexity of conducting health IT research, the variability in characteristics and features of electronic PHRs from practice to practice, or the absence of agreement about the standard definition of a PHR.[34][40]

Patients with chronic conditions may have the most to gain from using integrated PHRs. Improvements in diabetes-related clinical markers have been reported in studies using PHRs that incorporated systematic, active interactions between patients and providers, including improved glycemic control and blood pressure.[15][41][42] Adult patients with type 2 diabetes using an integrated PHR were more optimistic about their chronic disease management and their relationship with their primary care physician.[42] Although patients appreciate viewing their medical records, some have a greater need to record daily personal health information in a PHR.[43] Providing patients with type 2 diabetes with the option to upload measurements such as blood glucose levels can enable physicians to make between-visit medication adjustments.[15] Physicians and patients from primary care practices in mainly urban settings regarded the integrated PHR as an essential component of care and a means to establish active patient involvement.[44]


Table 3: Role of PHRs in Self-Management
Authors/Year Population Design Results Implications According to Authors
Krist et al. (2012)[13] n=4,500, patient users of an interactive PHR (IPHR) from 8 primary care practices EMR and survey data were analyzed to determine IPHR effectiveness •Patients who used the IPHR increased uptake of preventative services PHRs with high functionality may improve patient outcome
Ralston et al. (2009)[15] n=83, type 2 diabetes patients using an integrated PHR Case study to evaluate the success of an initiative targeting patient access to care •Patients received care faster and easier
•Connecting with physicians made easier
•Patient glycated hemoglobin levels decreased
Diabetes patients benefit from care management features in PHRs
Tenforde et al. (2011)[23] n=21, published research articles on PHR adoption and attitudes, clinical outcomes, and existing PHRs Literature review of MEDLINE articles on PHRs (published between 2000-2010) •Affects PHR access on patient outcomes difficult to determine
•Study limitations included lack of patient blinding and generalizability
•Studies show inconsistent improvement in diabetes care with PHR access
Although evidence supporting PHRs, clinical value is limited; PHRs may empower patients in self-management
Winkelman et al. (2005)[24] =12, inflammatory bowel disease patient users of an EMR linked PHR in Canada Qualitative study using in-depth interviews and focus groups •Having the patient’s voice guide EMR structure promotes a sense of illness ownership
•A PHR that supports self-care is most useful for patients
A useful PHR is customizable, provides informational, emotional, and tangible support
Brink et al. (2005)[26] n=36, cancer patient users of an electronic PHR and (n=36) general practitioners in the Netherlands Questionnaires completed on PHR use after 6 week period •PHR detected patient problems undiscovered during regular visits
•General practitioners (61%) expected health IT to play an important role in oncology care
An elderly, relatively computer illiterate patient group could use and appreciate the value of a PHR
Keselman et al. (2007)[32] n=103, chronic disease patient users of both paper-based and electronic PHRs Survey to determine patient needs and experiences with their health records for optimizing PHR design •Desire for health self=management prompted patient interest in PHRs
•Viewing PHRs resulted in patient engagement in care-related decisions and actions
Optimization of PHR functionality will enable patient participation in health care
Kim et al. (2007)[34] n=46, Elderly and disabled patient users of an electronic PHR PHR database log analyzed to determine patient usage patterns •Patients (96%-100%) updated their medications and recorded past and present health problems
•Free-text field was used to record questions, note, and reminders
Interactive features in integrated PHRs are important and useful for patients
Cimino et al. (2002)[36] n=13, patient and physician users of an integrated PHR PHR log file, online questionnaire, and telephone interview data analyzed •Improved interactions with health care providers
•Patients reported taking a more active role in their healthcare
Access to PHRs enhanced patients’ understanding of their conditions and improved communication with their physicians
Grant et al. (2005)[41] n=244, diabetes patient users of an integrated, diabetes-specific PHR Randomized control trial among 11 primary care practices •Patients who used the PHR were most likely to modify their medication regimens Integrated PHRs may facilitate medication initiation and dosage adjustment, leading to improved clinical outcomes
Holbrook et al. (2009)[42] n=511, type 2 diabetes patients using an integrated PHR in Canada Questionnaires to evaluate PHR use •Patient optimism increased in the intervention group compared to control
•Patients in the intervention group were satisfied or more satisfied about their diabetes care after using the PHR
PHRs may contribute to improvements in blood pressure and glycated hemoglobin levels
Ventres et al. (2006)[44] Unknown, patients and physicians using an electronic PHR An ethnographic study including participant observation, interviews, and taped encounters, to identify factors influencing physician and patient use •PHR use enhanced patient-physician communication
•Patient concerns were influenced by their level of comfort with computers
•Physicians expressed frustration about the time needed to learn how to use the PHR
The effects of introducing PHRs into clinical practice may not be universally positive; consideration of factors influencing how PHRs are viewed and used in medical practice is advised

Discussion

Patients embrace the idea of PHRs, but adoption has been slow as patients lack the knowledge and training required to fully engage with integrated PHRs, and remain unaware of useful features.[16][35][45] Patients’ understanding of integrative PHRs’ value and relevance to care may increase patient adoption; therefore, practices may need to offer a wide range of materials and processes to inform patients.[13] Overall, patients prefer integrated PHRs due to privacy concerns and their desire to be connected to their doctors.[9][18][46] Patients report an interest in communicating with their providers and are less interested in adding health-related data.[18][46] Specific features of integrated PHRs, such as the ability to look up test results and email physicians, appeal to patients, yet patients are deterred when confronted with unfamiliar medical terms and the need to memorize user names and passwords, or are lacking in health and computer literacy. PHRs will likely be more successful and effective when practices provide guidance to health care professionals in health record management and when patients receive both educational and technical support when accessing PHRs.[29][45] When used effectively, PHRs can engage patients in their health care, resulting in increased illness ownership and positive health outcomes. However, conclusive evidence of the clinical value of using PHRs is needed as studies have yet to demonstrate the effects of PHR adoption on clinical outcomes.[18]

The ideal PHR actively engages patients in sharing and exchanging health information with their clinicians by offering a full spectrum of high functioning health IT capabilities to improve patient care and outcomes beyond the traditional clinical encounter. However, a consensus on what information to include in an integrated PHR has yet to be reached.[18] Some integrated PHR systems offer such functionality, but do not provide patients with all possible capabilities.[47] Future integrated PHRs will likely offer secure patient-physician messaging, incorporate decision-support systems, evaluate patents’ needs using evidence-based guidelines, and contain applications that offer behavioral feedback and the capabilities for individualized recommendations.[18][35][42][47][48] Furthermore, the adoption of national standards for integrated PHRs will be necessary to ensure the integrity and long-term sustainability of PHRs.[49] The Certification Commission for Health IT has recommended certification for specific PHR features, including privacy, security, interoperability, and functionality.[50]

Multiple studies have examined patient attitudes towards PHRs and usage among special populations. Specific patient populations, such as those with chronic or multiple illnesses, may benefit directly from integrated PHRs, which could motivate continued use.[18] However, current evidence demonstrating the benefits of PHRs in chronic disease management is lacking. The existing evidence showing that PHRs have value is restricted to diabetes management.[15][35][41][42] Patients in developed countries with diabetes tend to utilize PHRs more than healthy patients.[15][35][41][42][46]

Studies examining the effects of age, race, ethnicity, and sex on patient attitudes and usage have been inconclusive, demonstrating effects of these variables in some comparisons but not others.[9][18][34][37][46] Factors such diagnosis, age, gender, and country of origin may account for the reported variation. Patient motivations for using a PHR are tied to and highly influenced by the patient-physician relationship, physician attitudes toward PHRs[16][18][25][46], and the desire for illness ownership[16] and control over the dissemination of medical information.[25][28][30][31] Patients are likely to adopt, use, and value an integrated PHR that is user-friendly[26][28][34], provides a high level of privacy and security[25][30], and offers advanced features such as messaging, editing, and medication renewal capabilities.[33][34][35] Patient adoption and use will increase as health IT developers integrate patient feedback in the development process.

This review includes several limitations. First, the majority of studies included in this review were authored in the United States. However, 13 of the 52 papers selected were authored outside the United States, including five from Canada[18][24][38][40][42], four from the United Kingdom[14][27][28][51], and the remaining from Spain[11], Serbia[12], Germany[7], and the Netherlands.[26] Second, biases in the literature include small sample size[15][41], non-random, self-selected samples[25][30][32], and limited ethnic, racial, and socioeconomic diversity.[13][15][28][33][41][51] Only one paper included non-English speaking participants.[44] Finally, although we have discussed many of the important findings and themes in the literature, it was not possible to detail every factor affecting PHR evolution and adoption, patient user attitudes toward PHRs, patient reported barriers to use, and the role of PHRs in self-management.

Conclusion

Integrated PHRs have the potential to improve the patient-provider relationship, enable shared decision-making, and allow the healthcare system to move toward a more personalized healthcare delivery system. Integrated PHRs will have a broader impact on public health as they evolve higher levels of functionality and as physicians increase PHR adoption.[13] Since 2012, the federal government has given over $5 billion to providers and hospitals for the adoption and meaningful use of qualifying PHRs.[46] Beginning in 2014, providers and hospital are required to make PHRs available to 50% of patients and achieve an adoption rate of 10%.[46] Incentivizing providers and hospitals to adopt and become meaningful users of EHRs will provide more patients with the opportunity to use PHRs. However, the available evidence demonstrating that PHRs can support their intended use is insufficient as the existing literature on PHRs is limited and inconclusive.[9][18] Further patient- and physician-focused research on factors affecting PHR adoption and frequency of use is needed to improve PHR functionality, inform health IT development, and determine what motivates patients to not only adopt but to continue using PHRs.

Conflicts of interest

No potential conflict of interest to report.

References

  1. US Department of Health and Human Services (June 2008). "The ONC-Coordinated Federal Health Information Technology Strategic Plan: 2008U2012" (PDF). https://www.healthit.gov/sites/default/files/hit-strategic-plan-summary-508-2.pdf. 
  2. US Department of Health and Human Services (February 2006). "Personal Health Records and Personal Health Record Systems: A Report and Recommendation from the National Committee on Vital and Health Statistics" (PDF). http://www.ncvhs.hhs.gov/wp-content/uploads/2014/05/0602nhiirpt.pdf. 
  3. 3.0 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 Detmer, D.; Bloomrosen, M.; Raymond, B.; Tang, P. (2008). "Integrated personal health records: transformative tools for consumer-centric care". BioMed Central Medical Informatics and Decision Making 8: 45. doi:10.1186/1472-6947-8-45. PMC PMC2596104. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2596104. 
  4. 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 Tang, P.C.; Ash, J.S.; Bates, D.W.; Overhage, J.M.; Sands, D.Z. (2006). "Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption". Journal of the American Medical Informatics Association 13 (2): 121-126. doi:10.1197/jamia.M2025. PMC PMC1447551. PMID 16357345. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1447551. 
  5. 5.0 5.1 Gearon, C. (June 2007). "Perspectives on the future of personal health records" (PDF). California HealthCare Foundation. http://www.chcf.org/~/media/MEDIA%20LIBRARY%20Files/PDF/P/PDF%20PHRPerspectives.pdf. 
  6. 6.0 6.1 Kaelber, D.; Pan, E.C. (2008). "The value of personal health records (PHR) systems". American Medical Informatics Association Annual Symposium Proceedings 2008: 343–347. PMC PMC2655982. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2655982. 
  7. 7.0 7.1 Sunyaev, A.; Kaletsch, A.; Krcmar, H. (January 2010). "Comparative evaluation of Google Health API vs. Microsoft Healthvault API" (PDF). Proceedings of the Third International Conference on Health Informatics 2010: 195–201. Archived from the original on 11 May 2013. https://web.archive.org/web/20130511163734/http://www.alexander-kaletsch.de/downloads/api.pdf. 
  8. Markle Foundation (1 July 2003). "Connecting for Health: A Public-Private Collaborative" (PDF). p. 14. http://www.policyarchive.org/handle/10207/bitstreams/15473.pdf. 
  9. 9.0 9.1 9.2 9.3 Kaelber, D.C.; Jha, A.K.; Johnston, D.; Middleton, B.; Bates, D.W. (2008). "A research agenda for personal health records (PHRs)". Journal of the American Medical Informatics Association 15 (6): 729-736. doi:10.1197/jamia.M2547. PMC PMC2585530. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2585530. 
  10. 10.0 10.1 Harris Interactive (22 September 2006). "Few patients use or have access to online services for communicating with their doctors, but most would like to". The Wall Street Journal Online 5 (16): 1–7. http://www.prnewswire.com/news-releases/few-patients-use-or-have-access-to-online-services-for-communicating-with-their-doctors-but-most-would-like-to-57121547.html. 
  11. 11.0 11.1 11.2 11.3 Carrión, I.; Fernández-Alemán, J.L.; Jayne, C.; Palmer-Brown, D.; Toval, A.; Carrillo-de-Gea, J.M. (January 2012). "Evaluation and neuronal network-based classification of the PHRs privacy policies". Proceedings of the 45th Hawaii International Conference on System Sciences 2012: 2840-2849. doi:10.1109/HICSS.2012.257. 
  12. 12.0 12.1 Stakic, S.B.; Teodosijevic, N. (August 2010). "Agreement based distribution of responsibilities in national electronic health record systems". Proceedings of the IEEE International Conference on Social Computing / IEEE International Conference on Privacy, Security, Risk and Trust 2010: 607-614. doi:10.1109/SocialCom.2010.95. 
  13. 13.0 13.1 13.2 13.3 13.4 13.5 13.6 13.7 Krist, A.H.; Woolf, S.H.; Rothemich, S.F.; Johnson, R.E.; Peele, J.E.; Cunningham, T.D.; Longo, D.R.; Bello, G.A.; Matzke, G.R. (2012). "Interactive preventive health record to enhance delivery of recommended care: a randomized trial". Annals of Family Medicine 10 (4): 312-9. doi:10.1370/afm.1383. PMC PMC3392290. PMID 22778119. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3392290. 
  14. 14.0 14.1 14.2 Pagliari, C.; Detmer, D.; Singleton, P. (2007). "Potential of electronic personal health records". British Medical Journal 335 (7615): 330-333. doi:10.1136/bmj.39279.482963.AD. PMC PMC1949437. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1949437. 
  15. 15.0 15.1 15.2 15.3 15.4 15.5 15.6 15.7 15.8 15.9 Ralston, J.D.; Hirsch, I.B.; Hoath, J.; Mullen, M.; Cheadle, A.; Goldberg, H.I. (2009). "Web-based collaborative care for type 2 diabetes: a pilot randomized trial". Diabetes Care 32 (2): 234-9. doi:10.2337/dc08-1220. PMC PMC2628685. PMID 19017773. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2628685. 
  16. 16.0 16.1 16.2 16.3 16.4 Witry, M.J.; Doucette, W.R.; Daly, J.M.; Levy, B.T.; Chrischilles, E.A. (2010). "Family physician perceptions of personal health records". Perspectives in Health Information Management 7 (Winter): 1d. PMC PMC2805556. PMID 20697465. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2805556. 
  17. 17.0 17.1 17.2 17.3 Tobacman, J.; Nolan, P. (1996). "Utilization of a personal health record in a general medicine clinic". Journal of General Internal Medicine 11 (6): 370-372. PMID 8803745. 
  18. 18.00 18.01 18.02 18.03 18.04 18.05 18.06 18.07 18.08 18.09 18.10 Archer, N.; Fevrier-Thomas, U.; Lokker, C.; McKibbon, K.A.; Straus, S.E. (2011). "Personal health records: a scoping review". Journal of the American Medical Informatics Association 18 (4): 515-522. doi:10.1136/amiajnl-2011-000105. PMC PMC3128401. PMID 21672914. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3128401. 
  19. Taylor, H. (2004). "Two in five adults keep personal or family health records and almost everybody thinks this is a good idea: electronic health records likely to grow rapidly". Health Care News 4 (13). http://www.prnewswire.com/news-releases/two-in-five-adults-keep-personal-or-family-health-records-and-almost-everybody-thinks-this-is-a-good-idea-71581677.html. 
  20. Hsiao, C-J.; Hing, E.; Socey, T.C.; Cai, B. (December 2010). "Electronic medical record/electronic health record systems of office-based physicians: United States, 2009 and preliminary 2010 state estimates" (PDF). National Center for Health Statistics. http://www.cdc.gov/nchs/data/hestat/emr_ehr_09/emr_ehr_09.pdf. 
  21. Undem, T. (April 2010). "Consumers and health information technology: a national survey" (PDF). California HealthCare Foundation. pp. 40. http://www.chcf.org/~/media/MEDIA%20LIBRARY%20Files/PDF/C/PDF%20ConsumersHealthInfoTechnologyNationalSurvey.pdf. 
  22. Markle Foundation (June 2008). "Americans overwhelmingly believe electronic personal health records could improve their health" (PDF). pp. 7. http://www.markle.org/sites/default/files/ResearchBrief-200806.pdf. 
  23. 23.0 23.1 23.2 Tenforde, M.; Jain, A.; Hickner, J. (2011). "The value of personal health records for chronic disease management: what do we know?". Family Medicine 43 (5): 351-354. PMID 21557106. 
  24. 24.0 24.1 24.2 24.3 24.4 24.5 24.6 24.7 Winkelman, W.; Leonard, K.; Rossos, P. (2005). "Patient-perceived usefulness of online electronic medical records: employing grounded theory in the development of information and communication technologies for use by patients living with chronic illness". Journal of the American Medical Informatics Association 12 (3): 306-314. PMC PMC1090462. PMID 15684128. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1090462. 
  25. 25.0 25.1 25.2 25.3 25.4 25.5 25.6 25.7 25.8 Zickmund, S.; Hess, R.; Bryce, C.; McTigue, K.; Olshansky, E.; Fitzgerald, K.; Fischer, G. (2007). "Interest in the use of computerized patient portals: role of the provider-patient relationship". Journal of General Internal Medicine 23 (S1): 20-26. doi:10.1007/s11606-007-0273-6. PMC PMC2338160. PMID 18095039. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2338160. 
  26. 26.0 26.1 26.2 26.3 26.4 26.5 26.6 26.7 26.8 26.9 Brink, J.; Moorman, P.; Boer, M.; Pruyn, J.; Verwoerd, C.; Bemmel, J. (2005). "Involving the patient: a prospective study on use, appreciation and effectiveness of an information system in head and neck cancer care". International Journal of Medical Informatics 74 (10): 839-849. doi:10.1016/j.ijmedinf.2005.03.021. PMID 16043392. 
  27. 27.0 27.1 27.2 27.3 27.4 Jones, R.; McConville, J.; Mason, D.; Macpherson, L.; Navin, L.; McEwen, J. (1999). "Attitudes towards, and utility of, an integrated medical-dental patient-held record in primary care". British Journal of General Practice 49 (442): 368-73. PMC PMC1313422. PMID 10736887. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1313422. 
  28. 28.0 28.1 28.2 28.3 28.4 28.5 28.6 28.7 Pyper, C.; Amery, J.; Watson, M.; Crook, C. (2004). "Patients’ experiences when accessing their online electronic patient records in primary care". British Journal of General Practice 54 (498): 38-43. PMC PMC1314776. PMID 14965405. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1314776. 
  29. 29.0 29.1 29.2 29.3 Zayas-Caban, T.; Valdez, R. (2007). "Do patients understand how PHRs work?". American Medical Informatics Association Annual Symposium Proceedings 11: 1169. PMID 18694265. 
  30. 30.0 30.1 30.2 30.3 30.4 Cox, B.; Thornewill, J. (2008). "The consumer’s view of the electronic health record: engaging patients in EHR adoption". Journal of Healthcare Information Management 22 (2): 43-7. PMID 19266994. 
  31. 31.0 31.1 Bright, B. (29 November 2007). "Benefits of electronic health records seen as outweighing privacy risks". The Wall Street Journal. http://www.wsj.com/articles/SB119565244262500549. 
  32. 32.0 32.1 32.2 32.3 32.4 32.5 32.6 32.7 32.8 Keselman, A.; Slaughter, L.; Smith, C.A.; Kim, H.; Divita, G.; Brown, A.; Tsai, C.; Zeng-Treitler, Q. (2007). "Towards consumer-friendly PHRs: patients’ experience with reviewing their health records". American Medical Informatics Association Annual Symposium Proceedings 2007: 399-403. PMC PMC2655877. PMID 18693866. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2655877. 
  33. 33.0 33.1 33.2 33.3 33.4 33.5 33.6 Hassol, A.; Walker, J.; Kidder, D.; Rokita, K.; Young, D.; Pierdon, S.; Deitz, D.; Kuck, S.; Ortiz, E. (2004). "Patient experiences and attitudes about access to a patient electronic health care record and linked web messaging". Journal of the American Medical Informatics Association 11 (6): 505–13. PMC PMC524631. PMID 15299001. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC524631. 
  34. 34.0 34.1 34.2 34.3 34.4 34.5 34.6 34.7 34.8 34.9 Kim, E.; Stolyar, A.; Lober, W.; Herbaugh, A.; Shinstrom, S.; Zierler, B.; Soh, C.; Kim, Y. (2007). "Usage patterns of a personal health record by elderly and disabled users". American Medical Informatics Association Annual Symposium Proceedings 2007: 409-13. PMC PMC2655817. PMID 18693868. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2655817. 
  35. 35.0 35.1 35.2 35.3 35.4 35.5 35.6 35.7 35.8 35.9 Hess, R.; Bryce, C.; Paone, S.; Fischer, G.; McTigue, K.; Olshansky, E.; Zickmund, S.; Fitzgerald, K.; Siminerio, L. (2007). "Exploring challenges and potentials of personal health records in diabetes self-management: implementation and initial assessment". Telemedicine and e-Health 13 (5): 509-17. doi:10.1089/tmj.2006.0089. PMID 17999613. 
  36. 36.0 36.1 36.2 36.3 Cimino, J.J.; Patel, V.L.; Kushniruk, A.W. (2002). "The patient clinical information system (PatCIS): technical solutions for and experience with giving patients access to their electronic medical records". International Journal of Medical Informatics 68 (1-3): 113-27. doi:10.1016/S1386-5056(02)00070-9. PMID 12467796. 
  37. 37.0 37.1 37.2 37.3 37.4 Lober, W.; Zierler, B.; Herbaugh, A.; Stolyer, A.; Kim, E.H.; Kim, Y. (2006). "Barriers to the use of a personal health record by an elderly population". American Medical Informatics Association Annual Symposium Proceedings 2006: 514-518. PMC PMC1839577. PMID 17238394. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1839577. 
  38. 38.0 38.1 38.2 38.3 Wiljer, D.; Urowitz, S.; Apatu, E.; Leonard, D.; Quartey, N.K.; Catton, P. (2010). "Understanding the support needs of patients accessing test results online". Journal of Healthcare Information Management 24 (1): 57-63. PMID 20077927. 
  39. Zeng-Treitler, Q.; Goryachev, S.; Hyeoneui, K.; Keselman, A.; Rosendale, D. (2007). "Making texts in electronic health records comprehensible to consumers: a prototype translator". American Medical Informatics Association Annual Symposium Proceedings 2007: 846-50. PMC PMC2655860. PMID 18693956. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2655860. 
  40. 40.0 40.1 Shcherbatykh, I.; Holbrook, A.; Thabane, L.; Dolovich, L. (2008). "Methodologic issues in health informatics trials: the complexities of complex interventions". Journal of the American Medical Informatics Association 15 (5): 575-80. doi:10.1197/jamia.M2518. PMC PMC2528041. PMID 18579839. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2528041. 
  41. 41.0 41.1 41.2 41.3 41.4 41.5 Grant, R.W.; Wald, J.S.; Schnipper, J.L.; Gandhi, T.K.; Poon, E.G.; Orav, E.J.; William, D.H.; Volk, L.A.; Middleton, B. (2008). "Practice-linked online personal health records for type 2 diabetes mellitus: a randomized controlled trial". Archives of Internal Medicine 168 (16): 1776-1782. doi:10.1001/archinte.168.16.1776. PMC PMC3829635. PMID 18779465. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3829635. 
  42. 42.0 42.1 42.2 42.3 42.4 42.5 42.6 Holbrook, A.; Thabane, L.; Keshavjee, K.; Dolovich, L.; Bernstein, B.; Chan, D.; Troyan, S.; Foster, G.; Gerstein, H. (2009). "Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial". Canadian Medical Association Journal 181 (1–2): 37-44. doi:10.1503/cmaj.081272. PMC PMC2704409. PMID 19581618. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2704409. 
  43. Brennan, P.F.; Downs, S.; Casper, G. (2010). "Project HealthDesign: rethinking the power and potential of personal health records". Journal of Biomedical Informatics 43 (5): S3–5. doi:10.1016/j.jbi.2010.09.001. PMID 20937482. 
  44. 44.0 44.1 44.2 Ventres, W.; Kooienga, S.; Vuckovic, N.; Marlin, R.; Nygren, P.; Stewart, V. (2006). "Physicians, patients, and the electronic health record: an ethnographic analysis". Annals of Family Medicine 4 (2): 124-131. doi:10.1370/afm.425. PMC PMC1467009. PMID 16569715. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1467009. 
  45. 45.0 45.1 Weitzman, E.R.; Kaci, L.; Mandl, K.D. (2009). "Acceptability of a personally controlled health record in a community-based setting: implications for policy and design". Journal of Medical Internet Research 11 (2): e14. doi:10.2196/jmir.1187. PMC PMC2762802. PMID 19403467. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2762802. 
  46. 46.0 46.1 46.2 46.3 46.4 46.5 46.6 Kannry, J.; Beuria, P.; Wang, E.; Nissim, J. (2012). "Personal health records: meaningful use, but for whom?". Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine 79 (5): 593-602. doi:10.1002/msj.21334. PMID 22976365. 
  47. 47.0 47.1 Krist, A.H.; Woolf, S.H. (2011). "A vision for patient-centered health information systems". The Journal of the American Medical Association 305 (3): 300-301. doi:10.1001/jama.2010.2011. PMID 21245186. 
  48. Gibbons, M.C.; Wilson, R.F.; Samal, L.; Lehmann, C.U.; Dickersin, K.; Lehmann, H.P.; Aboumatar, H.; Finkelstein, J.; Shelton, E.; Sharma, R.; Bass, E.B. (October 2009). "Impact of Consumer Health Informatics Applications" (PDF). U.S. Department of Health and Human Services. pp. 546. http://www.ahrq.gov/research/findings/evidence-based-reports/chiapp-evidence-report.pdf. 
  49. Kim, J.; Jung, H.; Bates, D.W. (2011). "History and trends of "personal health record" research in pubmed". Healthcare Informatics Research 17 (1): 3-17. doi:10.4258/hir.2011.17.1.3. PMC PMC3092992. PMID 21818452. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3092992. 
  50. Certification Commission for Healthcare Information Technology (15 July 2008). "Recommendations of the PHR advisory task force: certification of PHRs" (PDF). https://hitanalyst.files.wordpress.com/2008/07/cchitphratf.pdf. 
  51. 51.0 51.1 Pyper, C.; Amery, J.; Watson, M.; Crook, C. (2004). "Access to electronic health records in primary care - a survey of patients' views". Medical Science Monitor 10 (11): 17–22. PMID 15507869. 

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. Table 1–3 have been placed slightly differently. Some references didn't include links to PDF files or were missing issue numbers. Additionally, all journal references did not list DOIs and PubMed IDs; these have been added to the references to make them more useful. The authors also included reference item 40 (Kupchunas W. Personal health record new opportunity for patient education. Orthopaedic Nursing. 2006;26(3):185-191.) in their references but never used it as a citation in the text. As such, it has been omitted.

Finally, in the PDF a couple of references were placed out of order by appearance, particularly references nine and ten in the introduction. Additionally, reference 40 is unused and removed. Because the wiki automatically assigns reference numbers based on order of appearance, the reference numbers here ultimately do not match up with those in the original paper. This was unavoidable.