Journal:The current state of knowledge on imaging informatics: A survey among Spanish radiologists

From LIMSWiki
Revision as of 21:26, 8 March 2022 by Shawndouglas (talk | contribs) (Saving and adding more.)
Jump to navigationJump to search
Full article title The current state of knowledge on imaging informatics: A survey among Spanish radiologists
Journal Insights into Imaging
Author(s) Eiroa, Daniel; Antolín, Andreu; Ascanio, Mónica F.d.C.; Ortiz, Violeta P.; Escobar, Manuel; Roson, Nuria
Author affiliation(s) Hospital Universitario Valle de Hebrón, Hospital Universitario Nuestra Señora de Candelaria
Primary contact Email: danieldomingo dot eiroa dot idi at gencat dot cat
Year published 2022
Volume and issue 13
Page(s) 34
DOI 10.1186/s13244-022-01164-0
ISSN 1869-4101
Distribution license Creative Commons Attribution 4.0 International
Website https://insightsimaging.springeropen.com/articles/10.1186/s13244-022-01164-0
Download https://insightsimaging.springeropen.com/track/pdf/10.1186/s13244-022-01164-0.pdf (PDF)

Abstract

Background: There is growing concern about the impact of artificial intelligence (AI) on radiology and the future of the profession. The aim of this study is to evaluate general knowledge and concerns about trends on imaging informatics among radiologists working in Spain (residents and attending physicians). For this purpose, an online survey among radiologists working in Spain was conducted with questions related to knowledge about terminology and technologies, need for a regulated academic training on AI, and concerns about the implications of the use of these technologies.

Results: A total of 223 radiologists answered the survey, of whom 76.7% were attending physicians and 23.3% residents. General terms such as "AI" and "algorithm" had been heard of or read in at least 75.8% and 57.4% of the cases, respectively, while more specific terms were scarcely known. All the respondents considered that they should pursue academic training in medical informatics and new technologies, and 92.9% of them reckoned this preparation should be incorporated in the training program of the specialty. Patient safety was found to be the main concern for 54.2% of the respondents. Job loss was not seen as a peril by 45.7% of the participants.

Conclusions: Although there is a lack of knowledge about AI among Spanish radiologists, there is a will to explore such topics and a general belief that radiologists should be trained in these matters. Based on the results, a consensus is needed to change the current training curriculum to better prepare future radiologists.

Key points: Spanish radiologists desire to delve deeper into imaging informatics. Patient safety and adaptation to new technologies are the main concerns. A change on radiology education is needed to include artificial intelligence.

Keywords: artificial intelligence, medical informatics, medical education, surveys and questionnaires, radiology

Introduction

There is no doubt that the upsurge of machine learning (ML) and deep learning (DL) algorithms, paired with the high amount of digital data generated in radiology, is changing this medical specialty. ML is already used in different imaging modalities such as CAD (computer-aided design) systems for breast cancer screening on mammography [1] or nodule detection on thoracic CT or radiography. [2] DL algorithms, in particular convolutional networks, are a promising technique for processing medical imaging data not only in tasks like image classification, object detection, segmentation, or registration [3], but also on dose optimization, creation and maintenance of biobanks, and structured reporting among others. [4]

More than 50,000 articles are returned when the search “Radiology” AND “Artificial Intelligence” OR “Deep Learning” OR “Machine Learning” is performed in the PubMed medical research engine, with a “quasi-exponential” slope for the last 10 years. Such is the concern that both the European Society of Radiology (ESR) and the Radiological Society of North America (RSNA) have their own specialized internet portals dedicated to artificial intelligence (AI) [5, 6], and the latter has even published a peer-reviewed journal fully dedicated to it. [7]

For this reason, there is growing concern among radiologists about the future of the profession. Some believe that radiologists will become obsolete in a few years, and others, such as the aforementioned societies [4, 8], have a more conservative stance in which AI will enhance the role of the radiologist and turn the job from volume-based to value-based. [9] Regardless of particular opinions, the irruption of AI in the radiological field, as well as its progressive integration into clinical practice, will bring a radical change in radiology as we currently know it.

The aim of this study is to evaluate general knowledge and concerns about trends on imaging informatics among radiologists currently working in Spain (both residents and attending physicians). All those respondents who had completed residency at the time of the survey are referred to as "attending physicians" throughout the text.

Methods

An online survey using Google Forms was designed by the authors, composed of 20 questions related to the level of knowledge about trending terminology and technologies according to the most recent and relevant literature [4, 8, 10], the need for a regulated academic training, and concerns about the implications of the widespread use of these technologies in the clinical setting, both ethics- and workforce-related. A summary of the survey is displayed in Table 1.

Table 1. Questions about the state of knowledge on imaging informatics and concerns, translated to English; AP = attending physician.
Demographic information
Region of the country 17 options
Gender Male
Female
I'd rather not say
Are you a resident or attending physician (AP)? Resident physician
Attending physician
Only for residents Only for AP
Which year of your residency are you currently in? R1 What is your work setting? Only public health care
R2 Only private health care
R3 Both, mainly public health care
R4 Both, mainly private health care
Other (explain)
Upon finishing your residency, in which setting do you wish to practice your specialty? I haven't decided yet Without taking your residency into consideration, how many years of professional experience do you currently have? 0–5
Both, mainly in public health care 6–10
Only public health care 11–20
Only private health care 21–30
Both, mainly in private health care > 30
Other (explain)
Technologies and terminology
Choose your level of familiarity with the following terms from the provided options:
Term Possible answers
Artificial intelligence I do not know this term
I have heard or read about this term
I have used it professionally on occasion
I usually use it professionally
Algorithm
Backpropogation
Blackbox
Convolutional neural network
Machine learning
Python (programming language)
R (programming language)
Pandas (Python library)
PyTorch
TensorFlow
Academic training
Do you consider practicing radiology to be routine work? Yes
No
Other (explain)
Do you consider you should pursue academic training in IT and new technologies (artificial intelligence, machine learning, programming, etc.)? Yes
No
Do you consider said skills and competencies should be included in the specialty's academic program? Yes
No
Other (explain)
Do you consider there is enough time in four years of academic training to include said skills and competencies? Yes
No
Who do you consider should cover the economic cost of this academic training? Yourself
The organization which you work for
Pharmaceutical companies
Professional societies
Technological companies
Other (explain)
In the hypothetical case of massive adoption of AI in the field of radiology, how much do the following worry you?
Questions Possible answers
Lack of work 1. Not concerned at all
Increase in workload 2. Not very concerned
Patient safety 3. Indifferent
Reduced remuneration per report 4. Concerned
Adapting to new technologies 5. Very concerned
Journals and Congresses/Meetings
How many articles on the matter discussed in this survey have you read in the past year? None
1–3
4–6
7–10
11–15
> 15
How many presentations at Congresses on the matter discussed in this survey have you attended? None
1–3
4–6
7–10
11–15
> 15

A link to the survey was distributed among radiologists working in Spain, who were asked to share and publicize it, as widely as possible, among colleagues throughout the country after requesting their permission. It was also shared by some of the regional subsidiaries of the Sociedad Española de Radiología Médica (SERAM). It remained open for 62 days, between July 30 and September 30, 2019. Radiologists not working in Spain were excluded.

Responses were stored in a spreadsheet (Google Forms) that was later transformed into a comma-separated value file that was loaded into a Jupyter Notebook using the Python (v 3.4) pandas (v 1.1.4) library for data exploration and statistical analysis. To facilitate analysis and drawing of conclusions, the answers in the Concerns section were grouped into three categories: not concerned (options 1 and 2), indifferent (option 3), and concerned (options 4 and 5). In the instances where group comparison was made between attending physicians and residents, the Chi-square was used (scikit-learn v 0.24.0). Yates’ correction for continuity was applied where necessary. Statistical significance was accepted at p < 0.05.

Confidence intervals are not provided since the survey was purely descriptive. The results are expressed in percentages of the total answers throughout the manuscript.

Results

In the span of two months, a total of 223 radiologists answered the survey, of whom 171 (76.7%) were attending physicians and 52 (23.3%) resident physicians. When comparing to the current distribution of members in SERAM (836 residents and 5139 nonresidents) [11], we found that we had a greater proportion of residents than expected (p < 0.05).

Regarding attending radiologists, 50.9% worked exclusively in the public setting, while 5.8% worked only in the private sector and 38.6% combines public and private dedication. The same proportion (39.2%) had either fewer than 10 years or more than 20 years of working experience.

As per the residents, 44.2% were in their second year of specialty. Upon finishing, 63.5% desire to work in the public setting, mostly with some private dedication (55.8%). 32.7% had not yet decided on their preferred work setting. A summary of the results is shown in Table 2.

Table 2. Summary of results; AP = attending physician.
Demographic information
Gender
Female 118/223 (52.9%)
Male 103/223 (46.2%)
Rather not say 2/223 (0.9%)
Professional level
Attending physician 171/223 (76.7%)
Resident physician 52/223 (23.3%)
Resident section—52 respondents AP section—171 respondents
Year of residency Work setting
R1 9/52 (17.3%) Both, mainly public 66/171 (38.6%)
R2 23/52 (44.2%) Both, mainly private 8/171 (4.7%)
R3 11/52 (21.2%) Only public 87/171 (50.9%)
R4 9/52 (17.3%) Only private 10/171 (5.8%)
Desired work setting upon residency completion Experience as AP (in years)
Not decided 17/52 (32.7%) 0–5 32/171 (18.7%)
Both, mainly public 29/52 (55.8%) 6–10 35/171 (20.5%)
Both, mainly private 2/52 (3.8%) 11–20 37/171 (21.6%)
Only public 4/52 (7.7%) 21–30 49/171 (28.7%)
Only private 0/52 (0%) > 30 18/171 (10.5%)
Technologies and terminology
I do not know this term I have heard or read about this term I have used it professionally on occasion I usually use it professionally
Artificial intelligence 2/223 (0.9%) 169/223 (75.8%) 41/223 (18.4%) 11/223 (4.9%)
Algorithm 17/223 (7.6%) 128/223 (57.4%) 46/223 (20.6%) 32/223 (14.3%)
Backpropagation 171/223 (76.7%) 45/223 (20.2%) 6/223 (2.7%) 1/223 (0.4%)
Blackbox 145/223 (65.0%) 73/223 (32.7%) 1/223 (0.4%) 4/223 (1.8%)
Convolutional neural network 80/223 (35.9%) 131/223 (58.7%) 10/223 (4.5%) 2/223 (0.9%)
Machine learning 26/223 (11.7%) 167/223 (74.9%) 23/223 (10.3%) 7/223 (3.1%)
Python 160/223 (71.7%) 56/223 (25.1%) 5/223 (2.2%) 2/223 (0.9%)
R 181/223 (81.2%) 34/223 (15.2%) 6/223 (2.7%) 2/223 (0.9%)
Pandas 200/223 (89.7%) 18/223 (8.1%) 3/223 (1.3%) 2/223 (0.9%)
PyTorch 215/223 (96.4%) 6/223 (2.7%) 1/223 (0.4%) 1/223 (0.4%)
TensorFlow 181/223 (81.2%) 37/223 (16.6%) 2/223 (0.9%) 3/223 (1.3%)
Academic training
Do you consider practicing radiology to be routine work?
Yes 82/223 (36.8%)
No 123/223 (55.2%)
Other 18/223 (8%)
Do you consider you should pursue academic training in IT and new technologies (artificial intelligence, machine learning, programming, etc.)?
Yes 223/223 (100%)
No 0/223 (0%)
Do you consider said skills and competencies should be included in the specialty's academic program?
Yes 207/223 (92.9%)
No 2/223 (2.2%)
Other 11/223 (4.9%)
Do you consider there is enough time in four years of academic training to include said skills and competencies?
Yes 53/223 (23.8%)
No 170/223 (76.2%)
Who do you consider should cover the economic cost of this academic training? (multiple answer)
Yourself 23/223 (10.3%)
The organization which you work for 188/223 (84.3%)
Pharmaceutical companies 21/223 (9.4%)
Professional societies 95/223 (42.6%)
Technological companies 74/223 (33.2%)
Other (explain) 23/223 (10.3%)
Self-education
None 1–3 4–6 7–10 11–15 > 15
Lectures attended last year 91/223 (40.8%) 93/223 (41.7%) 29/223 (13.0%) 4/223 (1.8%) 2/223 (0.9%) 4/223 (1.8%)
Articles read last year 58/223 (26.0%) 111/223 (49.8%) 30/223 (13.5%) 15/223 (6.7%) 2/223 (0.9%) 7/223 (3.1%)
Concerns
Not concerned Indifferent Concerned
Lack of jobs 102/223 (45.7%) 65/223 (29.2%) 56/223 (25.1%)
Workload increase 90/223 (40.4%) 65/223 (29.1%) 68/223 (30.5%)
Reduced per-report remuneration 47/223 (21.1%) 55/223 (24.7%) 121/223 (54.2%)
Patient safety 62/223 (27.8%) 49/223 (22.0%) 112/223 (50.2%)
Adapting to new technologies 71/223 (32.0%) 53/223 (23.8%) 98/223 (44.2%)

With respect to the terminology and technologies, most of the underlying technologies used in deep learning remained unknown to the survey participants, including Python (71.7%), R (81.2%), PyTorch (96.4%) and TensorFlow (81.2%). Conversely, general terms like "artificial intelligence" and "algorithm" had been heard of or read in at least 75.8% and 57.4% of the cases, respectively (Fig. 1). Statistical significance was found for "artificial intelligence," "algorithm," "backpropagation," "blackbox," and "TensorFlow" (Table 3). According to Pearson's residuals, this significance is mainly due to a higher proportion of residents showing occasional use or knowledge only.


Fig1 Eiroa InsightsIntoImaging22 13.png

Fig. 1 Level of knowledge or usage of the different terms and technologies. Responses are divided into residents (red) and attending physicians (blue). The y-axis shows the percentage of answers for each group.


References