COVID-19 Research Paper Volume 12, Issue 20 pp 19945—19953

Lung ultrasound is a reliable diagnostic technique to predict abnormal CT chest scan and to detect oxygen requirements in COVID-19 pneumonia

Géraldine Falgarone1,2, , Frédéric Pamoukdjian1,3, , Johann Cailhol4,5, , Audrey Giocanti-Auregan6, , Sandrine Guis7,8, , Guilhem Bousquet1,9, , Olivier Bouchaud4,5, , Olivier Seror10,11,12, ,

  • 1 Université Sorbonne Paris Nord, INSERM UMR_S942, Bobigny F-93009, Paris, France
  • 2 AP-HP, Hôpital Avicenne, Unité de Médecine Ambulatoire (UMA), Bobigny F-93009, Paris, France
  • 3 AP-HP, Hôpital Avicenne, Service de Médecine Gériatrique, Bobigny F-93009, Paris, France
  • 4 AP-HP, Hôpital Avicenne, Service de Maladies Infectieuses et Tropicales, Bobigny F-93009, Paris, France
  • 5 Université Sorbonne Paris Nord, EA 3412, Bobigny F-93009, Paris, France
  • 6 AP-HP, Hôpital Avicenne, Service d’Ophtalmologie, Bobigny F-93009, Paris, France
  • 7 Service de Rhumatologie, AP-HM, Aix-Marseille Université, Marseille, France
  • 8 CRMBM/CEMEREM, UMR CNRS 7339, Aix-Marseille Université, Marseille, France
  • 9 AP-HP, Hôpital Avicenne, Service d’Oncologie Médicale, Bobigny F-93009, Paris, France
  • 10 AP-HP, Hôpital Avicenne, Service de Radiologie Interventionnelle, Bobigny F-93009, Paris, France
  • 11 Université Sorbonne Paris Nord, INSERM UMR_S1162 Paris, Bobigny F-93009, Paris, France
  • 12 Inserm U1138, Centre de Recherche des Cordeliers, Paris F-75006, Paris, France

Received: July 28, 2020       Accepted: September 9, 2020       Published: October 30, 2020      

https://doi.org/10.18632/aging.104150
How to Cite

Copyright: © 2020 Falgarone et al. This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Abstract

COVID-19 pneumonia can be severe, with an unpredictable evolution and high mortality prevalence in older patients. The diagnosis is usually performed by RT-PCR or CT chest scan. Lung ultrasonography (LUS) has been proposed as an alternative method to monitor patients with COVID-19 pneumonia.

To assess the diagnostic performance of LUS, we performed LUS using a portable device and adapting a protocol already used in Acute Respiratory Syndrome. We used the score obtained with the index we created to assess for LUS diagnostic performance as compared to lung CT chest scan and to predict for oxygen requirements.

Daily bedside LUS was easy to perform and microbiologically safe. LUS was 89% sensitive and 100% specific in predicting CT chest scan abnormalities, and 95% sensitive and 67% specific in detecting oxygen requirements.

This is the first report on the diagnostic performance of LUS as compared to CT chest scan for the diagnosis of COVID-19 pneumonia and assessments of oxygen requirements by LUS. LUS could help in the orientation of dyspneic patients to intensive care. It could also be proposed when there is limited access to CT scan in the context of a pandemic crisis, or to implement clinical lung examinations for outpatient follow-up.

Introduction

COVID-19 pneumonia can be severe and its evolution unpredictable [1, 2] with a high mortality prevalence of 26% in older inpatients [3]. Computed Tomography (CT) chest scan is the imaging "gold standard" to detect COVID-19 pneumonia, in particular when RT-PCR is negative [4, 5]. In the dramatic context of a pandemic situation, access to CT chest scan can be limited, and repeated CT scans, if an imaging follow-up is required, can be difficult to perform due to costs, invasiveness and infectious risks. In intensive care units, lung ultrasonography (LUS) has proved to be very helpful in managing acute respiratory distress syndrome, (ARDS) [6, 7], and has recently been suggested to manage COVID-19 pneumonia [810]. To date no study has yet assessed the diagnostic performance of LUS in COVID-19 as compared to CT chest scan. Furthermore, this information is of major importance in the event of a second wave, to manage patient flows, or in emerging infectious lung diseases. Here we propose for the first time a practical diagnostic process using bedside LUS with a portable device which can be used for both diagnosis and daily monitoring of patients with COVID-19 pneumonia.

Results

Characteristics of patients and diagnostic performances of LUS in detecting lung damage observed on CT chest scan in COVID-19

The mean age of the 50 consecutive patients with confirmed COVID-19 was 54.3 years, 34% were older than 65 years, 74% were male and 74% overweight with a median BMI = 28 kg/m². They had damage detected on CT scan described as minor (10%), moderate (38%), extensive (46%) or severe (6%). 72% of all patients had a positive RT-PCR for SARS-Cov-2. 80% had at least one significant comorbidity, 30% had two comorbidities, and 15% had three comorbidities (hypertension, diabetes, overweight). The prevalence of hypertension was 28%, and the prevalence of diabetes was 28% (Table 1).

Table 1. Baseline characteristics of 50 consecutive inpatients with COVID-19.

VariablesMean ± SD or Median (Q1-Q3)N (%)
Age (y)54.3 ± 17.3
Gender (men)37 (74)
US-index0.40 ± 0.10
Number of evaluated Locations (% in the cohort)
Front Upper Right50 (100)
Front Lower Right49 (98)
Front Upper Left49 (98)
Front Lower Left44 (88)
Side Upper Right39 (78)
Side Medium Right34 (68)
Side Lower Right20 (40)
Posterior Right37 (74)
Side Upper Left42 (84)
Side Medium Left33 (66)
Side Lower Left22 (44)
Posterior Left37 (74)
Time lapse between symptoms and LUS (days)9 (7-14)
Time lapse between CT chest scan and LUS (days)1.5 (1-6.5)
CT chest scan damage
None3 (6)
Mild2 (4)
Moderate19 (38)
Extensive23 (46)
Severe3 (6)
Sars-cov-2 RT-PCR
Positive36 (72)
Negative11 (22)
Not performed3 (6)
Oxygen therapy
Consumption > 0 l/min (yes)41 (82)
Requirement (l/min)2.5 (1-4)
BMI (kg/m2)28 (25.1-30.6)
Prevalence of comorbidities:
Number of comorbidities1 (1-2)
1 at least40 (80)
2 comorbidities12 (24)
3 comorbidities6 (12)
Overall HTA prevalence14 (28)
Overall Diabetes prevalence14 (28)
US: Ultrasound; BMI: Body Mass Index; HTA: hypertension.

Severity index for lung involvement based on LUS

We performed daily bedside LUS evaluations using a portable device to evaluate COVID-19 pneumonia. LUS evaluations of lung damage were graded in the six categories described for ARDS, in a blinded manner for oxygen needs and CT scan grading, based on a twelve-point grading system (see Materiel and Methods section). We designed this severity index that is based on evaluations done with certainty to be able to take into account missing data and feasibility (see Material and Methods section for details). Table 2 reports the LUS scoring taking into account missing data, feasibility due to anatomical or posture problems, and oxygen requirements for the first 12 patients included. For the totality of the patients, the mean LUS severity score was 0.40 (ranging from 0.2 to 0.63). LUS exhibited 89% sensitivity and 100% specificity in predicting an abnormal CT scan with an AUC of 96% (95% CI) (Figure 1). When our LUS severity index was tested at different thresholds, we found that the value 0.32 was robust across sensitivity analyses, providing the optimal index to predict CT scan severity (Supplementary Table 1). Figure 2 illustrates the case of a 45-year-old man at 10 days from initial symptoms with severe pneumonia on CT scan. The LUS severity index was 0.58, with 10 locations scored from 1 to 4.

Receiver operating characteristics curves for LUS to screen for COVID-19: ROC for LUS to predict abnormal CT scan.

Figure 1. Receiver operating characteristics curves for LUS to screen for COVID-19: ROC for LUS to predict abnormal CT scan.

(A)This panel shows a grade 2 LUS image for a 45-year-old man at 10 days from initial symptoms, requiring oxygen (6 l/min), with a severity index of 0.58. On this sagittal ultrasound view encompassing a right anterior inter-rib space (arrows: rib shadows), one can see a typical lung rocket (arrow) as breath moving comet-tail artefact. (B) This panel shows an axial image of the corresponding CT scan performed at admission with typical COVID-19 interstitial pneumonia combining septal thickening (arrow) and peripheral ground glass opacities (stars).

Figure 2. (A)This panel shows a grade 2 LUS image for a 45-year-old man at 10 days from initial symptoms, requiring oxygen (6 l/min), with a severity index of 0.58. On this sagittal ultrasound view encompassing a right anterior inter-rib space (arrows: rib shadows), one can see a typical lung rocket (arrow) as breath moving comet-tail artefact. (B) This panel shows an axial image of the corresponding CT scan performed at admission with typical COVID-19 interstitial pneumonia combining septal thickening (arrow) and peripheral ground glass opacities (stars).

Table 2. Examples of LUS scoring for the first 12 patients.

Location 1Location 2Location 3Location 4Location 5Location 6Location 7Location 8Location 9Location 10Location 11Location 12Nb LocationsMax obtainableScore value02 need (l/mn)
pt#1111211413310500.361
pt#2111131148400.331.5
pt#3123222241410500.464
pt#41133336300.478
pt#51111111349450.310
pt#61111133333311550.424
pt#71211334148400.509
pt#8331144433310500.586
pt#911111142122312600.334
pt#101213341111211550.363
pt#111212233322311550.441
pt#12111233423410500.484
pt: patients. No. locations: Number of locations evaluated with certainty. Max: maximum obtainable, which is the number of locations multiplied by 5. Score value: Sum of location values divided by Max.

Diagnostic performance of LUS in detecting oxygen requirements in COVID-19 pneumonia

LUS was a good screening test for oxygen requirements (0.5 litre/min or more) with 95% sensitivity, 67% specificity, and an AUC of 88% (95% CI) (Figure 3A). The best LUS severity index threshold for oxygen therapy was 0.32 (Table 2) because the PPV was 92.9 (80-98) and the NPV 75.0 (35-97), with a diagnostic accuracy of 90.0 (78-97). In contrast, on the CT scans of our 50 patients, global scoring was not as reliable in predicting oxygen requirements, with an AUC of 72 (CI: 50-93%) (Figure 3B). For example, a score of 2 (moderate lung damage of 10 to 25%) had sensitivity of 98% but specificity of 44%. The LUS diagnostic performances were also robust in the sensitivity analyses according to BMI, and thus reliable for overweight patients, since the PPV was still 100% for CT scan scoring, while it varied for oxygen requirements, ranging from 93% to 91% and 95% for the whole cohort, normal weight, and over weighted patients respectively (Table 3).

(A) LUS to screen for oxygen requirement ≥ 0.5 l/min; (B) CT scan to screen for oxygen requirement ≥ 0.5 l/min.

Figure 3. (A) LUS to screen for oxygen requirement ≥ 0.5 l/min; (B) CT scan to screen for oxygen requirement ≥ 0.5 l/min.

Table 3. Diagnostic performances of the LUS - severity index in detecting oxygen requirements ≥ 0.5 l/min.

LUS-indexSe (%) 95%CISp (%) 95%CIPPV (%) 95%CINPV (%) 95%CIDiagnostic accuracy (%) 95%CI
Whole cohort (n=50)
≥ 0.30100 (87.4-100)44.4 (13.7-78.8)89.1 (76.4-96.4)100 (28.4-100)90.0 (78.2-96.7)
≥ 0.3197.6 (87.1-99.9)55.6 (21.2-86.3)90.9 (78.3-97.5)83.3 (35.9-99.6)90.0 (78.2-96.7)
≥ 0.3295.1 (83.5-99.4)66.7 (29.9-92.5)92.9 (80.5-98.5)75.0 (34.9-96.8)90.0 (78.2-96.7)
≥ 0.3387.8 (73.8-95.9)66.7 (29.9-92.5)92.3 (79.1-98.4)54.5 (23.4-83.3)84.0 (70.9-92.8)
≥ 0.3482.9 (67.9-92.8)77.8 (40.0-97.2)94.4 (81.3-99.3)50.0 (23.0-77.0)82.0 (68.6-91.4)
BMI ≤ 28 kg/m2 (n=26)
0.30100 (78.1-100)50.0 (6.80-93.2)91.7 (73.0-99.0)100 (9.40-100)92.3 (74.9-99.1)
0.3195.5 (77.2-99.9)50.0 (6.80-93.2)91.3 (72.0-98.9)66.7 (9.40-99.2)88.5 (69.8-97.6)
0.3290.9 (70.8-98.9)50.0 (6.80-93.2)90.9 (70.8-98.9)50.0 (6.80-93.2)84.6 (65.1-95.6)
0.3381.8 (59.7-94.8)50.0 (6.80-93.2)90.0 (68.3-98.8)33.3 (4.30-77.7)76.9 (56.4-0.91)
BMI > 28 kg/m2 (n=24)
0.30100 (75.1-100)40.0 (5.30-85.3)86.4 (65.1-97.1)100 (9.40-100)87.5 (67.6-97.3)
0.31100 (75.1-100)60.0 (14.7-94.7)90.5 (69.6-98.8)100 (19.4-100)91.7 (73.0-99.0)
0.32100 (75.1-100)80.0 (28.4-99.5)95.0 (75.1-99.9)100 (28.4-100)95.8 (78.9-99.9)
0.3394.7 (74.0-99.9)80.0 (28.4-99.5)94.7 (74.0-99.9)80.0 (28.4-99.5)91.7 (73.0-99.0)
Se = sensitivity; Sp = specificity; PPV = positive predictive value; NPV = negative predictive value; Bold = Best threshold.

Discussion

In this study, we have shown the feasibility of LUS for the diagnosis of pneumonia and oxygen requirements in the context of the COVID-19 pandemic. LUS is feasible in COVID-19 units with their high infectious risk, particularly with a portable device. Safety conditions were fulfilled, applying specific COVID-19 hygiene procedures. Operators were wearing adequate protection and as the device was restricted to the COVID-19 unit, the operator had to simply clean the probe, the wire, and the LUS device itself after each examination. From the technical method described by Soldati et al (7), we developed a scoring system that is easy to perform and reliable for the diagnosis of COVID-19 pneumonia, whatever the patient’s position. The proposed LUS severity index was calculated by summing all scores for unequivocal locations, and then dividing the sum by the maximum obtainable (the maximum being 60 for the 12 locations evaluated). The robustness of our assessment is related to the choice we made to only take into account scores allocated with certainty. A striking result was that the prediction of oxygen therapy requirements was excellent for LUS but poor for CT chest scan, which is considered the gold standard for COVID-19 pneumonia diagnosis. However, the discordance between CT scan and clinical severity has already been reported [11]. The optimal threshold of 0.32 for the severity index could be appropriate to motivate increase in oxygen therapy, and to prevent inappropriate early reduction. This could be of major interest in the follow-up of patients with COVID-19 pneumonia, since LUS can easily be performed daily at the bedside. For severe COVID-19 inpatients, the use of LUS could be helpful to comfort the estimation of oxygen needs at hospital discharge. As a perspective following these observations, LUS could also be proposed for outpatients, particularly older patients since COVID-19 is liable to impinge upon the follow-up of chronic diseases (autoimmune diseases, cancers, chronic obstructive pulmonary disease). LUS could be useful in diagnosis, as well as in follow-up of lung diseases in an ultrasonoscopy procedure where lung auscultation is performed or replaced by lung visualisation with ultrasound [9], especially for patients that need low irradiation techniques like pregnant women.

In addition, LUS could also be of particular interest when CT chest scan access is limited, or in the case of so-called re-infestation/reactivation of COVID-19 to diagnose pneumonia (16).

Conclusions

This proof-of-concept study proposing an original scoring system and a severity index requires confirmation by larger multicentre studies, which can now benefit from a clearly described, easy procedure. This would help in evaluating lung disease using ultrasound in a clinical practice also named ultrasonoscopy.

Materials and Methods

We followed the Standards for Reporting Diagnostic Accuracy studies (STARD) recommendations [12].

Patients

From 04/03/2020 to 04/14/2020, 50 consecutive patients with COVID-19 pneumonia admitted to the department of infectious diseases in Avicenne hospital, Paris, were systematically evaluated with LUS. Baseline clinical characteristics were prospectively collected, including gender, age, time lapse from onset of COVID-19 disease, and major comorbidities as previously defined [13], Body Mass Index (BMI) before the illness, CT chest scan severity index (standard national recommendation, based on [14]), SARS-Cov-2 RT-PCR test result, C-reactive protein level (mg/l), lymphocyte count as an indicator of viral disease severity [15], and oxygen therapy requirements (litre/min). Patient consent was collected in accordance with national ethics rules.

Daily bedside evaluation using LUS

LUS evaluations were performed by a single operator experienced in articular ultrasonography, using a portable device (ExoTouch, Quantel Medical ®, Cournon d’Auvergne, F-63808 France), and a 3,5 to 6 Mhz convex array transducer (CC560A, ExoTouch, Quantel Medical ®, Cournon d’Auvergne, F-63808 France). LUS evaluations of lung damage were graded in the six categories described for ARDS [16]: normal pleural image with A lines was graded as 1, B lines with lung rockets grade 2, ground glass rockets grade 3, condensation grade 4, and neo organization known as hepatisation grade 5. Pleurisy, theoretically graded 6, was not found among our patients. LUS was performed blind to oxygen needs and CT scan grading, and results were expressed on a twelve-point grading system with 3 key features defining our process 1) the patient’s position was not limited since we performed LUS in lying, siting, or standing position; 2) the anatomical location of the examination, with, for each hemi thorax, 2 anterior locations, 3 side locations, and 1 posterior location (annex 1); 3) the grading system from 1 to 5 as described above. We decided that only unequivocal scores were to be collected. Uncertain scores were simply considered as non-available, whatever the reason (position, anatomical variation, technical difficulties). Thus, the number of available measures defined the feasibility of LUS across the 12 locations assessed.

Development of a severity index for lung damage based on LUS

To provide a reproducible method using LUS, we created a severity index for lung damage as follows: the sum of the scores obtained for each measurement location was divided by the maximum possible score based on evaluations done with certainty. For example, when a measure was obtained only for 8 locations, the maximum score was 5 x 8 = 40. In contrast, when a measure was obtained for all 12 locations, the maximum score was 5 x 12 = 60. If the sum of the LUS evaluation is 20, in the first case, with a total of 8 locations collected with certainty, the index of severity index is 0.5 (i.e. 20/40). In the second case, where all locations were assessed with certainty, the severity index is 0.33 (i.e. 20/60). Thus this index takes missing data and feasibility into account.

Statistical analysis

Qualitative variables were expressed as numbers and proportions, and quantitative variables as means and standard deviation (SD) or medians and quartiles (Q1-Q3) as appropriate. Diagnostic performances were assessed on the basis of sensitivity (Se), specificity (Sp), positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (PLR), and negative likelihood ratio (NLR). The diagnostic accuracy of LUS in detecting lung damage on CT chest scan or oxygen requirements was quantitatively analysed by the area under the receiver operating characteristic curve (AUC-ROC) with 95%CI, and graphically from the ROC curve. Sensitivity analyses were performed to test the robustness of the results by 1) varying the thresholds of the LUS-index (0.30, 0.31, 0.32, 0.33, and 0.34); and 2), using BMI as a function of the median of 28 kg/m2. All tests were two-sided, with P<0.05 considered statistically significant. The data was analysed using R statistical software (version 3.4.3, R Foundation for Statistical Computing, Vienna, Austria; http://www.r-project.org).

Supplementary Materials

Supplementary Table 1

Author Contributions

GF: literature search, figures, study design, data collection, data analysis, data interpretation, drafting; FP: literature search, figures, study design, data analysis, data interpretation, drafting; JC: literature search, figures, study design, data analysis, data interpretation, drafting; AGA: study design, data collection, data analysis, data interpretation; SG: literature search, figures, study design, data interpretation, drafting; GB: literature search, figures, study design, data collection, data analysis, data interpretation, drafting; OB: literature search, figures, study design, data interpretation, drafting; OS: literature search, figures, study design, data collection, data analysis, data interpretation, drafting.

Acknowledgments

We would like to thank Ms Angela Swaine for revising the English language. We thank Prof. D’Agostino for her enriching discussion on the topic. We thank Prof. Janin for her critical revision of the manuscript.

Conflicts of Interest

All authors declare to have no conflicts of interest.

Funding

This work was supported by the INSERM and Université Sorbonne Paris Nord (funding for the UMR_S 942).

References

  • 1. Song F, Shi N, Shan F, Zhang Z, Shen J, Lu H, Ling Y, Jiang Y, Shi Y. Emerging 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology. 2020; 295:210–17. https://doi.org/10.1148/radiol.2020200274 [PubMed]
  • 2. Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, Wang B, Xiang H, Cheng Z, Xiong Y, Zhao Y, Li Y, Wang X, Peng Z. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA. 2020; 323:1061–69. https://doi.org/10.1001/jama.2020.1585 [PubMed]
  • 3. Bousquet G, Falgarone G, Deutsch D, Derolez S, Lopez-Sublet M, Goudot FX, Amari K, Uzunhan Y, Bouchaud O, Pamoukdjian F. ADL-dependency, D-dimers, LDH and absence of anticoagulation are independently associated with one-month mortality in older inpatients with COVID-19. Aging (Albany NY). 2020; 12:11306–13. https://doi.org/10.18632/aging.103583 [PubMed]
  • 4. Pan Y, Guan H, Zhou S, Wang Y, Li Q, Zhu T, Hu Q, Xia L. Initial CT findings and temporal changes in patients with the novel coronavirus pneumonia (2019-nCoV): a study of 63 patients in Wuhan, China. Eur Radiol. 2020; 30:3306–09. https://doi.org/10.1007/s00330-020-06731-x [PubMed]
  • 5. Han X, Cao Y, Jiang N, Chen Y, Alwalid O, Zhang X, Gu J, Dai M, Liu J, Zhu W, Zheng C, Shi H. Novel coronavirus disease 2019 (COVID-19) pneumonia progression course in 17 discharged patients: comparison of clinical and thin-section computed tomography features during recovery. Clin Infect Dis. 2020; 71:723–31. https://doi.org/10.1093/cid/ciaa271 [PubMed]
  • 6. Lichtenstein D, Goldstein I, Mourgeon E, Cluzel P, Grenier P, Rouby JJ. Comparative diagnostic performances of auscultation, chest radiography, and lung ultrasonography in acute respiratory distress syndrome. Anesthesiology. 2004; 100:9–15. https://doi.org/10.1097/00000542-200401000-00006 [PubMed]
  • 7. Alzahrani SA, Al-Salamah MA, Al-Madani WH, Elbarbary MA. Systematic review and meta-analysis for the use of ultrasound versus radiology in diagnosing of pneumonia. Crit Ultrasound J. 2017; 9:6. https://doi.org/10.1186/s13089-017-0059-y [PubMed]
  • 8. Soldati G, Smargiassi A, Inchingolo R, Buonsenso D, Perrone T, Briganti DF, Perlini S, Torri E, Mariani A, Mossolani EE, Tursi F, Mento F, Demi L. Proposal for international standardization of the use of lung ultrasound for patients with COVID-19: a simple, quantitative, reproducible method. J Ultrasound Med. 2020; 39:1413–19. https://doi.org/10.1002/jum.15285 [PubMed]
  • 9. Buonsenso D, Pata D, Chiaretti A. COVID-19 outbreak: less stethoscope, more ultrasound. Lancet Respir Med. 2020; 8:e27. https://doi.org/10.1016/S2213-2600(20)30120-X [PubMed]
  • 10. Fiala MJ. A brief review of lung ultrasonography in COVID-19: is it useful? Ann Emerg Med. 2020; 75:784–85. https://doi.org/10.1016/j.annemergmed.2020.03.033 [PubMed]
  • 11. Pan F, Ye T, Sun P, Gui S, Liang B, Li L, Zheng D, Wang J, Hesketh RL, Yang L, Zheng C. Time course of lung changes at chest CT during recovery from coronavirus disease 2019 (COVID-19). Radiology. 2020; 295:715–21. https://doi.org/10.1148/radiol.2020200370 [PubMed]
  • 12. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, Lijmer JG, Moher D, Rennie D, de Vet HC, Kressel HY, Rifai N, Golub RM, et al, and STARD Group. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ. 2015; 351:h5527. https://doi.org/10.1136/bmj.h5527 [PubMed]
  • 13. Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, Qiu Y, Wang J, Liu Y, Wei Y, Xia J, Yu T, Zhang X, Zhang L. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet. 2020; 395:507–13. https://doi.org/10.1016/S0140-6736(20)30211-7 [PubMed]
  • 14. Wang Y, Dong C, Hu Y, Li C, Ren Q, Zhang X, Shi H, Zhou M. Temporal changes of CT findings in 90 patients with COVID-19 pneumonia: a longitudinal study. Radiology. 2020; 296:E55–64. https://doi.org/10.1148/radiol.2020200843 [PubMed]
  • 15. Chen J, Qi T, Liu L, Ling Y, Qian Z, Li T, Li F, Xu Q, Zhang Y, Xu S, Song Z, Zeng Y, Shen Y, et al. Clinical progression of patients with COVID-19 in shanghai, China. J Infect. 2020; 80:e1–e6. https://doi.org/10.1016/j.jinf.2020.03.004 [PubMed]
  • 16. Lichtenstein DA. BLUE-protocol and FALLS-protocol: two applications of lung ultrasound in the critically ill. Chest. 2015; 147:1659–70. https://doi.org/10.1378/chest.14-1313 [PubMed]