Front. Oncol.Frontiers in OncologyFront. Oncol.2234-943XFrontiers Media S.A.10.3389/fonc.2024.1404426OncologySystematic ReviewIs three-dimensional ultrasonography a valuable diagnostic tool for patients with ovarian cancer? Systematic review and meta-analysisLiuYuan1†ZhangQingdong2†ZhangFang3LiuMeiyan3ZhangJun4CaoXiaoli2YinWeihong3*1School of Medical Imaging, Binzhou Medical University, Yantai, Shandong, China2Department of Ultrasonography, Affiliated Yantai Yuhuangding Hospital of Qingdao University, Yantai, Shandong, China3Department of Ultrasonography, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, Shandong, China4Department of Scientific Research and Teaching, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, Shandong, China
Edited by: Jianfeng Guo, Huazhong University of Science and Technology, China
Reviewed by: Elisa Scarpelli, University Hospital of Parma, Italy
Sami Fendri, Habib Bourguiba University Hospital, Tunisia
*Correspondence: Weihong Yin, ytfycsk@163.com
†These authors have contributed equally to this work and share first authorship
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Introduction
This paper was to assess the diagnostic performance and clinical value of three-dimensional ultrasonography (3DUS), three-dimensional ultrasonography power Doppler (3DPD), and 3DUS combined with 3DPD in ovarian cancer (OC).
Methods
The study was registered with PROSPERO (CRD 42023405765). PubMed and Web of Science were searched from inception to 25 January 2022, and reference lists of potentially eligible studies were also manually searched. Patient and study characteristics were extracted by two independent reviewers. Any discrepancies were addressed through discussion. The sensitivity, specificity, positive and negative likelihood ratio (PLR and NLR, respectively), and the area under the receiver operating characteristic curve (AUC) were pooled separately.
Results
We retrieved 2,566 studies, of which 18 were finally enrolled, with 2,548 cases. The pooled sensitivity, specificity, PLR, NLR, and AUC for 3DUS were 0.89 (95% CI: 0.85–0.93), 0.93 (95% CI: 0.88–0.96), 13.1 (95% CI: 7.3–23.4), 0.11 (95% CI: 0.08–0.16), and 0.90 (95% CI: 0.87–0.93), respectively. The pooled sensitivity, specificity, PLR, NLR, and AUC for 3DPD were 0.90 (95% CI: 0.80–0.95), 0.85 (95% CI: 0.71–0.92), 5.8 (95% CI: 3.0–11.2), 0.12 (95% CI: 0.06–0.24), and 0.94 (95% CI: 0.91–0.96), respectively. The pooled sensitivity, specificity, PLR, NLR, and AUC for 3DUS combined with 3DPD were 0.99 (95% CI: 0.73–1.00), 0.95 (95% CI: 0.85–0.99), 21.9 (95% CI: 6.1–78.9), 0.01 (95% CI: 0.00–0.37), and 0.99 (95% CI: 0.98–1.00), respectively.
Conclusions
3DUS, 3DPD, and 3DUS combined with 3DPD are promising diagnostic tools for OC, alongside elevated sensitivity and specificity. However, the combination of 3DUS and 3DPD techniques has higher diagnostic efficiency.
ovarian cancerthree-dimensional ultrasonographythree-dimensional power Doppler ultrasonographymeta-analysisdiagnosesection-in-acceptanceGynecological OncologyIntroduction
Ovarian cancer (OC) is a major concern for women’s health, accounting for 3.4% of female cancer cases and with a mortality rate of 4.7% (1). Patients at the International Federation of Gynecology and Obstetrics (FIGO) stage I have a high 5-year survival rate of 90%, but those at FIGO stage IV have a high 5-year survival rate of no more than 10% (2). Nonetheless, a significant proportion, approximately 70% of OC patients do not receive a diagnosis until the disease has progressed to advanced stages. This delay in diagnosis is primarily due to its asymptomatic nature in the initial stages and its deep location within the pelvis (3). This underscores the critical importance of ongoing research efforts to develop early and reliable diagnostic techniques for OC.
The gold standard for OC diagnosis is histopathology (4), which, however, is invasive. As alternatives, non-invasive techniques such as biochemical and imaging examination, including carbohydrate antigen 125 (CA125), human epididymis protein 4 (HE4), two-dimensional ultrasonography, computer tomography (CT), and magnetic resonance imaging (MRI) are commonly used in preoperative assessment of OC. However, each of these options presents disadvantages. For instance, elevated CA125 levels may also be detected in other malignancies and certain benign gynecological conditions (5). HE4 levels are susceptible to factors such as body mass index and smoking (6). CT scans expose patients to high doses of ionizing radiation, particularly for repeated scans, while MRI scans are expensive and not widely accessible (7). Ultrasonography has become one of the preferred diagnostic methods for distinguishing OC due to its non-invasive, simple, repeatable, cost-effective, and real-time features. The International Ovarian Tumor Analysis has introduced simple ultrasound-based rules, logistic regression model, and assessment of different neoplasms in the adnexa (ADNEX model) for preoperative evaluation of OC patients (8). Nevertheless, two-dimensional ultrasonography is heavily dependent on the operator and presents limited sensitivity (9).
Three-dimensional ultrasonography (3DUS) offers solutions to several major limitations of conventional two-dimensional ultrasound (10). It can obtain and store the volume of a region of interest (ROI). It requires a few volumetric scans to obtain a comprehensive image of the entire tissue. These images can be easily reviewed and re-examined electronically from various angles and planes, allowing different expert operators to assess the tissue independently of the initial sonographer. This significantly reduces the reliance on the original sonographer. Tissue vascularization in the ROI can also be assessed using three-dimensional ultrasonography power Doppler (3DPD), which helps generate three-dimensional reconstructions of the vascular network and is particularly significant in the field of oncology. The vascular structure in malignant tumors is different from that of benign ones, with tumor tissue typically displaying a higher microvessel density, a phenomenon referred to as angiogenesis (11). Furthermore, power Doppler has been shown to be 3 times more sensitive than color Doppler in detecting low-flow velocities (12), making it an important tool for assessing blood flow in tissues.
Studies have examined the accuracy of both 3DUS and 3DPD in detecting OC, however, yielding conflicting results (13–16). We conducted a meta-analysis and systematic review to assess the efficacy of 3DUS, 3DPD, and 3DUS combined with 3DPD in distinguishing between benign and malignant ovarian tissue.
Materials and methodsSearch strategy and selection criteria
Our study was registered with PROSPERO (CRD 42023405765). PubMed and Web of Science were systematically searched for studies on the diagnostic value of 3DUS and 3DPD in OC between inception and 25 January 2022. The search strategy is shown in Supplementary Material S2. The reference lists of potentially eligible studies and prior systematic reviews were manually examined.
The inclusion criteria encompassed the following: (1) individuals diagnosed with OC with no limitation on duration of illness, other diseases, or complications; (2) studies examining the diagnostic value of 3DUS, 3DPD, and 3DUS combined with 3DPD; (3) postoperative histopathology as the diagnostic standard; (4) studies providing sufficient data to construct the 2 × 2 contingency table, including false positives, true positives, false negatives, and true negatives; (5) no limitation on study type.
Studies were excluded for the following reasons: (1) utilization of index tests in conjunction with other diagnostic methods; (2) emphasis on 3DPD vascular indexes; (3) not taking postoperative histopathology as the gold standard; (4) insufficient data provided in the studies to obtain 2 × 2 contingency table directly or indirectly; (5) abstracts, reviews, case reports, animal experiments, correspondences, conferences, and lectures.
Data collection and quality assessment
Data collection and quality assessment were independently conducted by two researchers (L.Y., Z.Q.D.). Any discrepancies were addressed through group discussion after reviewing the full text of the available articles.
The name of the first author, publication year, country, publication type, type of study, ultrasound machine, masses type, and sample size (ultrasound and gold standard) were extracted from each included study. The count of true positives, false positives, true negatives, and false negatives was independently documented by each investigator.
The methodological quality of the included studies was assessed using QUADAS (quality assessment of studies of diagnostic accuracy) (17). The evaluation criteria for each item on the checklist were customized to suit our review (18). If additional information was required, we would contact the corresponding authors.
Statistical analysis
The true positives, false negatives, false positives, and true negatives among OC patients were calculated according to study classification to compute sensitivity and specificity and the corresponding 95% confidence interval (CI).
An exact binomial rendition (19) of the bivariate mixed-effects regression model developed by van Houwelingen (20, 21) was employed for comprehensive data analysis, which was suitable for meta-analysis of treatment trials and was modified for comprehensive analysis of diagnostic test data (22, 23). This model preserves the original two-dimensional nature of the data without transforming the sensitivity and specificity of individual studies into a single measure of diagnostic accuracy. It considers any correlation between sensitivity and specificity. Based on this model, the mean logit sensitivity and specificity with their standard errors and 95% CIs were estimated. Inter-study variability in logit sensitivity and specificity and their covariance was also calculated. These data were inversely concerted to the original receiver operating characteristic (ROC) curve to obtain summary sensitivity, specificity, and diagnostic odds ratios. Furthermore, a hierarchical summary ROC curve was plotted for 3DUS and 3DPD, with summary points for sensitivity and specificity and a 95% confidence ellipsoid on the curves (two-dimensional CI).
I² statistics was utilized to assess heterogeneity (24). The Cochrane Q test was utilized to obtain I², where I² <50% indicated moderate heterogeneity, and thus a fixed-effects model was used to pool the effect measures. Conversely, I² >50% indicated high heterogeneity, so a random-effects model was employed. In cases of heterogeneity, meta-regression, and sensitivity analysis were performed to determine the potential sources of heterogeneity. Based on the characteristics of each literature, specific covariates and criteria were set as follows: ① sample size (size50): sample size ≥50 was set as 1, while sample size <50 was set as 0; ② included standard of OC (subject): no special descriptions was set as 1, while special descriptions of included standard was set as 0; ③ ultrasound machine manufacturer (machine): GE Voulson machines was set as 1, while the machine from other manufacturers was set as 0.
To assess publication bias, a funnel plot of the log of effective sample size versus the diagnostic odds ratio was generated, and a regression test was conducted to assess asymmetry (25).
Cohen’s κ statistics were calculated by two investigators to assess methodological quality.
The MIDAS module of STATA (version 15.0) was used to summarize the pooled estimates and to perform the meta-regression and graphing.
Compliance with ethics guidelines
This article is based on previous studies and does not involve any human participants or animals in any included studies.
Results
A total of 2,566 articles were retrieved. Following a review of the titles and abstracts, we excluded 2,518 articles. After full-text assessment, seven articles were excluded due to the lack of well-defined reference criteria according to guidelines, seven articles were excluded because the index tests were combined with other diagnostic methods, six articles on 3DPD vascular indexes were excluded, eight articles were excluded due to the lack of 2 × 2 contingency table, one study was excluded due to the patient with the same sequence, and another one study was excluded because it focused on specific type of OC. Finally, 18 primary studies were enrolled (Figure 1). Table 1 shows the main characteristics of the 18 included studies (13–16, 26–39)with 1652 ovarian lesions. The sample size varied from 20 to 318. The number of analyzed ovarian lesions was counted, not the number of patients. There were seven studies on 3DUS, eight studies on 3DPD, and six studies on 3DUS combined 3DPD. Histopathologic diagnoses were regarded as the gold standard in all studies (Table 1).
3DUS and 3DPD, which were used to distinguish benign from malignant ovarian lesions, examined the structure of the ovarian wall, shadowing, solid parts, septa, presence of the peritoneal fluid, surface, relationship with surrounding structure, vessel architecture, and branching pattern (22). Malignant tumors were classified postoperatively according to the FIGO system (40).
Supplementary Material S1 shows the methodological quality of the included studies according to the QUADAS checklist. Most studies (83.3%, 15/18) were of high quality (QUADAS score ≥ 8), two studies had a QUADAS score of 7, and one had a QUADAS score of 5.
3DUS
Nine studies on 3DUS were included, with 749 lesions. Most studies were prospective, with only one retrospective study (37). Five articles were limited to patients with complex OC, which was defined as the presence of at least 1 of the following features: solid areas, thick papillary projections, thick septa, or purely solid echogenicity (13). Three studies investigated the intraobserver and interobserver agreements of 3DUS in distinguishing malignant from benign adnexal masses (27, 28, 37).
The pooled sensitivity was 0.89 (95% CI: 0.85–0.93) and the pooled specificity was 0.93 (95% CI: 0.88–0.96) (Figure 2), indicating that 3DUS had an ability to positively and negatively differentiate OC. AUC was 0.90 (95% CI: 0.87–0.93) (Figure 3), suggesting that 3DUS had good accuracy in differentiating ovarian masses.
Forest plot of sensitivity and specificity for 3DUS in differentiating malignant from benign ovarian tumors.
The area under the ROC curve for 3DUS in differentiating malignant from benign ovarian tumors.
According to the forest plot, the heterogeneity of pooled sensitivity was I² = 33.45, and that of pooled specificity was I² = 72.34. There was moderate heterogeneity in pooled sensitivity and high heterogeneity in pooled specificity. To identify the source of heterogeneity, meta-regression analyses were performed. The results unveiled that the included standard of OC was the main heterogeneity for 3DUS sensitivity in OC diagnosis (p < 0.05) (Supplementary Figure S1).
A sensitivity analysis was also done to determine the impact of individual studies on the overall conclusion. The results revealed that the meta-analysis was not heavily influenced by any single study, indicating the stability of the included articles and the reliability of the findings (Supplementary Figure S1).
Despite some biases of the meta-analysis itself, the Deeks’ funnel plot showed no publication bias in this meta-analysis (p > 0.05) (Supplementary Figure S3).
Fagan diagram was utilized to analyze the effectiveness of 3DUS in the diagnosis of OC. Given a pre-test probability of 50%, the post-test probability of a positive result was 93% (Supplementary Figure S4). It implied that when the result was positive, the probability of OC was 93%, which proved that 3DUS had high clinical value in OC diagnosis. The positive likelihood ratio (PLR) was 13, and the negative likelihood ratio (NLR) was 0.11, indicating the diagnostic performance of 3DUS in OC.
3DPD
Eight articles on 3DPD were finally enrolled, with 671 lesions. All studies were prospective. Five articles were limited to patients with complex OC. One study investigated the intraobserver and interobserver agreements of 3DPD in distinguishing malignant from benign OC (26).
The pooled sensitivity was 0.90 (95% CI: 0.80–0.95) and the pooled specificity was 0.85 (95% CI: 0.71–0.92) (Figure 4), indicating 3DPD had a respectable ability to positively and negatively differentiate OC. The AUC was 0.94 (95% CI: 0.91–0.96) (Figure 5), manifesting that 3DPD achieved good accuracy in differentiating OC.
Forest plot of sensitivity and specificity for 3DPD in differentiating malignant from benign ovarian tumors.
The area under the ROC curve for 3DPD in differentiating malignant from benign ovarian tumors.
According to the forest plot, the heterogeneity of pooled sensitivity was I² = 73.05, and that of pooled specificity was I² = 81.16. There was high heterogeneity in pooled sensitivity and specificity. To identify the source of heterogeneity, meta-regression analyses were performed. The results revealed that the above variables were not the sources of heterogeneity (Supplementary Figure S5). The main source may be the percentage of stage I and sample collection time. Sensitivity analysis revealed that no single study affected the meta-analysis results (Supplementary Figure S6).
The Deeks’ funnel plot suggested publication bias (p < 0.05), possibly because positive results were more likely to be published (Supplementary Figure S7).
The Fagan diagram showed that with a pre-test probability of 50%, the post-test probability of a positive result was 85% (Supplementary Figure S8). It indicated that when the result was positive, the probability of OC was 85%, which proved that 3DPD had good clinical value in the diagnosis of OC. The PLR was 6 and the NLR was 0.12, indicating that 3DUS cannot diagnose or exclude OC.
3DUS combined 3DPD
Six studies on 3DUS combined 3PDP were included, with 763 lesions. All studies were prospective. Two studies included complex OC.
The pooled sensitivity was 0.99 (95% CI: 0.73–1.00) and the pooled specificity was 0.95 (95% CI: 0.85–0.99; Figure 6), implying a significant ability to positively and negatively differentiate OC over a single diagnosis. The AUC was 0.99 (95% CI: 0.98–1.00) (Figure 7), indicating the excellent diagnostic accuracy of this combination tool.
Forest plot of sensitivity and specificity for 3DUS and 3DPD in differentiating malignant from benign ovarian tumors.
The area under the ROC curve for 3DUS and 3DPD in differentiating malignant from benign ovarian tumors.
The forest plot revealed that the heterogeneity of pooled sensitivity was I² = 94.40 and that of pooled specificity was I² = 96.54. There was significant heterogeneity in both pooled sensitivity and specificity. Due to the limited number of included articles, the source of heterogeneity was not analyzed.
The Fagan diagram showed that with a pre-test probability of 50%, the post-test probability of a positive result was 96% (Supplementary Figure S10). It indicated that when the result of 3DUS combined with 3DPD diagnosis was positive, the probability of OC was 96%, which proved that the combination test had very high clinical value in OC diagnosis. The PLR was 22 and the NLR was 0.01, indicating that it can diagnose and exclude OC.
Discussion
This meta-analysis assessed the diagnostic value of 3DUS, 3DPD, and 3DUS combined with 3DPD in distinguishing benign from malignant ovarian tissue. The results unveiled that 3DUS, 3DPD, and 3DUS combined with 3DPD exhibited high diagnostic values for OC. Moreover, the diagnostic value of 3DUS combined with 3DPD was superior to that of any single one.
Early detection of OC remains a significant challenge in clinical practice. To our knowledge, there is a lack of specialized diagnostic imaging techniques for OC. The typical approach for OC diagnosis is histological examination. Nevertheless, there is a growing body of research exploring the potential of 3DUS in detecting OC. This meta-analysis investigated the diagnostic performance of 3DUS in identifying OC. In this meta-analysis, 18 studies with 1,652 ovarian lesions were enrolled according to our inclusion criteria. In all studies, histologically diagnosed OC patients were considered positive. However, 41 lesions that resolved spontaneously after follow-up or showed no change in appearance by ultrasound were not confirmed through histological examination. Such a loose design may overestimate the diagnostic accuracy and lead to bias. This meta-analysis demonstrated that the AUC for diagnosing OC using 3DUS was 0.9, while the AUC using 3DPD was 0.94, and the AUC using the combined test was 0.99. All these values exceeded 0.9, indicating high accuracy. The combined test exhibited the highest diagnostic performance.
3DUS is an efficient technology for capturing digital data, enabling rapid acquisition and storage of volumetric data from ROI. Compared with traditional two-dimensional ultrasound, 3DUS offers improved visualization of the three-dimensional morphology, internal structure, and inner wall characteristics of fluid-filled areas and lesions (41). In recent years, 3DPD has attracted much attention. This technology relies on the ability to visualize the dynamics of circulating red blood cells, presenting the location of lesions and blood flow through spatially reconstructed images. Thus, it avoids the impact of vessel orientation and ultrasound detection angles, consequently minimizing the occurrence of aliasing artifacts. Additionally, 3DPD offers a broad dynamic range, enabling the detection of small vessels and low-velocity blood flow signals, thus enhancing the sensitivity to identify microvascular abnormalities (42). Furthermore, by utilizing three-dimensional imaging, 3DPD can provide a detailed and comprehensive visualization of the vascular tree or vascular network within and around lesions, achieving similar effects to vascular imaging techniques but with simple and non-invasive procedures (43). 3DUS can serve as an adjunct to routine ultrasound in cases of difficult diagnosis, and the combined application can improve the diagnostic accuracy of OC.
The presence of extensive neovascularization surrounding and within malignant ovarian tumors, marked by rapid blood flow velocities, is a common feature due to the aggressive and invasive nature of OC. In contrast, benign tumors exhibit a slow growth rate and fewer blood vessels. However, some benign and malignant tumors share overlapping areas in sonogram and blood flow classification. Some studies have noted that the blood flow intensity of OC can be influenced by local hormone levels or the luteal phase, and luteal hemorrhage can manifest as solid tumors with significant blood flow on sonograms (44). These factors all impact the accuracy of 3DUS in tumor characterization. Notably, 3DUS can neither detect surrounding and distant metastases of the tumor nor guide the clinical staging of OC. Therefore, sonographers should incorporate clinical data for comprehensive evaluation.
The heterogeneity analysis revealed different degrees of heterogeneity in 3DUS, 3DPD, and 3DUS combined with 3DPD, so the random-effects model was used for analysis. The observed heterogeneity in 3DUS may be attributed to three studies (14, 36, 38) that selected complex OC. 3DUS has its limitations. For instance, excessive gain adjustments may obscure truly solid areas, leading to the misdiagnosis of malignant lesions as benign masses. Consequently, this can contribute to higher rates of false negatives (14). Studies on 3DPD have shown differences in the proportion of stage I patients across studies, resulting in bias and heterogeneity. The sample collection time varied across studies. Five studies did not report the sample collection time, two studies (29, 32) collected data 1–2 weeks before surgery, and one study (39) collected data 2 days before surgery. In studies on 3DUS combined 3DPD for complex ovarian lesions, the specificity was lower than that of the literature not specifically mentioned this aspect. Therefore, complex ovarian lesions may be a source of heterogeneity. The number of ovarian lesions included in each literature varied greatly, ranging from 45 to 251, which may also lead to heterogeneity.
The primary advantage of our research lies in the systematic summary of available evidence on 3DUS for OC diagnosis. However, the present study has several limitations. First, the diagnostic accuracy for early stage cases (stages I–II) could not be determined due to insufficient raw data. Additionally, primary data cannot be obtained to explore changes in 3DUS values based on tumor type, histology, or stage. Second, both prospective and retrospective studies were included, thereby potentially introducing selective and recall biases. Third, the differences in the experience of ultrasound sonographers may have potentially impacted the diagnostic performance of ultrasound. Fourth, due to the limited number of included studies in the combination test, the selected factors influencing heterogeneity may be unstable and the results have limitations.
In conclusion, the current evidence suggests that 3DUS, 3DPD, and the combination of 3DUS with 3DPD have potential diagnostic value in distinguishing malignant from benign ovarian lesions. Studies incorporating both morphological and Doppler assessments have demonstrated significantly improved diagnostic accuracy compared to utilizing each modality alone. This combined approach exhibits high sensitivity and specificity. The rapid and convenient nature of 3DUS in detecting ovarian lesions suggests its potential utility for routine screening in asymptomatic high-risk populations. Further research is warranted to identify potential correlations among multiple ultrasound parameters, which may enhance the efficacy of OC detection.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2024.1404426/full#supplementary-material
ReferencesSungHFerlayJSiegelRLLaversanneMSoerjomataram I JemalA. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2021) 71:209–49. doi: 10.3322/caac.21660PennySM. Ovarian cancer: an overview. Radiol Technol. (2020) 91:561–75.BellRPetticrewMSheldonT. The performance of screening tests for ovarian cancer: results of a systematic review. Br J Obstet Gynaecol. (1998) 105:1136–47. doi: 10.1111/j.1471-0528.1998.tb09966.xDe Mattos-ArrudaLSiravegnaG. How to use liquid biopsies to treat patients with cancer. ESMO Open. (2021) 6:100060. doi: 10.1016/j.esmoop.2021.100060OlsenMLofPStiekemaAvan den BroekDWilthagenEABossuytPM. The diagnostic accuracy of human epididymis protein 4 (HE4) for discriminating between benign and Malignant pelvic masses: a systematic review and meta-analysis. Acta Obstet Gynecol Scand. (2021) 100:1788–99. doi: 10.1111/aogs.14224FortnerRTVitonisAFSchockHHusingAJohnsonTFichorovaRN. Correlates of circulating ovarian cancer early detection markers and their contribution to discrimination of early detection models: results from the EPIC cohort. J Ovarian Res. (2017) 10:20. doi: 10.1186/s13048-017-0315-6FischerovaDBurgetovaA. Imaging techniques for the evaluation of ovarian cancer. Best Pract Res Clin Obstet Gynaecol. (2014) 28:697–720. doi: 10.1016/j.bpobgyn.2014.04.006ShettyM. Imaging and differential diagnosis of ovarian cancer. Semin Ultrasound CT MR. (2019) 40:302–18. doi: 10.1053/j.sult.2019.04.002KoutrasAPerrosPProkopakisINtounisTFasoulakisZPittokopitouS. Advantages and limitations of ultrasound as a screening test for ovarian cancer. Diagnost (Basel). (2023) 13:2078. doi: 10.3390/diagnostics13122078BenacerrafBR. Three-dimensional volume imaging in gynecology. Obstet Gynecol Clin North Am. (2019) 46:755–81. doi: 10.1016/j.ogc.2019.07.008ChenMWangWPJiaWRTangLWangYZhanWW. Three-dimensional contrast-enhanced sonography in the assessment of breast tumor angiogenesis: correlation with microvessel density and vascular endothelial growth factor expression. J Ultrasound Med. (2014) 33:835–46. doi: 10.7863/ultra.33.5.835FrijlinghMJuffermansLde LeeuwRde BruynCTimmermanDvan den BoschT. How to use power Doppler ultrasound in transvaginal assessment of uterine fibroids. Ultrasound Obstet Gynecol. (2022) 60:277–83. doi: 10.1002/uog.24879AlcazarJLCastilloG. Comparison of 2-dimensional and 3-dimensional power-Doppler imaging in complex adnexal masses for the prediction of ovarian cancer. Am J Obstetrics Gynecol. (2005) 192:807–12. doi: 10.1016/j.ajog.2004.10.630AlcazarJLGalanMJGarcia-ManeroMGuerrieroS. Three-dimensional sonographic morphologic assessment in complex adnexal masses - Preliminary experience. J Ultrasound Med. (2003) 22:249–54. doi: 10.7863/jum.2003.22.3.249CohenLSEscobarPFScharmCGlimcoBFishmanDA. Three-dimensional power Doppler ultrasound improves the diagnostic accuracy for ovarian cancer prediction. Gynecol Oncol. (2001) 82:40–8. doi: 10.1006/gyno.2001.6253HataTYanagiharaTHayashiKYamashiroCOhnishiYAkiyamaM. Three-dimensional ultrasonographic evaluation of ovarian tumours: a preliminary study. Hum Reproduct. (1999) 14:858–61. doi: 10.1093/humrep/14.3.858WhitingPRutjesAWReitsmaJBBossuytPMKleijnenJ. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. (2003) 3:25. doi: 10.1186/1471-2288-3-25WhitingPFWeswoodMERutjesAWReitsmaJBBossuytPNKleijnenJ. Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol. (2006) 6:9. doi: 10.1186/1471-2288-6-9ChuHColeSR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. (2006) 59:1331–2; author reply 2-3. doi: 10.1016/j.jclinepi.2006.06.011Van HouwelingenHCZwindermanKHStijnenT. A bivariate approach to meta-analysis. Stat Med. (1993) 12:2273–84. doi: 10.1002/sim.4780122405van HouwelingenHCArendsLRStijnenT. Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. (2002) 21:589–624. doi: 10.1002/sim.1040ReitsmaJBGlasASRutjesAWScholtenRJBossuytPMZwindermanAH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. (2005) 58:982–90. doi: 10.1016/j.jclinepi.2005.02.022RileyRDAbramsKRSuttonAJLambertPCThompsonJR. Bivariate random-effects meta-analysis and the estimation of between-study correlation. BMC Med Res Methodol. (2007) 7:3. doi: 10.1186/1471-2288-7-3DinnesJDeeksJKirbyJRoderickP. A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess. (2005) 9:1–113, iii. doi: 10.3310/hta9120DeeksJJMacaskillPIrwigL. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. (2005) 58:882–93. doi: 10.1016/j.jclinepi.2005.01.016AlcazarJLCabreraCGalvanRGuerrieroS. Three-dimensional power Doppler vascular network assessment of adnexal masses - Intraobserver and interobserver agreement analysis. J Ultrasound Med. (2008) 27:997–1001. doi: 10.7863/jum.2008.27.7.997AlcazarJLGarcia-ManeroMGalvanR. Three-dimensional sonographic morphologic assessment of adnexal masses - A reproducibility study. J Ultrasound Med. (2007) 26:1007–11. doi: 10.7863/jum.2007.26.8.1007AlcazarJLIturraASeddaFAubaMAjossaSGuerrieroS. Three-dimensional volume off-line analysis as compared to real-time ultrasound for assessing adnexal masses. Eur J Obstetrics Gynecology Reprod Biol. (2012) 161:92–5. doi: 10.1016/j.ejogrb.2011.12.002DaiSYHataKInubashiriEKanenishiKShiotaAOhnoM. Does three-dimensional power Doppler ultrasound improve the diagnostic accuracy for the prediction of adnexal Malignancy? J Obstetrics Gynaecol Res. (2008) 34:364–70. doi: 10.1111/j.1447-0756.2007.00702.xGeominiPMKluiversKBMoretEBremerGLKruitwagenRFMolBW. Evaluation of adnexal masses with three-dimensional ultrasonography. Obstet Gynecol. (2006) 108:1167–75. doi: 10.1097/01.AOG.0000240138.24546.37KalmantisKRodolakisADaskalakisGAntsaklisA. Characterization of ovarian tumors and staging ovarian cancer with 3-dimensional power doppler angiography correlation with pathologic findings. Int J Gynecol Cancer. (2013) 23:469–74. doi: 10.1097/IGC.0b013e3182866679KupesicSKurjakA. Contrast-enhanced, three-dimensional power Doppler sonography for differentiation of adnexal masses. Obstet Gynecol. (2000) 96:452–8. doi: 10.1097/00006250-200009000-00023KurjakAKupesicSAnicTKosutaD. Three-dimensional ultrasound and power Doppler improve the diagnosis of ovarian lesions. Gynecol Oncol. (2000) 76:28–32. doi: 10.1006/gyno.1999.5647KurjakAKupesicSSparacVBekavacI. Preoperative evaluation of pelvic tumors by Doppler and three-dimensional sonography. J Ultrasound Med. (2001) 20:829–40. doi: 10.7863/jum.2001.20.8.829KurjakAKupesicSSparacVKosutaD. Three-dimensional ultrasonographic and power Doppler characterization of ovarian lesions. Ultrasound Obstetrics Gynecol. (2000) 16:365–71. doi: 10.1046/j.1469-0705.2000.00185.xLabanMMetaweeHElyanAKamalMKamelMMansourG. Three-dimensional ultrasound and three-dimensional power Doppler in the assessment of ovarian tumors. Int J Gynecology Obstetrics. (2007) 99:201–5. doi: 10.1016/j.ijgo.2007.03.027PascualMAGrauperaBHereterLRotiliARodriguezIAlcazarJL. Intra- and interobserver variability of 2D and 3D transvaginal sonography in the diagnosis of benign versus Malignant adnexal masses. J Clin Ultrasound. (2011) 39:316–21. doi: 10.1002/jcu.20808Perez-MedinaTOrensanzIPereiraAValero de BernabéJEngelsVTroyanoJ. Three-dimensional angioultrasonography for the prediction of Malignancy in ovarian masses. Gynecol Obstet Invest. (2013) 75:120–5. doi: 10.1159/000345576TestaACAjossaSFerrandinaGFruscellaELudovisiMMalaggeseM. Does quantitative analysis of three-dimensional power Doppler angiography have a role in the diagnosis of Malignant pelvic solid tumors? A preliminary study. Ultrasound Obstet Gynecol. (2005) 26:67–72. doi: 10.1002/uog.1937O’SheaAS. Clinical staging of ovarian cancer. Methods Mol Biol. (2022) 2424:3–10. doi: doi 10.1007/978-1-0716-1956-8_1AlcazarJLMerceLTGarcia ManeroM. Three-dimensional power Doppler vascular sampling: a new method for predicting ovarian cancer in vascularized complex adnexal masses. J Ultrasound Med. (2005) 24:689–96. doi: 10.7863/jum.2005.24.5.689ShiaWCChenDRHuangYLWuHKKuoSJ. Effectiveness of evaluating tumor vascularization using 3D power Doppler ultrasound with high-definition flow technology in the prediction of the response to neoadjuvant chemotherapy for T2 breast cancer: a preliminary report. Phys Med Biol. (2015) 60:7763–78. doi: 10.1088/0031-9155/60/19/7763PretoriusDHNelsonTRBaergenRNPaiECantrellC. Imaging of placental vasculature using three-dimensional ultrasound and color power Doppler: a preliminary study. Ultrasound Obstet Gynecol. (1998) 12:45–9. doi: 10.1046/j.1469-0705.1998.12010045.xLiangJDYangPMLiangPCHuangGTSheuJCChenDS. Three-dimensional power Doppler ultrasonography for demonstrating associated arteries of hepatocellular carcinoma. J Formos Med Assoc. (2003) 102:367–74.