Applying convenience and snowball sampling, we conducted an online survey on the knowledge of and compliance with NMIBC guidelines of Chinese urologists from October 2019 to January 2021. The questionnaire link was sent via a QR code posted on several national urological specialist forums in China. Meanwhile, we requested respondents to help us disseminate the questionnaire. Information for informed consent included the statement that individual responses would remain anonymous. Respondents who were more than 65 years old or did not give informed consent were excluded. No incentive was offered for participation.

An exhaustive online literature review of NMIBC guidelines worldwide was conducted. We had appraised the quality of NMIBC guidelines within the past 5 years and compared the similarities and differences of therapeutic recommendations between guidelines previously (13). Based on this, six core interventions pertaining to the management of NMIBC were formulated, which addressed the initial transurethral resection of bladder tumor (TURBT), second resection, immediate postoperative intravesical instillation of chemotherapy, additional adjuvant intravesical chemotherapy instillations, intravesical bacillus Calmette–Guerin (BCG) immunotherapy, and radical cystectomy. After several rounds of group meetings, the draft was sent to three clinical urological experts and two methodologists for consultation to verify the face validity. Based on the valuable opinions of experts, we deleted the item of “device-assisted chemotherapy” and added the interpretation for “BCG failure.” Through these efforts, we enhanced the acceptability and clarity of the questionnaire and also improved its expression to promote understanding.

Finally, the questionnaire consisted of the following six sections: i) demographic characteristics of urologists; ii) attitude toward guidelines in general, where the information of preferred guideline developers were gathered; iii) clinical utilization of chemotherapy and BCG; iv) knowledge of guidelines, in which the knowledge score of recommendations in NMIBC guidelines was assessed by nine items, while each item scored 1 point. Regarding the indications for surgery, given that all of them were extracted from the guidelines, 1 score was divided equally among each option (for example, if there were five indications for a second TURBT, then 0.2 point was given for each indication selected); v) compliance with guidelines, which focused on the strategy of chemotherapy and BCG for patients of each risk classification (low risk, intermediate risk, and high risk); and vi) barriers in clinical practice, which involved the barriers that respondents met in the clinical practice of a second TURBT, BCG, and radical cystectomy ( Appendix 1 ). Urologists were asked to use yes/no/unsure or check choices of medical interventions to indicate whether they thought a medical intervention was recommended by guidelines or whether they would comply with it. Questions about barriers to guideline implementation were multiple choice. When asking about frequency, Likert-scale questions were adopted on a 5-point scale as never, seldom, sometimes, often, and always. Text forms were offered where extra information was needed.

Descriptive statistics were used to summarize the data, where categorical variables were expressed as counts and percentages, and continuous variables were expressed as mean and standard deviation. McNemar’s tests were used to compare the knowledge and compliance in each item. To identify characteristic factors associated with knowledge, we performed univariable and multivariable linear regressions. While univariable and multivariable logistic regressions were conducted for factors associated with compliance, Firth’s logistic regressions were applied for unbalanced event with potential complete or quasi-complete separation issue. Statistical analyses were performed using SAS software, version 9.4 TS1M6 (SAS Institute Inc., Cary, NC), and a two-sided p-value of ≤0.05 was considered statistically significant.

A total of 814 responses were received, 2 of which were excluded for overage and informed disconsent, respectively. The vast majority of respondents were working in tertiary hospitals (78.45%), had been in practice for more than 15 years (63.18%), and had a master’s degree or above (56.28%) ( Table 1 ). Although only 10.71% respondents reported having had prior experience in guideline development, most respondents (98.77%) agreed that high-quality guidelines were efficacious in improving healthcare quality, standardizing the clinical procedures and quality assurance. Respondents preferred guidelines developed by the Chinese Medical Association (CMA) (72.78%), European Association of Urology (EAU) (60.96%), and American Urological Association (AUA) (48.77%). Respondents usually referred to an average of 2.78 ( ± 1.46) NMIBC guidelines.

There were 79.25% of the respondents who reported that low-risk NMIBC patients agreed to have chemotherapy for immediate course together with maintenance course. Respondents who reported that they “often” or more frequently utilized BCG therapy for intermediate- and high-risk NMIBC patients were only 38.87% and 51.84%, respectively.

For patients from each risk classification, at least 49.32% respondents scheduled induction course of intravesical chemotherapy instillations of 4 to 8 weeks, and 47.62% or more respondents scheduled a maintenance course of 6 to 12 months ( Appendix 2 ). As for BCG, many respondents (from 42.80% to 48.14%) scheduled induction course of BCG instillations of 6 to 8 weeks, while a maintenance course of 4 weeks or more was chosen by at least 61.98% respondents. The median length of maintenance installations was 1 year. Moreover, a majority of respondents (from 76.39% to 90.21%) approved of a standard dose of BCG.

The average knowledge score of respondents was 6.10 ± 1.28 (out of a full score of 9). “The range of initial TURBT” (97.40%) and “whether to perform an immediate postoperative instillation” (96.77%) got the highest correct rate ( Table 2 ). However, for low-risk patients, only 3.97% respondents realized that further chemotherapy was not recommended, and 43.08% respondents recognized that BCG immunotherapy was also not recommended.

There were 98.39% of the respondents who tended to utilize further chemotherapy instillations for patients with low-risk NMIBC ( Table 2 ). Notably, the difference between the knowledge and compliance was statistically significant in items of further chemotherapy for low-risk patients (p _low < 0.001). For intermediate-risk patients, although BCG was widely recommended in the guidelines, the compliance rate (67.62%) was much lower than that for chemotherapy (92.99%). More respondents (89.00%) suggested further chemotherapy for high-risk patients even though it was not supported by many guidelines.

Divergence between knowledge rate and compliance rate also existed in some items of surgery indications. In a second TURBT, the compliance rate was relatively lower than knowledge rate for the indication of “after incomplete initial TURBT” (79.60% vs. 67.41%, p < 0.001), so did “pathology analysis results of initial TURBT failed to determine stage or risk grading” (60.32% vs. 55.10%, p < 0.0011).

We used multiple linear regressions to assess characteristic factors associated with knowledge score of the respondents ( Table 3 ). Knowledge scores were positively and independently associated with the number of guidelines that respondents usually referred to, and the adjusted coefficient was 0.17 (95% CI, 0.10 to 0.23), p < 0.001. Compared with bachelors, masters and PhDs were more likely to gain higher knowledge scores (B = 0.67, p < 0.001; B = 0.42, p < 0.001). Besides, respondents from the Middle may gain lower scores than those from the East and the Northeast (we combined the data of respondents from these two regions for regression analysis) (B = −0.28, p = 0.022).

Univariable and multivariable logistic regressions were performed to identify factors associated with the compliance of the respondent with guideline recommendation ( Tables 4 , 5 ). Knowledge of the recommendation was demonstrated to affect the compliance positively (p < 0.001). In some items, respondents who consulted more guidelines were more likely to comply with the guidelines, such as further chemotherapy and BCG therapy for patients with intermediate-risk NMIBC (OR = 1.32, p = 0.047; OR = 1.22, p = 0.015). However, the result of BCG therapy for low-risk patients was reversed (OR = 0.87, p = 0.034). Regarding further chemotherapy for intermediate-risk patients (OR = 0.24, p = 0.033) and BCG for high-risk patients (OR = 0.36, p = 0.016), respondents from the Middle were more likely to gain less score than those from the East and the Northeast.

There were 70.63% of the respondents who reported that “patients rejected the operation because of risk or side effects” prevented the implementation of a second TURBT in clinical practice, followed by “patients rejected the operation for economic reasons” (50.43%) and “urologist didn’t suggest it because of risk or complications” (37.55%) ( Appendix 3 ). As data about the frequency of BCG utilization and radical cystectomy in clinical practice had been collected, we excluded respondents who “usually” or “always” implemented them in barrier analysis. For barriers that hindered the implementation of BCG, “drug was not accessible” was the dominant barrier (74.89%). Besides, there were 62.22% respondents who thought “patients rejected the operation for economic reasons” “often”, “usually”, or “always” hindered the implementation. With regard to radical cystectomy, 57.73% respondents indicated that “patients rejected it because of decrease in life quality” often or more frequently hindered the implementation.

Besides, studies of similar themes or about determinants of practice were also reviewed to analyze the reason for non-compliance. After reviewing studies about compliance with the guidelines, determinants of practice, and others, we developed a flowchart to incorporate the sequence of compliance and corresponding influencing factors ( Figure 1 ) (11, 14, 15).

Guidelines need to reflect current research (16), and one out of five recommendations could be out of date after 3 years (17). CMA amended and published their guideline last October, while its previous version was published in 2014. Given that it took time for the guideline to disseminate, the CMA guideline that was familiar to respondents when filling in questionnaires might be the 2014 version. From the aspect of timeliness, it could have less credibility compared with the EAU and NCCN guidelines, which were updated every year. After all, these results show an evident preference of respondents for native guideline. A survey conducted in China explored the barriers and enablers for the implementation of guidelines, which reported that 27.3% of their respondents encountered language barriers associated with English guidelines (18). Language might be an important reason for the gap of utilization between guidelines in Chinese and non-native language. Efforts should be devoted to increase readability of guideline for non-native speakers, and to provide translated executive summaries of guidelines could be a solution. Meanwhile, it requires guideline users to build trust in non-native guidelines and improve linguistic proficiency.

In addition, the feasibility of the guidelines is crucial for urologists to determine whether to recommend the guidelines to patients in actual clinical situations. As mentioned above, although some respondents knew that “an incomplete resection” was an indication for a second TURBT in the guidelines, they would not comply with it. Two respondents indicated that there was no objective criteria for TURBT to judge whether it was “a complete resection” or not. Hence, urologists were confused with this indication when applying guidelines. To enhance feasibility, guideline developers could give a definition to “complete resection” (for example, there was no residue with the naked eyes during operation or with cystoscopy), or detail the situations for the recommendation, such as “clear visual field in operation” and “the histopathology of the tumour base was negative”.

Knowledge of guideline is an essential prerequisite for compliance (11). For patients with low-risk NMIBC, it was stated in the guidelines that a single postoperative intravesical instillation was considered to be standard and complete treatment (19), while an additional chemotherapy course did not confer benefit but increase the risk of side effects (20). Our results indicated disturbing overuse of further intravesical instillations for low-risk patients, which reveals insufficient knowledge. Moreover, we found that respondents who referred to more guidelines were more likely to comply with guideline recommendations about the utilization of BCG for low-risk patients. Reminding urologists of the need to devote more time in acquiring guideline recommendations is essential. On the other hand, educational source about guidelines needs to be developed to benefit more urologists.

We got feedback from the respondents that the capability of communication with patients is of vital importance in clinical practice, especially when persuading patients to agree to have a second TURBT, or eschew further chemotherapy installations for low-risk NMIBC. Maintaining a harmonious relationship between patients and clinicians based on mutual trust and communication was essential (12).

Furthermore, the capability and training of urologists determined whether they could implement the recommendation in practice. In the study of Witjes et al., only 17.3% of intermediate-risk patients received BCG therapy in their group, which conformed to our results (10). Under the premise of the high toxicity and treatment cessation rate of BCG, one of the various barriers to its utilization was the lack of experience and confidence in the prevention and management of BCG-associated adverse events. As the management of BCG toxicity has been expounded in the EAU guideline (19) and practical recommendations for the prevention and management of adverse events had been acknowledged, these efforts might increase knowledge and finally contribute to clinical practice.

In our study, the lack of drug accessibility was the primary barrier to the utilization of BCG. Not only some respondents reported no local supply of BCG, but also the requirements for the transportation and storage of BCG are strict, which presents a challenge to the ability of a hospital to source the medicine. Actually, BCG shortage was a global problem, especially comparing with increasing demands (21). Desouky indicated that the ongoing clinical trials using BCG against COVID-19 could aggravate the shortage and influence our urology practice (22). Under the circumstances, both the AUA and NCCN provided strategies for urologists to help mitigate the conflicts, such as using chemotherapy as a substitute in intermediate-risk NMIBC patients when BCG was second-line therapy (20, 23).

A survey conducted in Europe also reported wide overuse of additional adjuvant intravesical chemotherapy instillations for low-risk NMIBC patients (8). For patients without supporting medical knowledge, it was firmly believed that chemotherapy was an essential measure for the management of all tumors. If the tumor recurs or progresses, the urologist would be severely blamed by patients and their relatives for his “negative” attitude. Hence, medical education for patients was necessary to improve their knowledge of disease management, especially their knowledge of and confidence in the guidelines. At this point, some guidelines have included patients in their targeted users, or a specially designed patient version has been published.

Meanwhile, the financial resources of patients also influenced the implementation of recommendations. The price of BCG was much higher than chemotherapy, but it was included into the scope of reimbursement only in a few provinces of China. Our study showed that a second TURBT and radical cystectomy were also limited by the financial resource of patients. For instance, patients need to pay the cost of operation, postoperative urine collection bag, skin protection materials, and others. However, BCG therapy could achieve cost savings by decreasing the risks of local recurrence and its attendant treatments (24). A cost-effectiveness study found that the implementation of BCG intravesical therapy decreased costs by $3,900 per 5-year recurrence-free interval compared with the total costs attributable to recurrences (25).

This is the first nationwide survey on the compliance of urologists with NMIBC guidelines in China, and it reveals the reasons for non-compliance in detail. The questionnaire development and distribution were carried out under the guidance of methodological experts. Through detailed analysis, it provided reliable information for guideline developers to improve the guideline implementation. However, this study still has some limitations that have to be considered. Recall bias might exist as the results were based on the subjective feedback of urologists, especially in the self-reported barriers to guideline implementation. Respondents might overstate the impact of patients and reduce their own responsibilities in non-compliance. Meanwhile, the results might be affected by the sample size of the questionnaire as well as the unknown response rate.