I have read the well-conducted randomized controlled study (RCT) published by Wang et al., 2017 in JAMA, known as The Pregnancy Outcomes Study in Euthyroid Women with Thyroid Autoimmunity after Levothyroxine (POSTAL) study with great interest. Authors of the POSTAL study randomized 600 euthyroid women undergoing ICSI with positive anti-thyroperoxidase antibodies (TPOAb) to receive either levothyroxine or no treatment (1). Authors concluded that levothyroxine did not reduce the rate of miscarriage or improve the rates of pregnancy and livebirth.

While reading this interesting RCT, I have identified some concerns that may make the transparency and trustworthiness of the POSTAL study questionable. To assess and address my concerns systematically, I used the Trustworthiness in Randomised Clinical Trials (TRACT) checklist (2).

TRACT checklist has 7 domains with 19 items that are applicable to check trustworthiness of any RCT in medical research (2). These domains are governance, author group, plausibility of intervention usage, timeframe, drop-out rates, baseline characteristics, and outcomes. The items of checklist were rated as either ‘‘no concern’’, ‘‘some concern/no information’’, or ‘‘major concern”. Rating the overall risk of integrity to either low, moderate or high risk depends on the number of domains with concerns.

To re-calculate p-values of summary data of baseline characteristics, ANOVA method was used (3). This method was recommended by many experienced sleuths and TRACT checklist developers (2, 3). To ensure and verify the findings, summery data was sent to an independent statistician to perform the Monte Carlo simulations test, as previously described (4).

The Chinese Clinical Trial Registry (ChiCTR-TRC-13004097) was searched to identify the time of registration. I also searched for any explanation in the final report about any reason or problem declared by the authors that could hinder the process of prospective registration.

To identify retracted studies of author group, I searched Retraction Watch Database and PubMed using each author’s name and institution. I searched PubMed and Embase using the registry number to identify any other presentation of the same RCT and reviewed methods and results for consistency.

Using TRACT checklist (2), five concerns were identified in 5 domains out of seven. Details of the formal assessment using TRACT checklist of the POSTAL study are available online (5). The concerns are summarized as follows:

Results from the POSTAL study are warranted to resolve the debate about the effect of positive TPOAb in euthyroid women undergoing IVF-ET on spontaneous miscarriage and clinical outcomes, showing that treatment of Levothyroxine is with no benefit (1). The authors recruited large sample size of patients through a rigorous study design to inform the current practice with valuable insights and conclusions. However, it is crucial to incorporate research integrity screening of RCTs into evidence synthesis to ensure adequate reporting of results and rigorous methodology without significant compromised integrity (9). Formal assessment of the integrity of POSTAL study using the TRACT checklist has identified major concerns regarding retrospective trial registration, baseline imbalances, inappropriate data reporting and timeline discrepancies. These major and multiple concerns in most domains indicate that the overall integrity risk level of the POSTAL study is high, marking it as suspicious.

Compromised RCT integrity puts the patients at risk of receiving ineffective or harmful treatment. Post-publication raised here should be addressed to avoid any potential contamination of the evidence and to ensure the safety of patients (10). The investigators should show a willingness to address these post-publication concerns and share the raw data in a public repository (11). Given that the raised concerns are serious, journals, publishers and institutions have an ethical obligation to the community to go through investigations (11).

The widespread belief that publishing RCTs in high-ranked journals is a marker of trustworthiness is no longer guaranteed. Concerns in this commentary showed that even RCTs published in top ranked journals suffer major challenges regarding inadequate trial registration and inappropriate reporting. Despite the efforts, adherence to ethical obligations of prospective registration and reporting related to ethics and consent remain inadequate (12, 13). The present concerns emphasize the need to ensure stringent governance through harmonizing the process of ethical approval worldwide and linking it to obligatory prospective registration (14).

Inaccuracies and inconsistencies in data reporting presented here are alarming. These concerns emphasize the need for more efforts to promote accurate and transparent reporting of RCTs. Strict adherence to international guidelines and recommendations and deployment of reporting checklists (e.g. CONSORT, GRIPP, etc.) is crucial to avoid inappropriate reporting and ensure transparency and openness (15, 16).

In conclusion, inadequacies in prospective registration and reporting related to ethics remain major challenges in medical research integrity. These inadequacies highlight the greater need for improvement areas in clinical trials including standardization of stringent governance and adherence to reporting guidelines and recommendations to safeguard the integrity of RCTs.