European double standards for drugs and herbal medicines

The following is an interesting report of the 3-year struggle to get the European Medicines Agency (EMA) to release data on clinical trials that it was bound by European law to release. It is interesting that European agencies (such as the EMA) cite protection of drug companies commercial interest for not divulging data, while, when it comes to herbal manufacturers, they claim to “protect the consumer”. When I hear that a regulatory agency aims to “protect the consumer” alarm bells ring. (For US practitioners: the EMA is the European equivalent of the FDA.)

BMJ 2011; 342:d2686 doi: 10.1136/bmj.d2686 (Published 10 May 2011)

OPENING UP DATA AT THE EUROPEAN MEDICINES AGENCY
Peter C Gøtzsche, professor
Anders W Jurgensen, PhD student

Nordic Cochrane Centre, Rigshospitalet and University of Copenhagen, Dept 3343, Blegdamsvej 9, DK-2100 Copenhagen Ø, Denmark

Widespread selective reporting of research results means we do not know the true benefits and harms of prescribed drugs. Peter Gøtzsche and Anders Jørgensen describe their efforts to get access to unpublished trial reports from the European Medicines Agency.

Doctors cannot choose the best treatments for their patients despite the existence of hundreds of thousands of randomised trials. The main reason is that research results are being reported selectively. Comparisons of published drug trials with unpublished data available at drug regulatory agencies have shown that the benefits of drugs have been much over-rated and the harms under-rated. Comparisons of trial protocols with published papers have also shown widespread selective reporting of favourable results.

Selective reporting can have disastrous consequences. Rofecoxib (Vioxx) has probably caused about 100,000 unnecessary heart attacks in the United States alone, and class 1 antiarrhythmic drugs probably caused the premature death of about 50,000 Americans each year in the 1980s. An early trial found nine deaths among patients taking the antiarrhythmic drug and only one among those taking placebo, but it was never published because the company abandoned the drug for commercial reasons.

Allowing researchers access to unpublished trial reports submitted to drug regulatory agencies is important for public health. Such reports are very detailed and provide more reliable data than published papers, but it has been virtually impossible to get access to them. We eventually succeeded in getting access to reports held by the European Medicines Agency (EMA) after three years of trying. Our case has set an important precedent, and we summarise here the process and the arguments.

Our application for access
On 29 June 2007 we applied for access to the clinical study reports and corresponding protocols for 15 placebo controlled trials of two anti-obesity drugs, rimonabant and orlistat. The manufacturers had submitted the reports to the EMA to obtain marketing approval in the European Union. We explained that we wanted to explore the robustness of the results by adjusting for the many missing data on weight loss and to study selective publication by comparing protocols and unpublished results with those in published reports.

The information was important for patients because anti-obesity pills are controversial. The effect on weight loss in the published trials is small, and the harms are substantial. People have died from cardiac and pulmonary complications or have experienced psychiatric disturbances, including suicidal events, and most of the drugs have been deregistered for safety reasons.

A basic principle in the European Union is to allow its citizens the widest possible access to the documents its agencies possess. But there are exemptions, and the EMA refuses access if disclosure would threaten commercial interests unless there is an over-riding public interest. We argued in our first letter to the EMA that secrecy was not in the best interests of the patients because biased reporting of drug trials is common. Furthermore, we had not found any information that could compromise commercial interests in 44 trial protocols of industry initiated trials we had reviewed previously.

Protection of commercial interests
Protection of commercial interests was the EMA’s over-riding argument. It would undermine the protection of commercial interests to allow us access, it said, as the documents represented the full details of the clinical development programme and the most substantial part of the applicant’s investment. Competitors could use them as a basis for developing the same or a similar drug and gather valuable information on the long term clinical development strategy of the company to their own economic advantage.

We explained that the clinical study reports and protocols are based on well known principles that can be applied to any drug trial; that the clinical study reports describe the clinical effects of drugs; and that nothing in the EMA’s guidelines for preparation of such reports indicates that any information included in them can be considered a trade secret. The trial protocols are always sent to the clinical investigators, and it is unlikely that companies would have left in any information that could be of commercial value (such as a description of the drug synthesis). We also noted that the clinical study reports and trial protocols represent the last phase of drug development, which has been preceded by many years of preclinical development. Other companies could hardly use them as a basis for developing similar drugs. In fact, unpublished trial data are generally less positive than published ones, and competitors would therefore be less likely to start drug development if they had access to the unpublished results. Other companies are more likely to be interested in in vitro, animal, and early human studies, and drug companies have no problems with publishing such studies because the results may attract investors.

The European ombudsman, P Nikiforos Diamandouros, considered that commercial interests might be at stake but noted that the risk of an interest being undermined must be reasonably foreseeable and not purely hypothetical. He could not see that access would “specifically and actually” undermine commercial interests. He inspected the relevant reports and protocols at the EMA and concluded that the documents did not contain commercially confidential information. He therefore criticised the EMA’s refusal to grant us access.

Over-riding public interest in disclosure
Even if commercial interests were undermined by disclosure, access would still have to be granted if there was an over-riding public interest. The EMA argued that it could not identify any over-riding public interest and remarked that the evaluation of safety and efficacy of drugs is its responsibility—the EMA constantly monitors drugs and updates its assessment reports and requires changes in product information as appropriate.

We considered this insufficient. Monitoring adverse effects reported by doctors to drug agencies would not have revealed that rofecoxib causes heart attacks. Few such events are reported, and heart attacks are common in people with arthritis. Postmarketing passive surveillance systems can therefore usually not detect whether a drug leads to more heart attacks than expected; randomised trials are needed for this.

We provided more evidence of the detrimental effects of selective publication but to no avail. The EMA continued to claim that we had not documented the existence of an over-riding public interest. We noted that we could not prove this in this specific case because we were denied access to the data, but we drew attention to the fact that the total number of patients in the main clinical studies of orlistat differed according to the source of the information: published reports, the EMA’s website, and the website of the US Food and Drug Administration.

The ombudsman indicated that we had established an over-riding public interest, but he did not take a definitive stance on whether an over-riding public interest existed because this question needed answering only if disclosure undermined commercial interests. He asked the EMA to justify its position that there wasn’t an over-riding public interest, but the EMA avoided replying by saying that we had not given evidence of the existence of such an interest. We believe that we had. Furthermore, the EMA’s argument was irrelevant. A suspect asked for his alibi on the day of the crime doesn’t get off the hook by asking for someone else’s alibi.

Administrative burden
According to the EMA, the redaction of (unspecified) “personal data” would cause the EMA a disproportionate effort that would divert attention from its core business, as it would mean redacting 300,000-400,000 pages. This was surprising. The Danish Drug Agency had not seen the workload as a problem when it granted us access to the reports for the anti-obesity drug sibutramine, which was locally approved in Denmark. The 56 study reports we received comprised 14,309 pages in total, and we requested only 15 study reports from the EMA (the pivotal studies described in the European Public Assessment Reports (EPARs) on rimonabant and orlistat). The ombudsman declared that the EMA had overestimated the administrative burden involved.

Worthlessness of data after redaction
The EMA argued that, “as a result of the redaction exercise, the documents will be deprived of all the relevant information and the remaining parts of them will be worthless for the interest of the complainant.”

From what we know of clinical trial reports and protocols it struck us as odd that they would contain so much personal data that the documents became worthless. The ombudsman noted that the requested documents do not identify patients by name but by their identification and test centre numbers, and he concluded that the only personal data are those identifying the study authors and principal investigators and to redact this information would be quick and easy.

The EMA also remarked that a possible future release of the assessment reports of the EMA’s Committee for Medicinal Products for Human Use and the (co)rapporteur assessment reports “could satisfy the request of the complainants.” These reports were not available and they would have been worthless to us because they are merely summaries used for regulatory decisions.

Maladministration
The EMA was completely resistant to our arguments and those from the ombudsman. However, after the ombudsman accused the EMA of maladministration in a press release on 7 June 2010, three years after our request, the EMA reversed its stance. The EMA now gave the impression that it had favoured disclosure all the time, agreed with the ombudsman’s reasoning, and noted that the same principles would be applied for future requests for access but that it would consider the need to redact part of the documents.

The EMA’s last letter was unclear: “The Agency will do its utmost to implement its decision as quickly as possible, in any case within the next 3 months at the latest. The Agency will keep the European Ombudsman promptly informed of the exact implementation date.”

It was not clear whether the three months was the deadline for sending the reports to us, for implementing its new policy, or both. We received the data we requested from the EMA on 1 February 2011, which in some cases included individual patient data in anonymised format, identified by individual and test centre numbers.

Concluding remarks
According to the EMA’s responses to the ombudsman, the EMA put protecting the profits of the drug companies ahead of protecting the lives and welfare of patients. Moreover the EMA's position is inconsistent because it resisted requests to give access to trial data on adult patients while providing access to data on paediatric trials, in accordance with EU legislation. The Declaration of Helsinki gives authors the duty to make publicly available the results of their research on humans. The declaration also says that, “Medical research involving human subjects must . . . be based on a thorough knowledge of the scientific literature.” If the knowledge base is incomplete, patients may suffer and cannot give fully informed consent9 and research resources are wasted. The EMA should be promoting access to full information that will aid rational decision making, not impede it.

Our case sets an important precedent. On 30 November 2010 the EMA declared it would widen public access to documents, including trial reports and protocols. We recommend that the FDA and other drug regulatory agencies should follow suit. Access should be prompt—for example, within three months of the regulator’s decision—and documents should be provided in a useful format. Drug agencies should get rid of the huge paper mountains and require electronic submissions from the drug companies, including the raw data, which should also be made publicly available.