Response from author of "The ADVANTAGE Seeding Trial"

In response to my earlier post "Merck scientific debate hits bottom" I received the following from one of the authors of the VIOXX seeding trial paper The ADVANTAGE Seeding Trial: A Review Of Internal Documents, Ann Intern Med 2008", Dr. David Egilman, MD, MPH.

I posted Dr. Egilman's opinions below at his request. My own thoughts follow.

Dr. Egilman also posted numerous documents to and from Merck's lawyer at this link. (The tone of some of those documents towards Dr. Egilman is particularly disturbing, such as the one here.)

------------------------------------------------------

From: David Egilman, MD, MPH
To: Healthcare Renewal

I am one of the authors of the "Seeding" paper.

Merck executive Dr. Jonathan M. Edelman, Executive director, Global Center for Scientific Affairs wrote:

There's no doubt that the ADVANTAGE clinical trial had a legitimate scientific purpose. That purpose was to assess the gastrointestinal tolerability of VIOXX compared to naproxen – a commonly used arthritis medicine with known tolerability problems – in the treatment of patients with osteoarthritis in a primary care setting, and for the first time allowed patients taking concomitant aspirin to participate.

Dr. Edelman's claim that ADVANTAGE was the first trial that permitted aspirin use with Vioxx is incorrect. Study 058, which was part of Merck's application for new drug approval submitted in November 1998, permitted the use of up to 325 mg of aspirin per day. ADVANTAGE only permitted up to 100 mg per day. Study 058 was a 30 week trial. ADVANTAGE was only a 12 week trial. Study 058 involved patients older than 80, comparing Vioxx to namebutone (another NSAID) and was completed in April 1998, about 10 months before ADVANTAGE enrolled a single patient. Study 078, the ghost-written Alzheimer’s trial also permitted aspirin, began in April 1998 and was scheduled to be completed by April 2000 before the end of the ADVANTAGE trial. More patients took low dose aspirin in the Vigor trial than the Advantage trial.

Further, ADVANTAGE was not designed to test the effect of aspirin on anything. Although aspirin was permitted, the examination of aspirin effects was not included as part of the study objective which Merck described: "[t]o assess the tolerability of rofecoxib (VIOXX) compared with naproxen for treatment of osteoarthritis." On the other hand, Merck Study 136 was designed to test the effects of concomitant aspirin and NSAID use. This study revealed that Vioxx offered no GI protection to low dose aspirin users who constituted the majority of potential Vioxx users.

By November 1998, when Merck sought FDA approval for an OA indication and three months before the ADVANTAGE trial enrolled any patients, Merck had already informed the FDA it had sufficient studies to prove Vioxx was efficacious for osteoarthritis patients. Merck's osteoarthritis trials (that it used to get FDA approval for use of VIOXX in osteoarthritis patients) had compared Vioxx to 3 other NSAIDS. The VIGOR trial, which tested Vioxx and naproxen in rheumatoid arthritis patients, started at the same time as ADAVANTAGE and used twice the dose of Vioxx than was used in ADVANTAGE. VIGOR was, therefore, a more valid scientific trial to determine relative safety of the two drugs.

This request for and subsequent approval meant that Merck could claim VIOXX was as effective for pain as naproxen. Beginning long before the Advantage trial Merck claimed Vioxx was safer than all NSIADS including naproxen.

While ADVANTAGE was the first study that compared Vioxx to naproxen in OA patients, Merck had completed trials comparing the two drugs in other pain patients.

It is for these reasons that the President of Merck Research Laboratories (MRL) Dr. Scolnick characterized ADVANTAGE as "intellectually redundant."

Merck wrote:

ADVANTAGE was a double-blind, randomized, controlled clinical trial with a legitimate scientific purpose designed to answer previously unanswered questions about the use of VIOXX in osteoarthritis in a primary care setting. It was not a seeding study.

Merck’s personnel called it a seeding trial internally but in an apparent effort to hide its true purpose wrote:

“I eliminated the reference to seeding. It may be a seeding study, but let’s not call it that in our internal documents.”

Merck apparently tried to make it look like a typical science-based clinical trial to mislead IRBs and journals. All seeding trials make some claim to some usually trivial scientific purpose. For example the question of whether or not Vioxx works better on people as a function of height is a scientific question. It is of course a trivial question. In this case Merck had studies that compared Vioxx to naproxen for pain control before the Advantage trial had started. Merck also had a larger trial that tested GI toxicity.

Merck wrote:

ADVANTAGE was important because although the earlier VIOXX clinical trial program provided extensive data on efficacy and safety, it did not include naproxen as a comparison Medication.

This is not correct. Merck had a study that compared Vioxx to naproxen for pain control before the Advantage trial started. This was presented to the FDA in the original New Drug Application and was published in October 1999.

Merck wrote:

The ADVANTAGE clinical trial was designed, conducted, analyzed, interpreted and published by the scientific department of Merck's U.S. Human Health (USHH) organization, Clinical Development (CDP), in conjunction with participating investigators. CDP was part of the Medical and Scientific Affairs department of USHH and was separate from the marketing department within USHH.

A more complete picture is:

USHH was the marketing division of Merck. It included sub-divisions including sales, marketing and a medical/scientific group called CDP. CDP performed “medical” studies that could be used by marketing to increase product sales. These studies were only conducted if favorable results could increase sales. They were not done to obtain new indications for drug use and Merck did not publish or provide the FDA with some of these studies (example 106).

Mr. David Anstice, a marketing executive with no apparent scientific training or background was the President of Merck's USHH division. In contrast Dr. Edward Scolnick, a physician/scientist of international renown, was the President of Merck’s research division which was called Merck Research Laboratories. Mr. Anstice the person ultimately responsible for the Advantage trial testified:

Q. I understand that. All I'm saying is, this is the study [Advantage trial] that was initiated and conducted by marketing, right?
A. Yes, by doctors in marketing.

A picture being worth a 1000 words I provide the Merck graphic for the organization of the Advantage trial:



Here is the power point description of marketing’s role in the Advantage trial:



While the marketing division of USHH set the study “objectives” CDP was in charge of the technical aspects of study implementation.

Further proof that ADVANTAGE served little scientific purpose is the fact that Merck had already claimed that Vioxx was safer than and as effective as all NSAIDS including naproxen prior to the initiation of the ADVANTAGE.

Merck did not rely on any ADVANTAGE results to make any claim about Vioxx efficacy or safety to the FDA. The lack of scientific purpose behind ADVANTAGE is demonstrated by the fact that Merck had withheld the ADVANTAGE results from its application to the FDA that requested a label change that would allow them to claim Vioxx was safer than naproxen. Merck only produced the results after the FDA made numerous oral and written requests for the safety data discovered during the trial.

Merck claims Advantage produced important scientific information:

In the end, ADVANTAGE showed a different gastrointestinal profile between VIOXX and naproxen that was unaffected by concomitant use of aspirin. This was an important medical result for physicians. In addition to measuring the GI tolerability of VIOXX, investigators also monitored patients for adverse events, which were required to be submitted to the FDA. Therefore, in ADVANTAGE, Merck was further evaluating any potential risks of VIOXX.

In fact the trial that Merck performed to test the effect of concomitant aspirin and Vioxx use (136) showed that aspirin use thwarted Vioxx’s GI advantage. (Gastroenterology. 2004 Aug;127(2):395-402.) The conclusion Merck reached based on the Advantage result was wrong precisely because Advantage was not designed to test this question. This conclusion was based on data mining.

Merck wrote:

We also want to underscore that the scientific purpose of ADVANTAGE was properly disclosed to physicians-investigators, participants, and institutional review boards, and Merck's business interests were clearly understood.

Merck never disclosed the marketing purpose of the trial which included the fact that Marketing “set objectives.”

Merck accuses the authors of "bias.”

In this open letter to the editors of The Annals of Internal Medicine, Merck would like to put in perspective the latest article by four authors who served as paid consultants to plaintiffs' lawyers in the VIOXX litigation against Merck. We are troubled by the biased article, which contains numerous inaccuracies, and wonder about the motivation behind this attack on Merck's scientific excellence and integrity.

Merck writes that the authors were “plaintiff witnesses” and “cherry picked” documents. As far as I know, all litigation ended about a year ago. None of the authors were paid on a contingency basis, the authors received no compensation from plaintiffs to work on the papers we have written and none of the authors are working on any Vioxx litigation at this time.

If money motivation equates to bias then it is Merck and its representatives who suffer from this problem. The same cannot be said of Merck or its representatives because while the authors have nothing to gain Merck’s future earnings depend, in some measure, on its reputation for honesty.

Merck does not explain how any theoretical bias impacted on the paper. They have not come forward with contradictory documents or testimony.

The authors agree that all the documents should be made public so readers can decide for themselves if we “cherry picked.” Merck, and Merck alone, continues to block the release of the documents.

Merck would not allow us to cite documents that showed that Advantage investigators were accused of fraud and at least one was convicted. Some of this data was deleted from the published paper but readers and editors were never informed of these problems.

It should be noted that eight Vioxx patients had heart attacks during the ADVANTAGE trial compared to one patient on naproxen. Merck never informed any of these patient volunteers of the cardiovascular risks of Vioxx before or after the trial although the informed consent stated that Merck would pay for treatment of drug related side effects. Unfortunately for some, this would have been funeral costs.

Merck wrote:

It is unfortunate that the authors and journal editors chose not to contact Merck before finalizing these publications. Had any of these individuals contacted Merck, factual errors could have been avoided.

I contacted Merck's main trial lawyer Ted Mayer and provided Merck an opportunity to comment on another paper related to the Advantage trial before it was submitted for publication. I did not send a pre-publication copy to plaintiff lawyers. Mr. Mayer provided comments and i included his comments in the final version.

Merck then complained about my contact to Mr. Mayer to Judge Higbee and requested that she sanction me for contacting their lawyer and then insisted that I make no further contact with them.

-- David Egilman

-----------------------------------------

My own thoughts on all of this are as follows:

The lessons of the Annals article are clear. The scientific community and the public are simply fed up with cavalier practices in the biomedical industry. While the article may affect remaining VIOXX litigation as pointed out here, it also should have an necessary "cleansing effect" on drug R&D.

It was not clinicians and scientists outside the industry who earned it the public's animosity. It was, and continues to be, the industry itself. As Roy Poses observed, there cannot be evidence based medicine if the evidence is distorted by commercial zealotry. I think the public recognizes this.

Further, marketing personnel have no place in pre-approval, pre-marketing scientific studies such as clinical trials. If they have a scientific role, it is perhaps in post-marketing studies, especially post-marketing surveillance for adverse effects. The latter is a function the pharma industry performs poorly.

Even in that latter domain, there must be honesty and transparency, characteristics with which the biases of marketing and its leaders (e.g., towards maximizing sales) may interfere.

Merck's responses to this new Annals article seem the antithesis of science. Instead, the responses appear to be right out of the political and legal warfare playbook (where logical argument prevails - except when presenting logical fallacy is to the advantage of the protagonists) ...

The response has been this:

• ignore the arguments and evidence [in this case, emails and documents from Merck itself],
  
• issue an ad hominem attack,
  
• issue slogans ("litigation in the name of science"),
  
• present a Red Herring as a distraction,
  
• issue accusations of bias,
  
• issue accusations of cherry picking,
  
• issue accusations of the authors taking evidence "out of context", etc.

and finally:

• produce no context or new evidence of your own, hoping the above tactics will make that unnecessary.
  

All that's seemingly missing are ... puppets.

Merck seems to expect the "courtesy" of being allowed to be a participant in any issues written about its conduct, as if the authors of this paper are its employees who under employment policies must permit any pubs they produce to be reviewed internally for approval. I believe the company's executives forget that their authority ends at the front gate.

It is also an odd and even arrogant request, especially considering the way the authors' evidence (Merck's own emails and documents) was essentially ignored in the responses, and the insinuations promulgated against the authors as serving plaintiff's lawyers -- which also implies that scientific integrity and the interest of patients is not their motivation.

As I mentioned in my earlier post, this is classic ad hominem and is insulting to authors in my opinion, as well as insulting to any clinician or scientist. Why would anyone want to provide a company that acts in this manner the courtesy of pre-publication involvement in investigative journalism?

Another issue I find interesting is noted in the limitations section of the paper where it is stated that:

... we did not identify, despite an exhaustive and systematic search strategy, documents detailing discussions between the marketing and research divisions, nor could we identify documents describing contracts between Merck and collaborating companies.

As well as the Annals editor's obervations that:

... despite the large body of documents searched by the authors, they discovered few details about exactly how Merck's marketing division carried out ADVANTAGE.

This is surprising. From an information science standpoint, it would not be unreasonable to believe there might be more related to this trial of a major drug in emails or powerpoints or other documents. This document sparsity could mean that the documents did not exist, but it also raises a speculative question about the document corpus produced in Discovery.

Could "inconvenient documents" have selectively been eliminated from the corpus of documents before it was released, and therefore not be present in the corpus of documents the authors searched? Could the documents the authors did find represent ones that were "missed" by some weeding out effort?

Finally, I believe the entire tenor of Merck's responses - ignoring evidence, stating the trial was "published in a peer reviewed journal" as a Red Herring and a justification of its legitimacy while ignoring Sox & Rennie's (the Annals editors) accompanying commentary Seeding Trials: Just Say "No" , belitting the authors, etc. - is very disturbing.

From "Seeding Trials: Just Say No":

No one told Annals the true purpose of ADVANTAGE. We learned about it when we received a letter to the editor from Dr. David Egilman, who was a consultant to the plaintiffs' attorneys in the civil suits against Merck. He had access to publicly accessible trial documents, which included Merck employees' e-mail messages that disclosed the true intent of the ADVANTAGE trial ... The article provides clear evidence that the intent of ADVANTAGE was to increase prescriptions of Vioxx (the study outcome of greatest interest to Merck seems to have been Vioxx prescribing rates) ... The documents do tell us that deception is the key to a successful seeding trial.

When I review NIH grant applications, if I suspect deception I will mention it to the study section leaders, and I can assure that if deception is verified higher up the chain, that application will not get funded (at the very least). I can also assure that legitimate medical journals do not willingly publish studies involving deception.

Merck's responses to the Annals article seem to represent a belief that the public (laypeople and physicians) are stupid and gullible.

This is not science, and is not a path to a return to the corporate greatness and respect that Merck once enjoyed and had earned.

Finally, a Red Herring of my own:



-- SS

Merck scientific debate hits bottom, keeps digging?

I find Merck Scientific Affairs executive Jonathan Edelman's op ed in today's Philadelphia Inquirer on the Vioxx "ADVANTAGE seeding trial" controversy to be mediocre spin control at best, if not deliberately misleading through selective omission of critical facts:

Taking Exception
Great value in clinical studies
Philadelphia Inquirer, Sept. 26, 2008

Your articles "Merck faces more criticism" (Inquirer, Aug. 19) and "Journal vs. the bad seed" (Aug. 20) drew the wrong conclusion.

The Advantage study was published by the Annals of Internal Medicine in 2003 after passing the journal's editorial and peer-review process that determined the study to be important new information for physicians. Dr. Harold Sox recently wrote in Annals that the way to identify a good clinical trial is to look at the importance of the scientific question it tries to answer.

This is the very same criterion that Annals and other medical journals use to select the studies that they publish and that Annals correctly applied in accepting the Advantage study five years ago.

Advantage was a randomized, controlled trial designed to address the scientific concerns of physicians, namely: the need to study Vioxx in osteoarthritis patients in the primary-care setting, in real-world conditions, and against a commonly used arthritis medicine, naproxen.

We are troubled by how easily the journal editors were persuaded by the conclusions of authors who were paid consultants to trial lawyers standing to profit from litigation.

[i.e., Hill et al, authors of the article "The ADVANTAGE Seeding Trial: A Review Of Internal Documents." Ann Intern Med 2008; 149:251-258 - ed.]

There is great value in conducting scientifically based clinical studies to address unanswered questions. We believe we acted appropriately in the Advantage trial, and stand behind our unwavering commitment to ethical conduct and scientific integrity.

Dr. Jonathan M. Edelman
Executive director
Global Center for Scientific Affairs
Merck Research Laboratories
Upper Gwynedd

The bulk of this op-ed, in fact, consists of a Red Herring and an Ad Hominem attack.

First, the Red Herring. The controversy is not about what the Annals published in 2003, it is not whether the science in the ADVANTAGE study was itself "good" in isolation of contextual (e.g., ethics and social policy) issues.

It is about what was written in the Annals in 2008, and the controversy over performing ADVANTAGE and other seeding trials, period -- which David Gorski at Science-Based Medicine so aptly describes as suffering from (at least) one major flaw, inherent deception:

... To boil it all down, here’s my perspective on why seeding trials such as this are inherently unethical, regardless of whether the clinical scientific question under study is worthy or the design of the trial can produce an answer to that scientific question. It all comes down to one issue: Deception. There is no way to carry out a seeding trial without deceiving virtually everyone involved below the level of study designers.

But I digress. Deception aside, it was not the words or the interpretations of the Annals 2008 authors that the ADVANTAGE trials were of questionable scientific value ...

Those words came from the head of Merck's own R&D division himself. The 2008 Annals authors are reporting the words of Merck's erstwhile head of R&D. Yet, Dr. Edelman failed to mention that highly important issue, as if it was irrelevant or immaterial. Politicians and biased journalists do this all the time - omit critical details to spin a story. It's one of the principles of effective propaganda.

From a physician/scientist, however, we expect better.

(I also note that Merck and other pharmas generally require careful vetting of materials released for publication. I assume the Edelman Inquirer op ed underwent internal peer review.)

From the New York Times:

In e-mail messages on April 7, 2001, to ... an executive vice president at Merck Research Laboratories, [President of Merck Research Labs] Dr. [Edward] Scolnick wrote that he was especially angry because the Advantage trial had no scientific purpose. In theory, Merck set up the trial to show that Vioxx caused fewer stomach problems than naproxen. But Merck had already demonstrated that with the Vigor trial, which tracked more than 8,000 patients for a year.

In pharma, the president of the research labs is usually considered "god" as far as new drugs are concerned. It was pointed out that Dr. Scolnick, largely seen as the #2 official in the company, worried that the ADVANTAGE study risked disclosing data to the Food and Drug Administration that could cause problems for Vioxx.

... [T]he reason we have resisted doing large marketing clinical studies is just this. It opens a lot of data to FDA that compromises the large clinically meaningful trials." Small marketing studies which are intellectually redundant are extremely dangerous," Scolnick wrote.

I find these statements by Merck's former head of R&D quite remarkable for many reasons, some stated in my earlier post here. In fact I completed several assignments for Dr. Scolnick and can state emphaically he was not someone easily challenged on scientific matters. He knew his stuff.

Dr. Edelman also omitted the following salient fact seen in the Annals editorial by Harold C. Sox, MD, Editor of Annals of Internal Medicine, and Drummond Rennie, MD:

No one told Annals the true purpose of ADVANTAGE. We learned about it when we received a letter to the editor from Dr. David Egilman, who was a consultant to the plaintiffs’ attorneys in the civil suits against Merck. He had access to publicly accessible trial documents, which included Merck employees’ e-mail messages that disclosed the true intent of the ADVANTAGE trial.

I note that it's unfortunate the Annals editors in 2003 did not have access to these remarkable statements and documents. This information, in fact, only saw the light of day due to the VIOXX litigation. I doubt Annals would have published in 2003 with such knowledge.

Now to the Ad Hominem in Dr. Edelman's op ed.

I find the Ad Hominem attack ("against the person") on the 2008 Annals authors, Drs. Hill, Ross, Egilman & Krumholz, disappointing (they were "paid consultants to trial lawyers standing to profit").

So what?

That is useless information in the context of their current article.

In an ad hominem attack, the character or circumstances of a person making a claim, or their actions, are impugned. This attack is taken to be evidence against the claim or argument the person in question is making or presenting.

This is an exceptionally poor form of argumentation, especially considering the current Annals article was based on an "informational infrastructure" consisting of plain-English emails and documents written by Merck officials themselves. They are available for examination at this link.

These documents, provided by the company itself under rules of legal discovery, do not appear to be taken "out of context" in any way. They appear to stand on their own merits.

The reason why an Ad Hominem (of any kind) is a fallacy is that the character, circumstances, or actions of a person do not in most cases have a bearing on the truth or falsity of the claim being made or the quality of the argument being made.

(The above explanation is from the Nizkor Project page on ad hominem attack, link. In the final example of ad hominem on the Nizkor page, substitute "lackey to the trial lawyers" for "lackey to the Pope" to better visualize just how outrageous the attack on the Annals authors is.)

Is this is the state of the art for Merck scientific debate, I ask?

If so, the company's leadership is in its ripe old age, dementia fast approaching.

If pharma wants to re-establish its credibility with physicians and patients, among others, it needs to start acting more like a concerned physician than a furiously spinning politician trying to "control the narrative."

Finally, as numerous examples on Healthcare Renewal demonstrate, there are those in prominent leadership positions in healthcare who never learned basic rules of logical thought or argumentation yet claim to proffer scientific or ethical truths, or selectively "forget" logic to advance their own agendas. At this point, I have no qualms about calling such people scoundrels.

Addendum:

I note the statement by Dr. Edelman in the Annals comments site at this link ("Merck does say no") that the 2008 Annals article by Hill et al constitutes "litigation in the name of science."

I'd opine that the article more resembles a rather straightforward exposé of probable smoking-gun internal emails and documents in the defense of science. "Investigative journalism" is an apt description.

As Roy Poses pointed out in the comments, evidence based medicine is impossible when the science is tainted in the name of commerce.

-- SS