Integrated summary of effectiveness (ISE) - statistical challenges, insights & opportunities

Any single clinical study can present numerous challenges and the same can certainly be true for an Integrated Summary of Effectiveness (ISE). An ISE takes several clinical studies and pulls (or pools) them together to present a coherent and hopefully compelling story of a drug or treatment’s effectiveness. Importantly, an ISE is also considered important for explaining the differences in results between the individual studies. Why might one study have been more or less effective than another – is it because of the differences in doses between studies or perhaps the subset of the target population that was included? From a statistical perspective, an ISE might be able to answer interesting questions that not only provide a better understanding of the treatment’s efficacy overall, but the greater power of pooled analyses may offer additional insight into the nature of the treatment’s effectiveness in demographic and other subpopulations.

Continue Reading

The World is Watching - Experiences as an IDAC for a COVID-19 Study

I always feel a huge sense of responsibility when involved in an Independent Data Monitoring Committee (IDMC) in any capacity but being the Independent Data Analysis Centre (IDAC) for a  recent COVID-19 study certainly amplified those feelings greatly. PHASTAR recently successfully supported a large pharmaceutical company in their IDAC requirements for a COVID-19 study. It was an honour to be involved in such an important piece of work that already has and will continue to save many people’s lives.

Many COVID-19 studies have been set up at breakneck speed and this trial was no different. There are many very good reasons why clinical trials typically take a long time to set up. They require huge levels of detailed thinking, organisation and of course a lot of preparation. But during the pandemic, there has been an urgent need to get treatments to people as quickly as possible whilst maintaining trial integrity and not compromising subject safety. This has not been an easy task. This COVID-19 study (as I’m sure is also true with many others) also had accelerated timelines all round. Whilst a typical IDAC may be given a number of days, or even weeks to prepare the blinded and unblinded package for communication with the IDMC members, in this instance PHASTAR was given only 24 hours in which to turn the analysis around, with the IDMC meetings typically only 2-3 weeks apart.

Continue Reading

Delivering an Interim Analysis During a Pandemic from a Data Management perspective

When the World Health Organisation (WHO) declared the COVID-19 pandemic on 11th March 2020, countries the world over implemented restrictions to manage this accordingly. As well as challenges faced by people and communities around the globe, the pandemic presented unique challenges for the clinical trials community, with many existing studies being either temporarily paused and / or adapting their process. 

Interim analysis provides several options and opportunities for sponsors, including modifications of the trial design and adaptive designs, monitoring the safety of the trials with DSMB’s, post marketing surveillance and long-term follow up and monitoring if the trial is going to go ahead as originally intended (i.e. sample size). The statistical output for an Interim Analysis may include (but is not limited to) tables, figures and listings, data listings, interim study reports, IDMC and DSMB requirements. The Interim Analysis may be blinded, partially blinded, unblinded, or will use a “dummy” randomisation schedule.

Continue Reading

How FSP can increase efficiency and quality in Japan

FSP (Functional Service Provision) is fairly common in the United States and Europe, where many of the world's leading pharmaceutical and biotechnology companies are located, but the term ‘FSP’ is not yet commonplace in Japan. Furthermore, FSP is not ‘mainstream’ in China either. Japanese-based pharmaceutical companies, including foreign companies, are mainly utilising a more orthodox model of outsourced services (more commonly known as a ‘Full-Service Model’). In Japan, in-house statisticians often create statistical analysis plans and protocol statistics sections and only outsource the programming elements of their statistics-related work. In addition to this, there are many temporary staffing companies which provide personnel to companies to support their daily programming work. The US and Europe also oftentimes operate an “enhanced FSP” – building teams of high calibre technical expertise and experience, working under the direction of a technical lead. 

In Europe and the United States, FSP is already well known and well utilized. In Japan, the workforce landscape is markedly different - it is difficult to hire experienced statisticians and analysis programmers’ who are mid-career, it’s difficult to dismiss full-time employees in Japan, and it is difficult to secure hiring quotas for full-time employees. In the future, it will be possible to respond more flexibly than dispatching, as the work of clinical testing and statistical / analysis programming becomes more complicated and specialized, awareness, benefits and demand of FSP will gradually increase.

Continue Reading

A Programmer's View on IDMCs


An IDMC (sometimes known as a DMC/DMEC/DSMB) is an Independent Data Monitoring Committee, whose role it is to monitor the conduct of a clinical trial, to ensure the safety of its participants and the scientific integrity of the study. By periodically reviewing the accumulating safety, and sometimes efficacy data, the IDMC will make recommendations on the continuation and management of the study.

The IDMC is an independent committee with a Chair, made up of two or more disease-specific experts and at least one statistician. They are usually governed by an IDMC charter, which outlines their role and responsibilities, the study data to be reviewed, any stop-go criteria, and IDMC quorum and voting rights.

Continue Reading