Continuous Quality Control Monitoring Service

By: Medavante  06-Dec-2011
Keywords: Interviewing Skills, Clinical Interviewing Skills

Assessment reliability can be dramatically reduced by differing interpretations of scales and conventions as well as poor interviewing technique. This reduced reliability can have a profound effect on study power.


inter-rater reliability

and reducing rater variability can have a profound effect on both the power and sample size requirements for a study. For example, improving the

intra-class correlation coefficient (ICC)*

from 0.70 to 0.90 would increase the study power from 50% to 72%.

Traditional rater training is insufficient at best. True inter-rater reliability is rarely achieved in multi center trials. Critically, after rater training at the study outset sponsors have:

  • No visibility to the quality of patients enrolled
  • No visibility to quality of the assessments

Using MedAvante's central bank of expert trainers, sponsors can:

  1. Monitor locally administered screening and symptom-severity assessments
  2. Assess the subject based on the site interview
  3. Calibrate the site raters to the central MedAvante expert trainer cohort
  1. Site-based raters digitally record all their subject interviews through provided laptop.
  2. All the recorded interviews and source documents are uploaded to MedAvante via internet.
  3. Recorded Interviews & the source document both electronically tracked and automatically routed to a MedAvante trainer according to an algorithm agreed upon with the Sponsor.
  4. MedAvante expert trainer listens to the entire subject interview
    • Provides own score of interview scale: automated workflow program will not provide site's scores until MedAvante expert trainer enters their assessment scores.
    • Scores the site-based rater's clinical interviewing skills using the Rater Applied Performance Scale (RAPS).
  5. Provides Sponsor with the real-time Quality Scorecard & provides the site-based raters with calibrating feedback
    • MedAvante expert trainers are calibrated to provide consistent feedback to all site raters to minimize rater variability.

The remediation plan is comprised of a customized algorithm to determine the frequency and number of subject interview evaluations, level of concordance required with centralized expert trainers assessments and  comprehensive and consistent, personalized feedback to the site-based rater. This rigorous process, as defined in the MedAvante CQC Continuous Monitoring  methodology, returns substantial rewards. Other providers may provide a remote independent review but only MedAvante measures the site assessments against a single uniform world wide standard benchmark of clinical excellence.

  • To achieve this uniform benchmark, no other organization has MedAvante's on-going internal QC (20% of raters time) and rigorous quality control. If the trainers are not calibrated, they will distribute "noise" to the study.

Keywords: Clinical Interviewing Skills, Interviewing Skills,

Contact Medavante

Email - none provided

Print this page

Other products and services from Medavante


MedAvante Products & Services

Sponsors of CNS clinical trials can select precisely the level of service needed to achieve their goals for signal detection, study power, and inter-rater reliability. Toward that end, MedAvante offers four levels of service, each based on our highly precise methodology for increasing objectivity in CNS studies. MedAvante is dedicated to bringing certainty to the mental-health evaluations and assessments performed during CNS clinical trials.


MedAvante: Solutions

By applying this methodology, MedAvante overcomes the major threat to achieving signal detection: Issues with the trial assessments’ validity and reliability caused by biases and interviewer variability. An entire cohort of study raters comprised of high quality interviewers can still result in poor reliability for the study as a whole, with an attendant negative effect on study power.


Remote Centralized Ratings

MedAvante’s Remote Centralized Ratings service addresses issues of baseline score inflation and expectancy bias by providing the services of expert, clinical raters working remotely from a central location. The result for sponsors is the highest level of certainty in maximizing the value proposition for their CNS products and delivering effective therapies for treating debilitating CNS diseases.


MedAvante Patient Ascertainment

MedAvante can dramatically improve the accuracy of patient ascertainment by employing a bank of centralized calibrated expert raters to qualify patient enrollment during the initial screening process. By enrolling the right subject and accurately assessing their baseline symptom severity, MedAvante Patient Ascertainment service increases objectivity in CNS clinical trials.


MedAvante Rater ReadinessTraining

To provide the highest levels of rater training, MedAvante offers enriched Rater Readiness training, a superior approach that puts extraordinary emphasis on the rater's applied interviewing skills which is representative of real world trial conditions. The result can be greater certainty in maximizing the value proposition for CNS products and delivering effective therapies for treating debilitating CNS diseases.