• Biospecimen SolutionsPrecision Value & HealthCareers
    P_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGB
    • Clinical
      Trial Services
        • Overview
            • Oncology Clinical TrialsImage

              Oncology Clinical Trials


              Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

              • Rare & Orphan DiseaseImage

                Rare & Orphan Disease


                With experience built on 150+ orphan disease projects covering 80+ rare diseases, we know how to anticipate logistical and regulatory obstacles and craft bold solutions that drive rare disease development programs.

        • Global Clinical Trial Support –
            • North & South America –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Europe –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • APAC –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

        • Clinical Trial Management –
            • Study Start-up & Feasibility –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Project Management –
            • Patient Recruitment –
            • Personalized Clinical Trial Operations –
            • Biometrics –
            • Medical & Safety Monitoring –
            • Clinical Data Management –
            • Medical Writing –
        • Clinical Development Strategy –
            • Clinical Development Planning –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Biomarker Strategies –
            • Cell & Gene Therapy Strategies –
            • CDx Regulatory and Market Access –
        • Clinical Trial Design –
            • Basket & Umbrella Trials –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Biomarker Clinical Trials –
            • Master Protocol Trials –
            • Decentralized Clinical Trials
        • Biostatistics –
            • Statistical Consulting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Study Design –
            • Data Monitoring Committees –
            • CDISC Programming and Documentation –
            • eCTD Submissions –
        • Central Lab Services –
            • Clinical Specimen Kitting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Sample Processing –
            • Global Specimen Logistics and Biostorage –
            • Biospecimen Data Services –
            • Precision Lab e-Portal –
            • Virtual Sample Inventory Management –
        • Training
            • Oncology Clinical TrialsImage

              Oncology Clinical Trials


              Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

              • Rare & Orphan DiseaseImage

                Rare & Orphan Disease


                With experience built on 150+ orphan disease projects covering 80+ rare diseases, we know how to anticipate logistical and regulatory obstacles and craft bold solutions that drive rare disease development programs.

    • Lab
      Services
        • Central Lab Services –
            • Clinical Specimen Kitting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Sample Processing –
            • Global Specimen Logistics and Biostorage –
            • Biospecimen Data Services –
            • Precision Lab e-Portal –
            • Virtual Sample Inventory Management –
        • Specialty Lab Services Overview –
            • Immune MonitoringImage

              Immune Monitoring


              Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

              • Tissue & Liquid BiopsyImage

                Tissue and Liquid Biopsy


                Obtain a detailed molecular view into patient biology with a range of tissue and liquid biopsy technologies, including our proprietary ApoStream platform which can isolate and enrich circulating tumor cells for downstream analysis.

        • EU Contract Research Organization –
        • Immune Monitoring –
            • Immune Monitoring by Flow Cytometry –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • Immune Cell Phenotyping by Epiontis ID –
            • Cytokine Profiling –
            • Gene Expression Profiling –
            • ELISpot and FluoroSpot –
            • Custom Assays –
        • Flow Cytometry –
            • Immune MonitoringImage

              Immune Monitoring


              Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

              • Tissue & Liquid BiopsyImage

                Tissue and Liquid Biopsy


                Obtain a detailed molecular view into patient biology with a range of tissue and liquid biopsy technologies, including our proprietary ApoStream platform which can isolate and enrich circulating tumor cells for downstream analysis.

        • Genomics –
            • NanoString Assays –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • ddPCR –
            • qPCR –
            • NGS –
            • Fluorescence In Situ Hybridisation (FISH) / ISH –
        • Tissue & Liquid Biopsy –
            • ApoStream – CTC and Rare Cell Isolation for Liquid Biopsy
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • CTC / cfDNA / Exosome Analysis –
            • Multiplex Immunofluorescence –
            • Immunohistochemistry –
            • Fluorescence In Situ Hybridisation (FISH) / ISH
            • Pathology Services –
            • NanoString Assays
        • Bioanalytical Testing –
            • Immunogenicity Testing –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • PK Assays –
            • ADA Assays –
            • MesoScale Discovery (MSD) Assays –
            • Quanterix SIMOA –
            • ELISA
        • Cytokine Analysis –
            • ELISA –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • MesoScale Discovery (MSD) Assays
            • Luminex –
            • Quanterix SIMOA
        • Preclinical Target and Biomarker Validation –
            • Cell Based Assays –
            • Target Expression – XpressWay Profiles –
            • Tissue Cross-Reactivity –
            • Fluorescence In Situ Hybridisation (FISH) / ISH –
            • Multiplex Immunofluorescence –
            • Immunohistochemistry (IHC)
        • Biospecimens
            • Immune MonitoringImage

              Immune Monitoring


              Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

              • Tissue & Liquid BiopsyImage

                Tissue and Liquid Biopsy


                Obtain a detailed molecular view into patient biology with a range of tissue and liquid biopsy technologies, including our proprietary ApoStream platform which can isolate and enrich circulating tumor cells for downstream analysis.

    • Data
      Sciences
        • Overview
            • BiostatisticsImage

              Biostatistics


              Seasoned biostatisticians and statistical programmers support every phase of your trial, from study design for small, rare disease trials to regulatory submissions, all backed by meticulous documentation.

              • Computational BiologyImage

                Computational Biology


                Domain experts from our QuartzBio team utilize integrated and harmonized data and tailored AI solutions to drive preclinical and clinical development, including patient stratification, signature development, predictive modeling of drug response, and MOA characterization.

        • Biostatistics
        • Clinical Data Management
        • Biometrics
        • QuartzBio –
            • Biomarker Data Management –
              • BiostatisticsImage

                Biostatistics


                Seasoned biostatisticians and statistical programmers support every phase of your trial, from study design for small, rare disease trials to regulatory submissions, all backed by meticulous documentation.

            • Virtual Sample Inventory Management –
    • Diagnostics
      & CDx
        • IVD and CDx Regulatory Affairs Consulting –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • COVID-19 & Viral Panel Assays –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • Biospecimens Solutions 
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • Diagnostic Market Access Services –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

    • Therapeutic
      Areas
        • Overview
            • By Specialty Area
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • Oncology and Immuno-Oncology
              • Oncology Clinical Trials
            • Rare & Orphan Disease
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • Cell & Gene Therapy
              • Cell Therapy
              • Gene Therapy
              • Cell and Gene Therapy Manufacturing
            • CNS & Neuroscience
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • COVID-19
            • AutoImmune & Allergy
            • Pediatric
            • Companion Diagnostics
        • By Research Phase
        • Preclinical Development –
        • Early Phase Trials (I-IIa) –
        • Late Phase Trials (IIb-III) –
    • News &
      Insights
        • Blog –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

        • Resources –
        • Thought Leadership –
        • News –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

        • Events –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

    • About
      Us
        • Our Passion –
            • Patient RecruitmentImage

              Our Passion


              What we do, why we do it and the principles that guide us every day.

              • meet-our-peopleImage

                Meet Our People


                We are devoted professionals with deep expertise in translational science, clinical trials and data sciences.

        • Meet Our People –
        • Careers
        • Regulatory Information –
            • Patient RecruitmentImage

              Our Passion


              What we do, why we do it and the principles that guide us every day.

              • meet-our-peopleImage

                Meet Our People


                We are devoted professionals with deep expertise in translational science, clinical trials and data sciences.

    • Contact
      Us
    • Home
    • Effectively Managing Rater Training and Consistency in CNS Trials

    Effectively Managing Rater Training and Consistency in CNS Trials

    by Saoussen Brun, Sabrina Buzzerd on November 9, 2022 — 5 minute read

    Rigorous study-wide training and centralized rater monitoring help to minimize subjectivity

    The failure rate of central nervous system (CNS) clinical trials is high, with less than 27 percent of studies successfully transitioning out of phase 2 studies.1 The major causes of CNS trial failure are the placebo response, medication adherence, and reliance on subjective endpoints such as pain or psychiatric rating scales. CNS studies rely heavily on ratings accuracy to demonstrate the efficacy and safety of investigational drugs, but subjectivity and rater consistency are often overlooked.

    Challenges to rater consistency

    Standardizing rater assessments is essential for reducing ratings variability across sites and studies. However, there are numerous challenges to rater consistency:

    • Variability in skill, training and consistency among raters
    • Country-to-country differences in common rating scales and diagnostic practices
    • Differences among scales that are commonly used in clinical practice and those used in clinical trials
    • Diverse cultural and language needs that may impact accurate administration of rating scales

    In addition, there is a misconception among many sponsors that raters do not require study-specific training. Moreover, site investigators may not be accustomed to standardizing assessments in a clinical trial context.

    3 Strategies for improving rater consistency and minimizing subjectivity

    CNS trials often involve multiple complex scales and outcomes measures, and protocols may even require separate raters for safety and efficacy assessments. Signal detection depends on rating consistency and accuracy, among individual raters and study sites.

    1. Standardized, study-wide rater training

    There is currently no accepted standard for selecting and training raters to administer scales in CNS trials, and raters may vary widely in their prior training and certification. Without standardized training, raters may use different assessment or interview methodologies across clinical trial participants, study visits, or scales. Developing and delivering a structured rater training program at the outset of a study, with periodic retraining throughout the duration of the trial, can help to address this variability.

    This study-specific, protocol-customized program should include a didactic component on the disease process, assessment procedures, and scoring conventions and an applied or practical component. Incorporating the use of structured interviews, where all raters ask the same questions in the same manner across all sites and during every study assessment, helps ensure both intra- and inter-rater reliability. Structured interviews also help maintain rater neutrality and minimize inadvertent expectation setting. As part of the training program, it may also be useful to establish minimum rater qualifications, based on experience with the administration of the rating scale(s) required for the study. Rigorous training helps increase study-wide consistency, leading to accurate, reproducible data.

    It may also be useful to develop training courses that help patients improve their ability to accurately and consistently self-report pain. An added benefit of patient training is that it may mitigate the placebo response.

    2. Centralized rater programs

    Sponsors may also consider utilizing a centralized rater program, where assessments are performed remotely via phone or video conference by a cohort of experienced, calibrated raters. With remote assessments, raters are subject to fewer biases as they are not privy to details of the study or the patient’s clinical history. Centralized rater programs also help reduce site and patient burden, which may help to accelerate study startup and enrollment.

    Another advantage of centralized rater programs is increased clinical trial access for both sites and patients. The use of remote raters enables sites that might not otherwise have qualified rater resources to participate in CNS studies, expanding the pool of eligible patients and enhancing clinical trial diversity and equity.

    3. Centralized rater monitoring

    Centralized rater monitoring or rater surveillance programs can help to minimize subjectivity by providing oversight of key assessments. Monitors can perform independent or confirmatory reviews of assessments to ensure that scoring and administration conventions were followed, and appropriate interview techniques were used.

    Moreover, being able to visualize clinical assessment data across an entire study helps monitors and sponsors detect patterns or potential issues in rater consistency and accuracy. For instance, if a site is generating unusually high or low values, the issue can be investigated, and additional training can be provided. Centralized rater monitoring also includes scheduled assessments of rater consistency and reliability to help mitigate rater drift which can adversely impact data quality, particularly in prolonged studies. If drift is detected, immediate refresher training can be deployed.

    Key Takeaway

    Embracing the development and implementation of rigorous study-wide training for all raters helps to increase consistency and minimize subjectivity. For studies where remote assessments are feasible, the use of centralized raters can further reduce bias. Centralized rater monitoring helps detect, mitigate, and remediate inter- or intra-rater drift during the study, ensuring that rating assessments can be relied upon as primary or secondary endpoints.

    Precision for Medicine has vast experience in managing rated studies, including both pediatric and adult CNS clinical trials. We have been involved in over 60 CNS clinical trial programs and more than 600 CNS commercialization projects. In addition to our familiarity with the common scales used in CNS and psychiatry, we have a network of vendors specializing in rater training and monitoring. To learn more about how Precision for Medicine supports successful CNS clinical trial execution, click here.

     

    About the authors

    Saoussen Brun is a Senior Director of Project Management at Precision for Medicine. She brings more than 18 years of Clinical and Project Management experience to the Precision team. Saoussen’s expertise covers a wide variety of therapeutic areas, with strong experience in oncology and neurology indication. She leads and motivates high-performing teams under tough deadlines to meet both project goals and company targets.

    Sabrina Buzzerd is a Sr. Project Manager at Precision for Medicine. She brings 17 years of clinical experience to the Precision team. Sabrina’s expertise covers a variety of therapeutic areas, including but not limited to acute and chronic pain, psychiatry, urology, orthopedics, dental and rare disease.

    Reference

    1. BIO, PharmaIntelligence, Quantitative Life Sciences. Clinical Development Success Rates and Contributing Factors 2011-2020, February 2021. Available at https://go.bio.org/rs/490-EHZ-999/images/ClinicalDevelopmentSuccessRates2011_2020.pdf.

    Precision for Medicine is part of the Precision Medicine Group, an integrated team of experts that extends Precision for Medicine’s therapeutic development capabilities beyond approval and into launch strategies, marketing communication, and payer insights. As one company, the Precision Medicine Group helps pharmaceutical and life-sciences clients conquer product development and commercialization challenges in a rapidly evolving environment.

    Visit the website
    Clinical Trial Services
    • Overview
    • Global Clinical Trial Support
    • Clinical Trial Management
    • Clinical Development Strategy
    • Clinical Trial Design
    • Biostatistics
    • Clinical Sample Management
    • Clinical Research Organization
    Specialty Lab Services
    • Overview
    • Immune Monitoring
    • Flow Cytometry
    • Genomics
    • Tissue & Liquid Biopsy
    • Bioanalytical Testing
    • Cytokine Analysis
    • Biospecimens
    • Sample Processing
    • Global Specimen Transport & Biostorage
    • Contract Research Organization
    • Bioanalysis
    • Neutralizing Antibody (NAb) Assays
    • PBMC Processing
    Data Sciences
    • Overview
    • Biostatistics
    • Clinical Data Management
    • Biometrics
    • QuartzBio
    • Virtual Sample Inventory Management
    Therapeutic Expertise
    • Overview
    • Preclinical Development
    • Early Phase Trials (I-IIa)
    • Late Phase Trials (IIb-III)
    • Oncology and Immuno-Oncology
    • Rare & Orphan Disease
    • Cell & Gene Therapy
    • Neurology
    • COVID-19
    • Autoimmune & Allergy
    • Pediatric
    • Companion Diagnostics
    About Us
    • Our Passion
    • Meet Our People
    • Careers
    • ESG Policy
    • Regulatory Information

    News & Insights
    • Publications
    • Case Studies
    • Thought Leadership
    • News
    • Events
    © 2023 Precision Medicine Group, LLC. All rights reserved. Privacy Policy    GDPR