• Biospecimen SolutionsPrecision Value & HealthCareers
    P_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGBP_ForMedicine_no_tag_RGB
    • Clinical
      Trial Services
        • Overview
            • Oncology Clinical TrialsImage

              Oncology Clinical Trials


              Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

              • Rare & Orphan DiseaseImage

                Rare & Orphan Disease


                With experience built on 150+ orphan disease projects covering 80+ rare diseases, we know how to anticipate logistical and regulatory obstacles and craft bold solutions that drive rare disease development programs.

        • Global Clinical Trial Support –
            • North & South America –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Europe –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • APAC –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

        • Clinical Trial Management –
            • Study Start-up & Feasibility –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Project Management –
            • Patient Recruitment –
            • Personalized Clinical Trial Operations –
            • Biometrics –
            • Medical & Safety Monitoring –
            • Clinical Data Management –
            • Medical Writing –
        • Clinical Development Strategy –
            • Clinical Development Planning –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Biomarker Strategies –
            • Cell & Gene Therapy Strategies –
            • CDx Regulatory and Market Access –
        • Clinical Trial Design –
            • Basket & Umbrella Trials –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Biomarker Clinical Trials –
            • Master Protocol Trials –
            • Decentralized Clinical Trials
        • Biostatistics –
            • Statistical Consulting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Study Design –
            • Data Monitoring Committees –
            • CDISC Programming and Documentation –
            • eCTD Submissions –
        • Central Lab Services –
            • Clinical Specimen Kitting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Sample Processing –
            • Global Specimen Logistics and Biostorage –
            • Biospecimen Data Services –
            • Precision Lab e-Portal –
            • Virtual Sample Inventory Management –
        • Training
            • Oncology Clinical TrialsImage

              Oncology Clinical Trials


              Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

              • Rare & Orphan DiseaseImage

                Rare & Orphan Disease


                With experience built on 150+ orphan disease projects covering 80+ rare diseases, we know how to anticipate logistical and regulatory obstacles and craft bold solutions that drive rare disease development programs.

    • Lab
      Services
        • Central Lab Services –
            • Clinical Specimen Kitting –
              • Oncology Clinical TrialsImage

                Oncology Clinical Trials


                Through 20+ years running successful oncology trials, we’ve developed a unique blend of proprietary technologies, flexible processes, and creative problem solving abilities that advance even the most challenging clinical development programs.

            • Sample Processing –
            • Global Specimen Logistics and Biostorage –
            • Biospecimen Data Services –
            • Precision Lab e-Portal –
            • Virtual Sample Inventory Management –
        • Specialty Lab Services Overview –
            • Immune MonitoringImage

              Immune Monitoring


              Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

              • Tissue & Liquid BiopsyImage

                Tissue and Liquid Biopsy


                Obtain a detailed molecular view into patient biology with a range of tissue and liquid biopsy technologies, including our proprietary ApoStream platform which can isolate and enrich circulating tumor cells for downstream analysis.

        • EU Contract Research Organization –
        • Immune Monitoring –
            • Immune Monitoring by Flow Cytometry –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • Immune Cell Phenotyping by Epiontis ID –
            • Cytokine Profiling –
            • Gene Expression Profiling –
            • ELISpot and FluoroSpot –
            • Custom Assays –
        • Flow Cytometry –
            • Receptor Occupancy Assays by Flow Cytometry –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

        • Genomics –
            • NanoString Assays –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • ddPCR –
            • qPCR –
            • NGS –
            • Fluorescence In Situ Hybridisation (FISH) / ISH –
        • Tissue & Liquid Biopsy –
            • ApoStream – CTC and Rare Cell Isolation for Liquid Biopsy
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • CTC / cfDNA / Exosome Analysis –
            • Multiplex Immunofluorescence –
            • Immunohistochemistry –
            • Fluorescence In Situ Hybridisation (FISH) / ISH
            • Pathology Services –
            • NanoString Assays
        • Bioanalytical Testing –
            • Immunogenicity Testing –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • PK Assays –
            • ADA Assays –
            • MesoScale Discovery (MSD) Assays –
            • Quanterix SIMOA –
            • ELISA
        • Cytokine Analysis –
            • ELISA –
              • Immune MonitoringImage

                Immune Monitoring


                Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

            • MesoScale Discovery (MSD) Assays
            • Luminex –
            • Quanterix SIMOA
        • Preclinical Target and Biomarker Validation –
            • Cell Based Assays –
            • Target Expression – XpressWay Profiles –
            • Tissue Cross-Reactivity –
            • Fluorescence In Situ Hybridisation (FISH) / ISH –
            • Multiplex Immunofluorescence –
            • Immunohistochemistry (IHC)
        • Biospecimens
            • Immune MonitoringImage

              Immune Monitoring


              Leverage sophisticated immune monitoring approaches, including flow cytometry, Epiontis ID immune cell phenotyping, and cytokine profiling, to characterize the immune cells in your samples and understand their impact on patient biology.

              • Tissue & Liquid BiopsyImage

                Tissue and Liquid Biopsy


                Obtain a detailed molecular view into patient biology with a range of tissue and liquid biopsy technologies, including our proprietary ApoStream platform which can isolate and enrich circulating tumor cells for downstream analysis.

    • Data
      Sciences
        • Overview
            • BiostatisticsImage

              Biostatistics


              Seasoned biostatisticians and statistical programmers support every phase of your trial, from study design for small, rare disease trials to regulatory submissions, all backed by meticulous documentation.

              • QuartzBioImage

                QuartzBio


                Purpose-built technology engineered specifically to reach across data silos and address the challenges of both sample data and biomarker data management— providing a single, scalable data platform solution.

        • Biostatistics
        • Clinical Data Management
        • Biometrics
        • QuartzBio –
            • Biomarker Data Management –
              • BiostatisticsImage

                Biostatistics


                Seasoned biostatisticians and statistical programmers support every phase of your trial, from study design for small, rare disease trials to regulatory submissions, all backed by meticulous documentation.

            • Virtual Sample Inventory Management –
    • Diagnostics
      & CDx
        • IVD and CDx Regulatory Affairs Consulting –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • COVID-19 & Viral Panel Assays –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • Biospecimens Solutions 
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • Diagnostic Market Access Services –
          • spevialty_labs_slice-300×54Image

            Specialty Lab Services


            Our comprehensive approach starts with a foundation of expertise in key biomaker discovery and analysis methods such as immune monitoring, genomics, and bioanalysis.

        • Companion Diagnostics
    • Therapeutic
      Areas
        • Overview
            • By Specialty Area
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • Oncology and Immuno-Oncology
              • Oncology Clinical Trials
            • Rare & Orphan Disease
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • Cell & Gene Therapy
              • Cell Therapy
              • Gene Therapy
              • Cell and Gene Therapy Manufacturing
            • CNS & Neuroscience
              • Global-clinical-trial-support-2Image

                Global Clinical Trial Support


                Sample processing labs, clinical trial sites and offices in five continents provide the clinical reach and scale to manage complex global programs.

            • COVID-19
            • AutoImmune & Allergy
            • Pediatric
        • By Research Phase
        • Preclinical Development –
        • Early Phase Trials (I-IIa) –
        • Late Phase Trials (IIb-III) –
    • News &
      Insights
        • Blog –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

        • Resources –
        • Thought Leadership –
        • News –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

        • Events –
            • iStock-945738094Image

              Blog


              Industry trends and best practices from Precision experts

              • shutterstock_1033743346Image

                Resources


                A searchable hub featuring the latest Precision case studies, white papers, capabilities brochures and more.

    • About
      Us
        • Our Passion –
            • Patient RecruitmentImage

              Our Passion


              What we do, why we do it and the principles that guide us every day.

              • meet-our-peopleImage

                Meet Our People


                We are devoted professionals with deep expertise in translational science, clinical trials and data sciences.

        • Meet Our People –
        • Careers
        • Regulatory Information –
            • Patient RecruitmentImage

              Our Passion


              What we do, why we do it and the principles that guide us every day.

              • meet-our-peopleImage

                Meet Our People


                We are devoted professionals with deep expertise in translational science, clinical trials and data sciences.

    • Contact
      Us
    • Home
    • Centralized vs Decentralized Raters: When to Use Which in CNS Trials?
    Blog Clinical Research Insights Translational & Lab Insights
    Article

    Centralized vs Decentralized Raters: When to Use Which in CNS Trials?

    Written By Robert Bauer, Vincent Shortino • May 9, 2023 • 7 min. read

    Raters play a critical role in ensuring the validity and reliability of study results. The overall objective of rating is to minimize variability in the assessment of study outcomes by following standardized protocols. This consistency allows for accurate comparisons between treatment groups and reduces the potential for bias.

    In central nervous system (CNS) clinical trials, rating is important because CNS disorders can manifest differently among individuals, making it challenging to consistently assess treatment efficacy. Moreover, mood, personality, and cognitive factors may influence subjective reporting by study participants.  

    Approaches to Rating in Clinical Trials 

    Raters are trained individuals who assess the symptoms, signs, and outcomes of clinical trial participants using standardized assessment tools. Their role is to provide objective, reliable measurements of treatment response and factors such as disease severity, functional status, or quality of life in the study population.

    In clinical trials, there are two approaches to rating which differ in location and number of raters: 

    • Centralized rating: Involves a single group of raters—often at a central location—assess the symptoms and outcomes of study participants using standardized assessment tools. This approach aims to minimize the potential for rater bias and variability. 
    • Decentralized rating: Involves raters at multiple sites or locations. This approach aims to increase the efficiency of data collection by distributing the workload across multiple raters and may be more practical for studies that involve large geographic areas or diverse populations. 

    Each rating approach has advantages and disadvantages, and the choice of which approach to use depends on the specific needs of the clinical trial. For example:

    • Centralized rating: Typically for studies with complex assessments or high levels of standardization and consistency.
    • Decentralized rating: Useful for times when there is a need for flexible and efficient data collection.

    Pros and Cons of Rating Approaches

    AdvantagesDisadvantages
    Decentralized RatingAssessment by a provider that knows the patient, which may be more comfortable for the patient 
     
    Provision of on-site care, which clinical trial participants may expect or prefer
    Difficulty in achieving standardization at a study-wide level  
     
    Cost and time involved in hiring, training, and maintaining expert raters at each study site
    Centralized RatingIncreased patient access and convenience, which may help with recruitment and retention 
     
    Bigger pool of eligible sites, since sites no longer need to have their own expert clinical raters   
     
    Centralized reporting, which allows rapid identification and remediation of non-compliant visits 
     
    Well-trained, independent raters, may be more objective in determining eligibility and treatment effectiveness 
     
    Rating standardization, due to centralized training and calibration which lead to higher levels of intra- and inter-rater reliability 
     
    Ability to study patient in real-world settings, rather than the clinical trial environment 
    Fewer face-to-face interactions with study staff 
     
    Requires good connectivity and technology capability, for both sites and study participants  
     
    Cost, depending on the study protocol and design

    Recommended Reading

    Effectively Managing Rater Training and Consistency in CNS Trials

    Key Considerations for Selecting a Rating Approach

    When determining which type of rating is most appropriate for a clinical trial, consider: 

    Indication under investigation

    Complexity of a disease and its symptomatology can influence the rating process. For CNS disorders such as Parkinson’s disease that require specialized training and experience to evaluate symptom severity accurately, centralized rating may be more appropriate. This is also true for studies where the ratings are primary or secondary endpoints.

    Study design

    The frequency of evaluations and the feasibility of performing those evaluations remotely also affect the choice of rating approach. For studies that require frequent evaluations or in-person assessments, decentralized rating may be the most cost-effective option.

    Investigator experience

    Experienced investigators may have a better understanding of the disease under investigation and the potential side effects or complications of the treatment being tested, making them better equipped to identify and measure the outcomes of interest. They may also be more familiar with the tools and methods used to assess these outcomes, which helps ensure that the data collected is reliable and accurate with either rating approach.  

    Site experience

    Experienced sites may have more experience working with the patient population of interest and more resources and infrastructure in place to ensure the quality and accuracy of data collected with decentralized rating. For less experienced sites without expert raters, a centralized approach may accelerate study startup as hiring, training, testing, and overseeing local raters may be more costly and time-consuming. 

    Rating scale(s) used

    Rating scales vary in complexity and level of validation or availability of expert guidelines or published literature to support interpretation. One study evaluating different versions of the Hamilton Rating Scale for Depression (HAM-D) found that these versions varied in their clinimetric properties and concluded that the most appropriate version for a clinical trial would depend on rater experience, study design and objectives, and clinical characteristics of the population under evaluation.i 

    For rating scales that require visual assessment, centralized rating has the advantage of reducing variability in ratings since all raters are trained and supervised in a standardized fashion. For rating scales that are complex and require significant and ongoing training and oversight to ensure compliance and consistency, centralized rating may be more appropriate. 

    Likelihood of placebo response, response bias, and rater bias

    The characteristics of both patients and raters can impact rating measurements. With patients, placebo response occurs when the positive expectation of improvement impacts self-reported outcomes. In clinical trials of antidepressant medications, placebo response is substantial.ii Response bias is introduced when patients answer rating questionnaire items with the response, they perceive to be most desirable to the rater or study staff.

    With raters, bias can be introduced when the rater’s underlying beliefs regarding the treatment under investigation influence their rating. When either placebo response, response bias, or rater bias is expected to be high, utilizing centralized raters to perform both the screening and outcome measures of a study may minimize bias and maximize consistency. 

    For some studies, a hybrid approach that combines both centralized and decentralized rating may be appropriate.

    • Example: a trial could use local raters to screen for eligibility and central raters to assess for efficacy (provided that all raters receive the same training and testing)

    In CNS conditions such as Alzheimer’s disease where telemedicine examinations correlate well with in-person evaluations, using the patient’s own physician—under the direction of two central neurologists—to perform rating assessments maintains consistency and may help to accelerate enrollment.iii  

    Recommended Reading

    Maximizing ePRO Value and Benefits in CNS Clinical Trials

    Tips for Implementing Centralized Rating

    Implementing a centralized rating approach in a clinical trial requires careful planning, training, and monitoring, as well as multi-stakeholder collaboration to define the workflow and supporting processes. Once the outcome measure(s) to be assessed have been defined in the study protocol, implementation involves: 

    1. Identifying a group of experienced, qualified raters with expertise in the outcome measure(s) being assessed and experience in conducting centralized ratings. 
    1. Determining technology needs which are necessary to support centralized rating, whether it is electronic patient reported outcomes (ePROs) or electronic clinical outcomes assessments (eCOAs) and selecting qualified vendors. 
    1. Developing and implementing a standardized rater training program that covers the rating scale(s) to be used, including practical training to ensure that all raters apply the rating scale in a consistent manner. 
    1. Conducting a reliability study to assess inter-rater reliability. This involves having multiple raters independently rate a set of standardized cases to evaluate consistency among their individual ratings. 
    1. Monitoring rating quality throughout the study with regular review of a sample of the ratings to ensure there is no rating drift. 
    1. Providing ongoing training, support and supervision for the duration of the study. 

    Key Takeaway

    Rating plays a critical role in CNS trials, providing a standardized and objective method for evaluating the efficacy and safety of investigational treatments. There is no one-size-fits-all approach to rating in CNS trials and determining whether to implement a centralized, decentralized or hybrid approach requires careful consideration of the study objectives and outcome measures, with a focus on optimizing the reliability, validity, and accuracy of results.  

    Precision for Medicine is experienced in managing rated studies, including both adult and pediatric CNS clinical trials. Through our support of over 60 CNS clinical trial programs and more than 600 CNS commercialization projects, we have developed expertise in the common scales used in CNS and psychiatry and built a network of qualified vendors specializing in rater training and monitoring.

    Explore Precision's Capabilities in CNS Research >


    • Robert Bauer

      Robert Bauer is an Executive Director of Operational Strategy at Precision with over 20 years of clinical trial operations experience from both the sponsor and CRO perspectives. He has led teams in the conduct of trials from Phase I through IV and has experience across a wide variety of trial designs. Bob has experience across many therapeutic areas some of which include rare diseases, oncology, depression, schizophrenia, and substance use disorders.

    • Vincent Shortino

      Vincent Shortino is a Sr. Clinical Trial Manager, bringing more than 20 years of experience to Precision. His experience spans all major therapeutic areas with a heavy emphasis on Cardiovascular and Rare Indications, across Phases I–IV. He brings solid perspectives inclusive of sites, pharma and CROs from his previous roles of Study Coordinator, Site Director, CRA, and Clinical Trial Manager.

    Precision for Medicine is part of the Precision Medicine Group, an integrated team of experts that extends Precision for Medicine’s therapeutic development capabilities beyond approval and into launch strategies, marketing communication, and payer insights. As one company, the Precision Medicine Group helps pharmaceutical and life-sciences clients conquer product development and commercialization challenges in a rapidly evolving environment.

    Visit the website
    Clinical Trial Services
    • Overview
    • Global Clinical Trial Support
    • Clinical Trial Management
    • Clinical Development Strategy
    • Clinical Trial Design
    • Biostatistics
    • Clinical Sample Management
    • Clinical Research Organization
    Specialty Lab Services
    • Overview
    • Immune Monitoring
    • Flow Cytometry
    • Genomics
    • Tissue & Liquid Biopsy
    • Bioanalytical Testing
    • Cytokine Analysis
    • Biospecimens
    • Sample Processing
    • Global Specimen Transport & Biostorage
    • Contract Research Organization
    • Bioanalysis
    • Neutralizing Antibody (NAb) Assays
    • PBMC Processing
    Data Sciences
    • Overview
    • Biostatistics
    • Clinical Data Management
    • Biometrics
    • QuartzBio
    • Virtual Sample Inventory Management
    Therapeutic Expertise
    • Overview
    • Preclinical Development
    • Early Phase Trials (I-IIa)
    • Late Phase Trials (IIb-III)
    • Oncology and Immuno-Oncology
    • Rare & Orphan Disease
    • Cell & Gene Therapy
    • Neurology
    • COVID-19
    • Autoimmune & Allergy
    • Pediatric
    • Companion Diagnostics
    About Us
    • Our Passion
    • Meet Our People
    • Careers
    • ESG Policy
    • Regulatory Information

    News & Insights
    • Publications
    • Case Studies
    • Thought Leadership
    • News
    • Events
    © 2023 Precision Medicine Group, LLC. All rights reserved. Privacy Policy    GDPR