Metrics Archives - Avoca, a WCG company https://www.theavocagroup.com/category/blog-topics/metrics/ GCP Quality and Compliance Consulting Solutions and Home of the Avoca Quality Consortium Wed, 13 Dec 2023 16:12:15 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.2 AQC Patient Diversity Work Group Members Reviewing Key Site Attributes to Include in Site Assessment Scoring Tool https://www.theavocagroup.com/aqc-patient-diversity-work-group-members-reviewing-key-site-attributes-to-include-in-site-assessment-scoring-tool/ Fri, 29 Jul 2022 15:15:02 +0000 https://www.theavocagroup.com/?p=14838 AQC Patient Diversity Metric Development Work Group members met on 9 June 2022 to discuss the challenges organizations encounter developing patient diversity plans, identifying sites able to recruit under-represented patient populations (URPP) and tracking recruitment success. They reviewed how current AQC tools and the new proposed site assessment tool will help organizations address some of […]

The post AQC Patient Diversity Work Group Members Reviewing Key Site Attributes to Include in Site Assessment Scoring Tool appeared first on Avoca, a WCG company.

]]>
AQC Patient Diversity Metric Development Work Group members met on 9 June 2022 to discuss the challenges organizations encounter developing patient diversity plans, identifying sites able to recruit under-represented patient populations (URPP) and tracking recruitment success. They reviewed how current AQC tools and the new proposed site assessment tool will help organizations address some of the patient diversity challenges raised. During the discussion, meeting participants shared information about current approaches to identifying sites able to recruit/retain URPPs, including understanding site attributes important to target URPPs as well as assessing the ability of experienced and novo/research naïve sites to meet URPP recruitment/retention needs. Consortium members can view the polling results by downloading the meeting slides or viewing the archive recording of the meeting available in the Patient Diversity Metric Development work group meeting archive library in the AQC Knowledge Center.

A sub-set of work group members have volunteered to participate in a detailed review of the proposed site selection scoring tool. The review will include an examination of the site attributes, attribute scoring, and proposed use for assessing experienced research sites as well as de novo/research-naïve sites.

AQC Members can log into the AQC Knowledge Center and visit the meeting calendar to register. Contact us for information on establishing an AQC user account.

The post AQC Patient Diversity Work Group Members Reviewing Key Site Attributes to Include in Site Assessment Scoring Tool appeared first on Avoca, a WCG company.

]]>
AQC QbD-RBQM-Quality Improvement CoP Group Exploring Current QTL Practices and Use of KRIs https://www.theavocagroup.com/aqc-qbd-rbqm-quality-improvement-cop-group-exploring-current-qtl-practices-and-use-of-kris/ Fri, 29 Jul 2022 15:06:35 +0000 https://www.theavocagroup.com/?p=14837 The WCG MCC QTL working group – a multistakeholder group of industry experts – met on 10 occasions over a 5-month period in 2021 to discuss challenges and best practice approaches for implementation of Quality Tolerance Limits (QTLs). The work culminated in a three-part article in Applied Clinical Trials. MCC founder Linda Sullivan and QTL […]

The post AQC QbD-RBQM-Quality Improvement CoP Group Exploring Current QTL Practices and Use of KRIs appeared first on Avoca, a WCG company.

]]>
The WCG MCC QTL working group – a multistakeholder group of industry experts – met on 10 occasions over a 5-month period in 2021 to discuss challenges and best practice approaches for implementation of Quality Tolerance Limits (QTLs). The work culminated in a three-part article in Applied Clinical Trials. MCC founder Linda Sullivan and QTL Working Group co-leads Steve Young (CluePoints) and Keith Dorricott (WCG Avoca) shared highlights of the work with WCG AQC QbD-RBQM-Quality Improvement Community of Practice (CoP) members at a virtual meeting on 8 June 2022. During the meeting, they shared how the sub-team worked together and some of the key concepts discussed in the Applied Clinical Trials article. Meeting participants shared information about current QTL practices such as QTL implementation progress (e.g., proportion of studies, phase / types of studies); number of QTLs implemented for each study; sources used to determine QTL thresholds; and practices related to modifying QTL parameters and thresholds during study conduct. Consortium members can view the polling results by downloading the meeting slides or viewing the archive recording of the meeting available in the QbD-RBQM-Quality Improvement meeting archive library in the AQC Knowledge Center.

Consortium members will continue to explore lessons learned from early QTL adopters at the next Community of Practice meeting on 13 July 2022. The topic of the meeting is Using KRIs as Companions to QTLs – Getting Earlier Signals of Risk QTL focusing on where QTLs work, and where they don’t as well as using KRIs as companions to QTLs.

AQC Members can log into the AQC Knowledge Center and visit the meeting calendar to register. Contact us for information on establishing an AQC user account.


Additional Resources

Applied Clinical Trials, Defining Quality Tolerance Limits and Key Risk Indicators that Detect Risks in a Timely Manner: Reflections from Early Adopters on Emerging Best Practices (Part 1), (Part 2), and (Part 3)

CTO Podcast Episode 34: Defining QTLs and KRIs that Detect Risks in a Timely Manner – Part 1 Relationship of QTLs & KRIs with Steve Young, Keith Dorricott, and WCG Senior Advisor Linda Sullivan

CTO Podcast Episode 35: Defining QTLs & KRIs that Detect Risks in a Timely Manner (Part II) — The Process of Defining QTLs with Steve Young, Keith Dorricott, and WCG Senior Advisor Linda Sullivan

CTO Podcast Episode 36: QTLs & Early Detection of Risk (Part III of the QTL Series) with Steve Young, Keith Dorricott, and WCG Senior Advisor Linda Sullivan

The post AQC QbD-RBQM-Quality Improvement CoP Group Exploring Current QTL Practices and Use of KRIs appeared first on Avoca, a WCG company.

]]>
Is it possible to measure TMF completeness accurately? It may be worse than you think! https://www.theavocagroup.com/is-it-possible-to-measure-tmf-completeness-accurately-it-may-be-worse-than-you-think/ Tue, 24 May 2022 18:44:22 +0000 https://www.theavocagroup.com/?p=14470 AQC’s Inspection Readiness | TMF Community of Practice Group Will Explore the Topic during June 14th meeting Timely TMF completeness is one of the goals of a well-functioning TMF process. Timeliness is relatively easy to measure – but how do you measure whether the TMF is complete? Join us on June 14, 2022 at 11:00 […]

The post Is it possible to measure TMF completeness accurately? It may be worse than you think! appeared first on Avoca, a WCG company.

]]>
AQC’s Inspection Readiness | TMF Community of Practice Group Will Explore the Topic during June 14th meeting

Timely TMF completeness is one of the goals of a well-functioning TMF process. Timeliness is relatively easy to measure – but how do you measure whether the TMF is complete? Join us on June 14, 2022 at 11:00 am EDT as we discuss what works and some of the challenges with measuring completeness.

AQC Members can log into the AQC Knowledge Center and visit the meeting calendar to register. Contact us for information on establishing an AQC user account.

The post Is it possible to measure TMF completeness accurately? It may be worse than you think! appeared first on Avoca, a WCG company.

]]>
QTL Working Group Publishes 3-part Series https://www.theavocagroup.com/qtl-working-group-publishes-3-part-series/ Tue, 24 May 2022 18:36:40 +0000 https://www.theavocagroup.com/?p=14469 In late 2020, WCG MCC members decided to develop guidance on quality tolerance limits (QTLs) – regarding metrics, implementation and use – by channeling experiences from across the industry. A working group of 20 individuals (representing 16 organizations) met virtually during 2021 to discuss the challenges and develop a leading practice approach to be shared […]

The post QTL Working Group Publishes 3-part Series appeared first on Avoca, a WCG company.

]]>
In late 2020, WCG MCC members decided to develop guidance on quality tolerance limits (QTLs) – regarding metrics, implementation and use – by channeling experiences from across the industry. A working group of 20 individuals (representing 16 organizations) met virtually during 2021 to discuss the challenges and develop a leading practice approach to be shared with the industry. A summary of the working group’s work about emerging best practices has been posted on the Applied Clinical Trials website in a three-part series.

WCG Avoca Quality Consortium (AQC) Members had an opportunity to discuss the recommendations with the working group at the AQC QbD – RBQM – QI Community of Practice meetings on June 8 and July 13, 2022.

AQC Members can log into the AQC Knowledge Center and visit the meeting calendar to register for upcoming meetings. Contact us for information on establishing an AQC user account.

The post QTL Working Group Publishes 3-part Series appeared first on Avoca, a WCG company.

]]>
eCOA Process Metrics v3.0 will be released at the Metric Demo and Q&A Meeting on April 27 https://www.theavocagroup.com/ecoa-process-metrics-v3-0-will-be-released-at-the-metric-demo-and-qa-meeting-on-april-27/ Mon, 25 Apr 2022 21:00:07 +0000 https://www.theavocagroup.com/?p=14447 The MCC eCOA Process Metrics Work Group (now part of WCG AQC) – comprised of more than 200 individuals representing over 40 organizations – worked collaboratively from September 2020 to December 2021 to develop the assets contained in the eCOA Process Metrics Toolkit v3.0. The decision to review and update the eCOA metric toolkit was […]

The post eCOA Process Metrics v3.0 will be released at the Metric Demo and Q&A Meeting on April 27 appeared first on Avoca, a WCG company.

]]>
The MCC eCOA Process Metrics Work Group (now part of WCG AQC) – comprised of more than 200 individuals representing over 40 organizations – worked collaboratively from September 2020 to December 2021 to develop the assets contained in the eCOA Process Metrics Toolkit v3.0. The decision to review and update the eCOA metric toolkit was based on the following three considerations:

  1. Industry and regulatory trends such as increased patient engagement (ICH E8 R1), FDA Guidance on Patient-Focused Drug Development, and the move to an increased use of ePRO (electronic Patient Reported Outcomes) as part of implementation of approaches to decentralized clinical trials needed to be considered.
  2. Consortium members identified gaps in the metric set – in particular around translation, eCOA helpdesk, and training processes – areas not covered in detail in earlier versions.
  3. The eCOA Process Metrics Toolkit v2.0 was developed prior to consortium members discussing whether metrics included in metric toolkits should be designated as potential Key Risk Indicators to support Risk-Based Quality Management.

The work group followed the Metric Development Framework described in the White Paper: MCC’s Metric Development Framework: Defining Metrics That Answer Key Performance Questions [link] to develop the revised metric toolkit which includes 38 metrics that help users answer 31 key performance questions covering study start-up, conduct and close activities. Additionally, the group identifying 11 metrics as potential Key Risk Indicators to support Risk-Based Quality Management. The comprehensive metric toolkit includes an extensive overview guide and video tutorial, process maps, detailed metric definitions, and metric selection tools.

AQC Members are invited to participate in the launch meeting on April 27 at 10 am EDT to see the new metric toolkit and participate in a live Q&A session. Members can log into the AQC Knowledge Center and visit the meeting calendar to register. Contact us for information on establishing an AQC user account.

The post eCOA Process Metrics v3.0 will be released at the Metric Demo and Q&A Meeting on April 27 appeared first on Avoca, a WCG company.

]]>
Patient Diversity Work Group Pauses Metric Discussions to Discuss DEPICT Legislation and the FDA’s Diversity Plan https://www.theavocagroup.com/patient-diversity-work-group-pauses-metric-discussions-to-discuss-depict-legislation-and-the-fdas-diversity-plan-draft-guidance-released-on-april-13/ Mon, 25 Apr 2022 20:50:48 +0000 https://www.theavocagroup.com/?p=14445 The AQC Patient Diversity Metric Development Work Group was scheduled to discuss member feedback about the draft site diversity assessment scoring tool at a meeting on April 14. However, the agenda quickly changed when the FDA released a new draft guidance entitled “Diversity Plans to Improve Enrollment of Participants from Underrepresented Racial and Ethnic Subgroups […]

The post Patient Diversity Work Group Pauses Metric Discussions to Discuss DEPICT Legislation and the FDA’s Diversity Plan appeared first on Avoca, a WCG company.

]]>
The AQC Patient Diversity Metric Development Work Group was scheduled to discuss member feedback about the draft site diversity assessment scoring tool at a meeting on April 14. However, the agenda quickly changed when the FDA released a new draft guidance entitled “Diversity Plans to Improve Enrollment of Participants from Underrepresented Racial and Ethnic Subgroups in Clinical Trials” on April 13. During the meeting, the work group reviewed and discussed key aspects of the draft guidance. Work group member, Lori Abrams, Vice President, Patient Advocacy & Clinical Research Diversity at WCG, provided contextual background on how the FDA typically handles situations when insufficient safety and efficacy data has been collected from racial and ethnic subgroups. She stated that the draft guidance signals that the FDA is shifting to a proactive approach that emphasizes including underrepresented populations in all phases of clinical trials – not just post approval studies. Abrams shared insights from her extensive experience of developing Diversity Plans and bringing de novo sites into clinical research. Finally, she noted that while FDA guidances are  not mandatory requirements, the “Diverse and Equitable Participation in Clinical Trials Act” or the “DEPICT Act” – introduced to the US House on February 3, 2022 – if passed, will direct the FDA to amend certain regulations to increase clinical trial diversity.

AQC Members can view a recording of the meeting by logging into the AQC Knowledge Center and going to the patient diversity work group meeting archive page.

The post Patient Diversity Work Group Pauses Metric Discussions to Discuss DEPICT Legislation and the FDA’s Diversity Plan appeared first on Avoca, a WCG company.

]]>
Metric Demo and Q&A Monthly Meeting Series https://www.theavocagroup.com/metric-demo-and-qa-monthly-meeting-series/ Thu, 24 Mar 2022 19:14:38 +0000 https://www.theavocagroup.com/?p=14405 Throughout 2022, the AQC will host a monthly meeting for Members to learn about metric toolkits available in the AQC Knowledge Center. During the 1-hour virtual meeting, metric experts will provide an overview of a selected toolkit, show how to use the toolkit metric selection tools, and answer audience questions. The metric toolkits scheduled for […]

The post Metric Demo and Q&A Monthly Meeting Series appeared first on Avoca, a WCG company.

]]>
Throughout 2022, the AQC will host a monthly meeting for Members to learn about metric toolkits available in the AQC Knowledge Center. During the 1-hour virtual meeting, metric experts will provide an overview of a selected toolkit, show how to use the toolkit metric selection tools, and answer audience questions. The metric toolkits scheduled for discussion include:

  • eCOA Process Metrics
  • TMF Metrics
  • Vendor/CRO Oversight Metrics
  • Site Selection & Study Start-Up Metrics
  • Centralized & Site Monitoring Process Metrics – Updates

Consortium members are invited to log into the AQC Knowledge Center calendar to register for meetings.

The post Metric Demo and Q&A Monthly Meeting Series appeared first on Avoca, a WCG company.

]]>
Community of Practice Group AQC Meetings https://www.theavocagroup.com/community-of-practice-group-aqc-meetings/ Thu, 24 Mar 2022 19:01:16 +0000 https://www.theavocagroup.com/?p=14403 The highly rated Community of Practice (CoP) groups meet as part of the AQC member program, sharing ideas and practical approaches to address challenges unique to each community. Members determine priority topics and share knowledge through case study presentations, panel sessions, and facilitated brainstorming sessions. The following three CoPs will meet in 2022 and discuss […]

The post Community of Practice Group AQC Meetings appeared first on Avoca, a WCG company.

]]>
The highly rated Community of Practice (CoP) groups meet as part of the AQC member program, sharing ideas and practical approaches to address challenges unique to each community. Members determine priority topics and share knowledge through case study presentations, panel sessions, and facilitated brainstorming sessions. The following three CoPs will meet in 2022 and discuss the following topics: 

  • Audit/Compliance/CAPA CoP
    • Opportunities and Challenges in the CAPA process
    • EU CTR: Practicalities for Implementing Serious Breaches
  • Inspection Readiness/TMF CoP
    • Case Study and Discussion: Risk-Based TMF Document Review
    • Accurate measurement of TMF completeness
  • QbD, RBQM, Quality Improvement (including centralized monitoring) CoP
    • Process Thinking When Identifying Risks and KRIs
    • RBQM and Data Management
    • MHRA Guidance and Categorizing Study Risk
    • QTLs and Companion KRIs

Meetings are open to all AQC Members, please visit the Knowledge Center calendar to register for upcoming meetings. An archive of past meeting recordings and presentations is available to Members in CoP-specific knowledge portals.

The post Community of Practice Group AQC Meetings appeared first on Avoca, a WCG company.

]]>
Approaches to selecting sites capable of enrolling under-represented participants in clinical trials. https://www.theavocagroup.com/approaches-to-selecting-sites-capable-of-enrolling-under-represented-participants-in-clinical-trials/ Mon, 31 Jan 2022 18:37:00 +0000 https://www.theavocagroup.com/what-new-types-of-collaboration-groups-will-be-offered-in-2022-copy/ These topics were explored in the Patient Diversity Community of Practice Group virtual meetings on August 12 and September 9, 2021. The group developed a draft list of attributes and brainstormed about how to measure / assess site capabilities. The site attribute list was shared in a joint meeting with the Site Selection and Start-Up Process Metric Development […]

The post Approaches to selecting sites capable of enrolling under-represented participants in clinical trials. appeared first on Avoca, a WCG company.

]]>
These topics were explored in the Patient Diversity Community of Practice Group virtual meetings on August 12 and September 9, 2021. The group developed a draft list of attributes and brainstormed about how to measure / assess site capabilities. The site attribute list was shared in a joint meeting with the Site Selection and Start-Up Process Metric Development Work Group to gain insights about today’s approaches to selecting sites capable of enrolling under-represented participants in clinical trials. At the end of the discussion, it was decided that there was interest in continuing exploration of the topic in 2022 in a metric development work group. 

Consortium members are invited to join to us on February 16th for the inaugural meeting of the AQC Patient Diversity Metric Development Work Group. During the meeting, discussion leaders will provide a summary overview of the work completed in by the Community of Practice Group in 2021 which will serve as the foundation for the new metric development work group in 2022. Specifically, we will: 

  • Review & brainstorm on the attributes that are important to assess sites
  • Discuss what site data is collected today
  • Explore how to obtain the missing data – site survey and then an analysis tool?

Consortium members are invited to log into the AQC Knowledge Center meeting calendar to register for meetings.

The post Approaches to selecting sites capable of enrolling under-represented participants in clinical trials. appeared first on Avoca, a WCG company.

]]>
What new types of collaboration groups will be offered in 2022? https://www.theavocagroup.com/what-new-types-of-collaboration-groups-will-be-offered-in-2022/ Mon, 31 Jan 2022 18:31:48 +0000 https://www.theavocagroup.com/ask-the-experts-vendor-oversight-copy/ During 2022, AQC will offer members the opportunity to participate in two new types of collaboration groups: Communities of Practice (CoP) and Metric Development Work Groups (MDWG). Members can participate in CoP groups that cover four areas:  Compliance/CAPA, Innovation Adoption (including AI/ML), Inspection Readiness/TMF, and QbD-RBQM-Quality Improvement (including centralized monitoring). Each Community of Practice – […]

The post What new types of collaboration groups will be offered in 2022? appeared first on Avoca, a WCG company.

]]>
During 2022, AQC will offer members the opportunity to participate in two new types of collaboration groups: Communities of Practice (CoP) and Metric Development Work Groups (MDWG). Members can participate in CoP groups that cover four areas:  Compliance/CAPA, Innovation Adoption (including AI/ML), Inspection Readiness/TMF, and QbD-RBQM-Quality Improvement (including centralized monitoring). Each Community of Practice – a virtual community of members who share ideas and practical approaches to address challenges unique to the community – will meet on a monthly or quarterly basis and share knowledge through case study presentations, expert panel discussions or fireside chats as well as open dialogue and whiteboard brainstorming sessions. CoPs will complement the work being done in AQC Leadership Advisory Board (LAB) groups. For example, the RBQM LAB group will work together to complete deliverables like updating the integrated risk management tool and the corresponding QbD-RBQM-QI CoP will provide members with an additional forum to have conversations / share insights about related topics such as QTLs vs KRIs, lessons learned about centralized monitoring during COVID, etc. Summaries of past MCC Community of Practice Meetings are available in the AQC knowledge center. 

Two Metrics Development Work Groups will continue to meet in 2022 to complete the development of the Centralized & Site Monitoring Process Metrics Toolkit and the Site Selection & Start-Up Process Metrics Toolkit. A new Work Group focusing on developing Patient Diversity metrics will launch on February 16th.

Consortium members are invited to log into the AQC Knowledge Center meeting calendar to register for meetings.

The post What new types of collaboration groups will be offered in 2022? appeared first on Avoca, a WCG company.

]]>