Clinical Trials Logo

Clinical Trial Details — Status: Recruiting

Administrative data

NCT number NCT06155292
Other study ID # PCCE202324
Secondary ID
Status Recruiting
Phase N/A
First received
Last updated
Start date October 3, 2023
Est. completion date October 31, 2025

Study information

Verified date May 2024
Source University of California, Los Angeles
Contact Ilana Brody
Phone 7032445470
Email ilana.brody.phd@anderson.ucla.edu
Is FDA regulated No
Health authority
Study type Interventional

Clinical Trial Summary

As part of UCLA Health's commitment to developing an integrated health system built on a foundation of physician-led, team-based primary care, the Department of Medicine (DOM) implemented a performance-based incentive plan called the Primary Care Clinical Excellence (PCCE) Incentive Plan. The UCLA Health DOM Quality team is leading the implementation and evaluation of this incentive plan across the UCLA Health primary care network, with the primary goal to immediately produce improvements in the quality of primary care. In order to rigorously measure the most efficacious ways to frame and communicate information about the quality improvement (QI) program, the DOM Quality team has partnered with the UCLA Anderson School of Management. Understanding the factors that motivate physicians to deliver high quality primary care will provide pivotal insights into the successful implementation of performance based programs nationwide.


Description:

The investigators will use a communication strategy that leverages behavioral principles to motivate providers to improve in all four of the evaluated domains of the PCCE program: clinical quality, professional participation, patient experience, and risk coding. The investigators will implement a three-arm experimental communication campaign that includes quarterly emails and quarterly survey messages. The communication strategies will utilize motivation and behavior change theories to improve physician performance in the program and attitudes towards the program. In particular, the investigators will test the independent and joint effects of communicating with physicians (a) personalized performance feedback and (b) the "co-creation" of the program (i.e., sharing how physician feedback informed the program design). The investigators will randomly assign eligible physicians to one of the three experimental arms, stratified by overall baseline performance (the total percent allocated in the PCCE program for the April, May, June 2023 quarter), specialty (based on classification as Adult or Adult/Peds), and contract (based on classification as DOM or PCN (CPN/EIMG)). The investigators will evaluate whether arm 3 differs from arm 1 in terms of the measures listed in the Outcome Measures section. If this comparison is statistically significant, the investigators will next compare arms 3 vs. 2 and arms 2 vs. 1. Analysis plan - Physician-quarter-level linear regression models with heteroskedastic-consistent robust standard errors, clustered at the physician level. - The primary model term will be indicator variables for arms that patients are assigned to. - Control variables: - Baseline values of the outcome measure: the investigators will control for the baseline measures of the outcomes, based on performance from July through September 2023 and survey responses in April and July 2023, if available. - Physician baseline subjective understanding of the PCCE program from the July 2023 survey, with four items which asked the extent to which physicians understood how their score in each domain of the program was calculated. - Physician characteristics: self-reported gender, race, and age, plus years at UCLA Health and clinic from administrative data - Missing covariate values will be handled by including 'unknown' indicator variables, along with mean imputation for continuous covariates. - Exploratory analyses will investigate heterogeneous treatment effects by the following characteristics: - Physician baseline performance in the PCCE program (evaluated based on performance in July, August, and September 2023) - Physician baseline perceived leadership support reported in the July 2023 survey - Physician baseline program-related attitudes (agency, value in PCCE program) reported in the April 2023 survey - Physician baseline subjective understanding of the PCCE program from the July 2023 survey - Objective valence of the feedback delivered in the first email report card, measured by 1) the number of metrics within each domain for which the physician improved relative to the prior quarter, 2) the number of metrics within each domain for which the physician met or exceeded the benchmark, and 3) average distance from the benchmark across the metrics within each domain - Random assignment to providing feedback on the report card design in a survey conducted before the intervention launch, in July 2023 - Physician gender - Physician years in practice - The investigators will investigate physicians' program-related attitudes and perceptions as proposed mechanisms of the interventions. These will be measured with 11 items that form three subscales about perceived justice, antecedents to one's intentions to succeed, and perceived value of the feedback. - Perceived justice in the PCCE program structure and implementation: Physicians will be surveyed regarding the structural justice (2 items), distributive justice (1 item), and informational justice of the program (2 items). - Antecedents of intentions to succeed in the program: Physicians will be surveyed regarding their perceived agency (behavioral control) over their performance in the PCCE program (1 item), their perceived value of the PCCE program (2 items), and their subjective norms about the endorsement and success of their colleagues in the program (2 items). - Perceived value of the performance feedback: Physicians will be surveyed about the utility of the quarterly performance feedback in contextualizing their goal pursuit efforts (1 item). - The investigators will investigate physicians' overall workplace attitudes as additional outcomes. These will be measured as a 4-item questionnaire about trust in UCLA Health leadership (1 item), perceived leadership support (1 item), job satisfaction (1 item), and burnout (1 item). - Robustness checks will be performed without covariates, and using logistic regression models in place of linear regression models for dependent variables that are measured as binary indicators.


Recruitment information / eligibility

Status Recruiting
Enrollment 330
Est. completion date October 31, 2025
Est. primary completion date October 31, 2024
Accepts healthy volunteers No
Gender All
Age group 18 Years and older
Eligibility Inclusion criteria: - Primary care physicians within the UCLA Health Department of Medicine Primary Care Network that are eligible for the PCCE Incentive program as of October 1, 2023. - Physicians with the clinical full-time employee level (FTE) of = 40% as of October 1, 2023 - Physicians with panel size >50 patients as of October 1, 2023 Exclusion criteria: - Physicians classified as Pediatrics will be excluded from data analysis given the structural differences in health maintenance guidelines for children. - Physicians classified as Urgent Care will be excluded from data analysis given the structural differences in their performance evaluation. They are all in Arm 1. - Physicians who participate in the design of this experiment will be excluded from analysis.

Study Design


Intervention

Behavioral:
Standard Communication Email
This is a standard quarterly email communication without personalized performance metrics.
Personalized Report Card Email
This personalized information about physician performance replaces the standard communication email to provide personalized feedback to physicians.
Bottom-Up Framing
The bottom-up framing is added onto the personalized communication email to provide insight on how the PCCE program was informed by physician feedback. The bottom-up framing is added onto the survey communication to provide insight on how the PCCE program was informed by physician feedback.

Locations

Country Name City State
United States UCLA Health Department of Medicine, Quality Office Los Angeles California

Sponsors (1)

Lead Sponsor Collaborator
University of California, Los Angeles

Country where clinical trial is conducted

United States, 

References & Publications (7)

Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179-211.

Bies, R. J., & Moag, J. S. 1986. Interactional justice; Communication criteria of fairness. In R. J. Lewicki, B. H. Sheppard, & B. H. Bazerman (Eds.), Research on negotiation in organizations, Vol. 1: 43-55. Greenwich, CT: JAI Press.

Colquitt JA. On the dimensionality of organizational justice: a construct validation of a measure. J Appl Psychol. 2001 Jun;86(3):386-400. doi: 10.1037/0021-9010.86.3.386. — View Citation

Konovsky, M. A. (2000). Understanding procedural justice and its impact on business organizations. Journal of Management, 26(3), 489-511. https://doi.org/10.1016/S0149-2063(00)00042-8

Leventhal, H. (1980). Toward a comprehensive theory of emotion. In Advances in experimental social psychology (Vol. 13, pp. 139-207). Elsevier.

Shapiro, D. L., Buttner, E. H., & Barry, B. (1994). Explanations: What factors enhance their perceived adequacy? Organizational Behavior and Human Decision Processes, 58(3), 346-368.

Thibault, J., & Walker, L. (1975). Procedural justice: A social psychological analysis. Hillsdale, NJ: Lawrence Elbaum Associates.

Outcome

Type Measure Description Time frame Safety issue
Primary Physician Behavior: Rate of Engagement with Resources in First Email Whether physicians click through to access the "PCCE Resources and Improvement Strategies", for which a link is provided via quarterly report card emails. The time frame is one week after the first email was sent, as a binary indicator. 1 week
Secondary Rate of Overall Resource Engagement Click-through behavior to access the "PCCE Resources and Improvement Strategies" as a binary indicator will be examined at the physician-quarter level. In November 2023 when there was just one email communication, click-through behavior will be assessed for one week after this email was sent. Starting in February 2024, a reminder email was sent two weeks after the first email, so click-through behavior will be assessed during the time between the send date of the first quarterly email through one week after the send date of the reminder email, per quarter. 12 months
Secondary Domain-Specific and Aggregate PCCE Performance Standardized z-scores of the metrics for each domain in the PCCE program will be averaged following the incentive program weights to measure domain-specific performance at the physician-quarter level. The investigators will analyze performance in each domain separately. Also, to analyze the effect of an intervention on aggregate performance, physician-quarter-domain level data will be analyzed in regressions weighted by the program domain weights for physicians' affiliation. This will be examined from January through September, 2024. If there is a significant effect, the investigators will explore whether the effect persists through June 2025. If there is no positive significant effect of an intervention, the investigators will examine the effect of the intervention on the "points" that physicians receive, since physicians may focus on meeting thresholds to earn points (rather than improving absolute performance). 9 months
Secondary Rate of Citizenship Behavior Physician willingness in a survey to opt in to perform an organizational citizenship behavior, as a binary indicator for whether physicians opted in. 2 weeks
Secondary Physician Workplace Attitudes Measured with 4 items about: 1) trust in UCLA Health leadership (scale measured from 1-7, with higher values indicating higher trust), 2) perceived leadership support (scale measured from 1-5, with higher values indicating higher support), job satisfaction (scale measured from 1-7, with higher values indicating more satisfaction), and burnout (scale measured from 1-5, with higher values indicating more burnout). 12 months
Secondary Physician Program-Related Attitudes and Perceptions Measured with 11 items that form three subscales about perceived justice, antecedents to one's intentions to succeed, and perceived value of the feedback. All items will be measured on a scale from 1-7, where higher scores indicate a better outcome. 12 months
See also
  Status Clinical Trial Phase
Completed NCT03224858 - Ambulatory ICU Study for Medically and Socially Complex Patients N/A
Completed NCT03663075 - Effect of Group Education and Individual Counselling on Mental Health and Quality of Life in 45-60 Year Old Women N/A
Recruiting NCT04151056 - Impact of the Social Determinants of Health in the Central Catalan Region
Recruiting NCT05715151 - Continuous Quality Improvement Cohorts on Advanced Access N/A
Completed NCT01242319 - Translating ATP III Cholesterol Management Guidelines Into Primary Care Practice N/A
Completed NCT02955433 - The Impact of Rideshare Transportation Services on Appointment Adherence N/A
Completed NCT02266069 - PROject - Supportive and Palliative Care and INnOvation - Antwerp (Pro-Spinoza) N/A
Recruiting NCT04702711 - Experiences of Anger in Patients in Primary Health Care With Symptoms of Generalized Anxiety
Completed NCT04521816 - PIM 2.0: Patient Aligned Care Team (PACT) Intensive Management (PIM) Project N/A
Recruiting NCT05709860 - An Electronic Health Record-based Approach to Increase PrEP Knowledge and Uptake: the EMC2 PrEP Strategy N/A
Completed NCT05121688 - Effectiveness of a Physical Therapy Telerehabilitation Program in Long Post COVID-19 Symptoms in Primary Health Care. N/A
Completed NCT05329246 - Validation of PMcardio AI-assisted Clinical Assistant in Primary Care N/A
Completed NCT02953925 - National-wide Survey on Primary Health Care in China N/A
Completed NCT03100526 - Patient Aligned Care Team (PACT) Intensive Management (PIM) Project N/A
Active, not recruiting NCT04585191 - Reducing Treatment Risk in Older Adults With Diabetes N/A
Recruiting NCT05609981 - Optimising Medication With Focus on Deprescribing in Frail Older People With Multidose Drug Dispensing Systems N/A
Completed NCT04688359 - Effectiveness of Nurse-coordinated Follow-up Program in Primary Care for People at Risk for T2DM N/A
Withdrawn NCT04010136 - Identification of Elderly Patients in Need of Palliative Care by Family Physicians N/A
Completed NCT04237883 - Primary Care Clinical Excellence Incentive Study N/A
Completed NCT04183504 - Screening for Therapy and Empowering Parents: A Pilot Study N/A