Dataset Information

Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model.

ABSTRACT:

Objective

To develop and validate the Readiness for Implementation Model (RIM). This model predicts a healthcare organization's potential for success in implementing an interactive health communication system (IHCS). The model consists of seven weighted factors, with each factor containing five to seven elements.

Design

Two decision-analytic approaches, self-explicated and conjoint analysis, were used to measure the weights of the RIM with a sample of 410 experts. The RIM model with weights was then validated in a prospective study of 25 IHCS implementation cases.

Measurements

Orthogonal main effects design was used to develop 700 conjoint-analysis profiles, which varied on seven factors. Each of the 410 experts rated the importance and desirability of the factors and their levels, as well as a set of 10 different profiles. For the prospective 25-case validation, three time-repeated measures of the RIM scores were collected for comparison with the implementation outcomes.

Results

Two of the seven factors, 'organizational motivation' and 'meeting user needs,' were found to be most important in predicting implementation readiness. No statistically significant difference was found in the predictive validity of the two approaches (self-explicated and conjoint analysis). The RIM was a better predictor for the 1-year implementation outcome than the half-year outcome.

Limitations

The expert sample, the order of the survey tasks, the additive model, and basing the RIM cut-off score on experience are possible limitations of the study.

Conclusion

The RIM needs to be empirically evaluated in institutions adopting IHCS and sustaining the system in the long term.

SUBMITTER: Wen KY

PROVIDER: S-EPMC3000759 | biostudies-literature | 2010 Nov-Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model.

Wen Kuang-Yi KY Gustafson David H DH Hawkins Robert P RP Brennan Patricia F PF Dinauer Susan S Johnson Pauley R PR Siegler Tracy T

Journal of the American Medical Informatics Association : JAMIA 20101101 6

<h4>Objective</h4>To develop and validate the Readiness for Implementation Model (RIM). This model predicts a healthcare organization's potential for success in implementing an interactive health communication system (IHCS). The model consists of seven weighted factors, with each factor containing five to seven elements.<h4>Design</h4>Two decision-analytic approaches, self-explicated and conjoint analysis, were used to measure the weights of the RIM with a sample of 410 experts. The RIM model wi ...[more]

PMID: 20962135

Similar Datasets

Project description:PurposeTo develop models for progression of nonproliferative diabetic retinopathy (NPDR) to proliferative diabetic retinopathy (PDR) and determine if incorporating updated information improves model performance.DesignRetrospective cohort study.ParticipantsElectronic health record (EHR) data from a tertiary academic center, University of California San Francisco (UCSF), and a safety-net hospital, Zuckerberg San Francisco General (ZSFG) Hospital were used to identify patients with a diagnosis of NPDR, age ≥ 18 years, a diagnosis of type 1 or 2 diabetes mellitus, ≥ 6 months of ophthalmology follow-up, and no prior diagnosis of PDR before the index date (date of first NPDR diagnosis in the EHR).MethodsFour survival models were developed: Cox proportional hazards, Cox with backward selection, Cox with LASSO regression and Random Survival Forest. For each model, three variable sets were compared to determine the impact of including updated clinical information: Static0 (data up to the index date), Static6m (data updated 6 months after the index date), and Dynamic (data in Static0 plus data change during the 6-month period). The UCSF data were split into 80% training and 20% testing (internal validation). The ZSFG data were used for external validation. Model performance was evaluated by the Harrell's concordance index (C-Index).Main outcome measuresTime to PDR.ResultsThe UCSF cohort included 1130 patients and 92 (8.1%) patients progressed to PDR. The ZSFG cohort included 687 patients and 30 (4.4%) patients progressed to PDR. All models performed similarly (C-indices ∼ 0.70) in internal validation. The random survival forest with Static6m set performed best in external validation (C-index 0.76). Insurance and age were selected or ranked as highly important by all models. Other key predictors were NPDR severity, diabetic neuropathy, number of strokes, mean Hemoglobin A1c, and number of hospital admissions.ConclusionsOur models for progression of NPDR to PDR achieved acceptable predictive performance and validated well in an external setting. Updating the baseline variables with new clinical information did not consistently improve the predictive performance.Financial disclosuresProprietary or commercial disclosure may be found after the references.

Project description:BackgroundMyasthenia gravis (MG) is one of the most common accessory syndromes for thymoma patients. To reduce MG exacerbation and guide clinical practice, we developed a nomogram for predicting MG exacerbation in patients with postoperative thymoma recurrence.MethodsRetrospective study of 176 patients with recurrence following thymoma resection who were admitted to the People's Hospital of Shijiazhuang's Center of Treatment of Myasthenia Gravis between 2013 and 2021. Among them, 120 patients with recurrent thymoma from 2013 to 2020 were selected as the training cohort, and 56 patients in 2021 as the validation cohort. Univariate and multivariate logical regression was used to determine the risk factors and draw the nomogram, and the parameters in the nomogram were proportionally assigned from 0 to 100 points. Finally, the performance of the model is evaluated by internal inspection and external inspection.ResultsMultivariate analysis revealed that postoperative treatment plan and the pathologic classification of the thymoma were independent predictors of MG exacerbation in the training cohort (n=120), so they were used to create the nomogram, which had a well-fit calibration curve and good concordance index of 0.77 [95% confidence interval (CI): 0.69-0.86] for the training cohort and 0.74 (95% CI: 0.58-0.91) for the validation cohort, respectively. Calculations were made to determine the nomogram's sensitivity, specificity, positive predictive values (PPV) and negative predictive values (NPV). The training cohort were 75.7% (95% CI: 66.1-83.4%), 64.7% (95% CI: 38.6-84.7%), 92.9% (95% CI: 84.5-97.1%) and 30.6% (95% CI: 16.9-48.3%) respectively, while the corresponding validation cohort were 84.1% (95% CI: 69.3-92.8%), 66.7% (95% CI: 35.4-88.7%), 90.2% (95% CI: 75.9-96.8%) and 53.3% (95% CI: 27.4-77.7%) respectively.ConclusionsWe identified the risk factors for MG exacerbation in patients with postoperative recurrence of thymoma and drew a nomogram, which can be used to calculate the probability of MG exacerbation and guide clinicians to choose post-operative treatment.

Project description:Rationale & objectiveRisk factors for acute kidney injury (AKI) in the hospital have been well studied. Yet, risk factors for identifying high-risk patients for AKI occurring and managed in the outpatient setting are unknown and may differ.Study designPredictive model development and external validation using observational electronic health record data.Setting & participantsPatients aged 18-90 years with recurrent primary care encounters, known baseline serum creatinine, and creatinine measured during an 18-month outcome period without established advanced kidney disease.New predictors & established predictorsEstablished predictors for inpatient AKI were considered. Potential new predictors were hospitalization history, smoking, serum potassium levels, and prior outpatient AKI.OutcomesA ≥50% increase in the creatinine level above a moving baseline of the recent measurement(s) without a hospital admission within 7 days defined outpatient AKI.Analytical approachLogistic regression with bootstrap sampling for backward stepwise covariate elimination was used. The model was then transformed into 2 binary tests: one identifying high-risk patients for research and another identifying patients for additional clinical monitoring or intervention.ResultsOutpatient AKI was observed in 4,611 (3.0%) and 115,744 (2.4%) patients in the development and validation cohorts, respectively. The model, with 18 variables and 3 interaction terms, produced C statistics of 0.717 (95% CI, 0.710-0.725) and 0.722 (95% CI, 0.720-0.723) in the development and validation cohorts, respectively. The research test, identifying the 5.2% most at-risk patients in the validation cohort, had a sensitivity of 0.210 (95% CI, 0.208-0.213) and specificity of 0.952 (95% CI, 0.951-0.952). The clinical test, identifying the 20% most at-risk patients, had a sensitivity of 0.494 (95% CI, 0.491-0.497) and specificity of 0.806 (95% CI, 0.806-0.807).LimitationsOnly surviving patients with measured creatinine levels during a baseline period and outcome period were included.ConclusionsThe outpatient AKI risk prediction model performed well in both the development and validation cohorts in both continuous and binary forms.

Dataset Information

Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model.

Objective

Design

Measurements

Results

Limitations

Conclusion

Publications

Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets