Dataset Information

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

ABSTRACT:

Background

The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision.

Objective

Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones.

Methods

After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients' true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code.

Results

We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses.

Conclusions

With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access.

SUBMITTER: Chien TW

PROVIDER: S-EPMC4795329 | biostudies-literature | 2016 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

Chien Tsair-Wei TW Lin Weir-Sen WS

JMIR medical informatics 20160302 1

<h4>Background</h4>The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision.<h4>Objective</h4>Our aim was to investigate whether CAT can be (1) efficient with i ...[more]

PMID: 26935793

Similar Datasets

Project description:Despite the urgent need for timely mortality data in low-income and lower-middle-income countries, mobile phone surveys rarely include questions about recent deaths. Such questions might a) be too sensitive, b) take too long to ask and/or c) generate unreliable data. We assessed the feasibility of mortality data collection using mobile phone surveys in Malawi. We conducted a non-inferiority trial among a random sample of mobile phone users. Participants were allocated to an interview about their recent economic activity or recent deaths in their family. In the group that was asked mortality-related questions, half of the respondents completed an abridged questionnaire, focused on information necessary to calculate recent mortality rates, whereas the other half completed an extended questionnaire that also included questions about symptoms and healthcare. The primary trial outcome was the cooperation rate, i.e., the number of completed interviews divided by the number of mobile subscribers invited to participate. Secondary outcomes included self-reports of negative feelings and stated intentions to participate in future interviews. We called more than 7,000 unique numbers and reached 3,054 mobile subscribers. In total, 1,683 mobile users were invited to participate. The difference in cooperation rates between those asked to complete a mortality-related interview and those asked to answer questions about economic activity was 0.9 percentage points (95% CI = -2.3, 4.1), which satisfied the non-inferiority criterion. The mortality questionnaire was non-inferior to the economic questionnaire on all secondary outcomes. Collecting mortality data required 2 to 4 additional minutes per reported death, depending on the inclusion of questions about symptoms and healthcare. More than half of recent deaths elicited during mobile phone interviews had not been registered with the National Registration Bureau. Including mortality-related questions in mobile phone surveys is feasible. It might help strengthen the surveillance of mortality in countries with deficient civil registration systems. Registration: AEA RCT Registry, #0008065 (14 September 2021).

Project description:BackgroundThe monitoring and evaluation of public health programs based on traditional face-to-face interviews in hard-to-reach and unstable regions present many challenges. Mobile phone-based methods are considered to be an effective alternative, but the validity of mobile phone-based data for assessing implementation strength has not been sufficiently studied yet. Nested within an evaluation project for an integrated community case management (iCCM) and family planning program in Mali, this study aimed to assess the validity of a mobile phone-based health provider survey to measure the implementation strength of this program.MethodsFrom July to August 2018, a cross-sectional survey was conducted among the community health workers (ASCs) from six rural districts working with the iCCM and family planning program. ASCs were first reached to complete the mobile phone-based survey; within a week, ASCs were visited in their communities to complete the in-person survey. Both surveys used identical implementation strength tools to collect data on program activities related to iCCM and family planning. Sensitivity and specificity were calculated for each implementation strength indicator collected from the phone-based survey, with the in-person survey as the gold standard. A threshold of ≥ 80% for sensitivity and specificity was considered adequate for evaluation purposes.ResultsOf the 157 ASCs interviewed by mobile phone, 115 (73.2%) were reached in person. Most of the training (2/2 indicators), supervision (2/3), treatment/modern contraceptive supply (9/9), and reporting (3/3) indicators reached the 80% threshold for sensitivity, while only one supervision indicator and one supply indicator reached 80% for specificity. In contrast, most of the stock-out indicators (8/9) reached 80% for specificity, while only two indicators reached the threshold for sensitivity.ConclusionsThe validity of mobile phone-based data was adequate for general training, supervision, and supply indicators for iCCM and family planning. With sufficient mobile phone coverage and reliable mobile network connection, mobile phone-based surveys are useful as an alternative for data collection to assess the implementation strength of general activities in hard-to-reach areas.

Project description:BackgroundIn recent years, the use of mobile phone weight-management apps has increased significantly. Weight-management apps have been found effective in promoting health and managing weight. However, data on user perception and on barriers to app usage are scarce.ObjectiveThis study aimed to investigate the use of weight-management apps and barriers to use as well as reasons for discontinuing use in a sample of mobile phone users in Saudi Arabia.MethodsMobile phone users aged 18 years and above from the general public in Saudi Arabia completed a Web-based survey. The survey included questions on weight-management app usage patterns, user perceptions concerning weight management, efficacy of weight-management apps, and reasons for discontinuing use. Participants were classified into normal weight (body mass index [BMI]: 18.5 to 24.9 kg/m2) and overweight or obese (BMI: ≥25.0 kg/m2).ResultsThe survey included 1191 participants; 513 of them used weight-management apps. More overweight or obese respondents used these apps compared with normal weight respondents (319/513, 62.2% vs 194/513, 37.8%, respectively). App features that overweight or obese users were most interested in were mainly the possibility to be monitored by a specialist and barcode identification of calorie content, whereas normal weight users mostly preferred availability of nutrition information of food items. Reasons for discontinuing use among overweight or obese respondents were mainly that monitoring by a specialist was not offered (80/236, 33.9%) and the app was not in the local language (48/236, 20.3%). Among normal weight users, the main reason for noncontinuance was the app language (45/144, 31.3%) and difficulty of use (30/144, 20.8%).ConclusionsTo better address the needs of both normal weight and overweight or obese adults, improved app designs that offer monitoring by a specialist are needed. Developers may consider ways of overcoming barriers to use, such as language, by developing local language apps, which can improve the efficacy of such apps and help spread their use.

Project description:IntroductionIncreased mobile phone subscribership in low- and middle-income countries (LMICs) provides novel opportunities to track population health. The objective of this study was to examine reliability of data in comparing participant responses collected using two mobile phone survey (MPS) delivery modalities, computer assisted telephone interviews (CATI) and interactive voice response (IVR) in Bangladesh (BGD) and Tanzania (TZA).MethodsUsing a cross-over design, we used random digit dialing (RDD) to call randomly generated mobile phone numbers and recruit survey participants to receive either a CATI or IVR survey on non-communicable disease (NCD) risk factors, followed 7 days later by the survey mode not received during first contact; either IVR or CATI. Respondents who received the first survey were designated as first contact (FC) and those who consented to being called a second time and subsequently answered the call were designated as follow-up (FU). We used the same questionnaire for both contacts, with response options modified to suit the delivery mode. Reliability of responses was analyzed using the Cohen's kappa statistic for percent agreement between two modes.ResultsSelf-reported data on demographic characteristics and NCD behavioral risk factors were collected from 482 (CATI-FC) and 653 (IVR-FC) age-eligible and consenting respondents in BGD, and from 387 (CATI-FC) and 674 (IVR-FC) respondents in TZA respectively. Survey follow-up rates were 30.7% (n = 482) for IVR-FU and 53.8% (n = 653) for CATI-FU in BGD; and 42.4% (n = 387) for IVR-FU and 49.9% (n = 674) for CATI-FU in TZA respectively. Overall, there was high consistency between delivery modalities for alcohol consumption in the past 30 days in both countries (kappa = 0.64 for CATI→IVR (BGD), kappa = 0.54 for IVR→CATI (BGD); kappa = 0.66 for CATI→IVR (TZA), kappa = 0.76 for IVR→CATI (TZA)), and current smoking (kappa = 0.68 for CATI→IVR (BGD), kappa = 0.69 for IVR→CATI (BGD); kappa = 0.39 for CATI→IVR (TZA), kappa = 0.50 for IVR→CATI (TZA)). There was moderate to substantial consistency in both countries for history of checking for hypertension and diabetes with kappa statistics ranging from 0.43 to 0.67. There was generally lower consistency in both countries for physical activity (vigorous and moderate) with kappa statistics ranging from 0.10 to 0.41, weekly fruit and vegetable with kappa ranging from 0.08 to 0.45, consumption of foods high in salt and efforts to limit salt with kappa generally below 0.3.ConclusionsThe study found that when respondents are re-interviewed, the reliability of answers to most demographic and NCD variables is similar whether starting with CATI or IVR. The study underscores the need for caution when selecting questions for mobile phone surveys. Careful design can help ensure clarity of questions to minimize cognitive burden for respondents, many of whom may not have prior experience in taking automated surveys. Further research should explore possible differences and determinants of survey reliability between delivery modes and ideally compare both IVR and CATI surveys to in-person face-to-face interviews. In addition, research is needed to better understand factors that influence survey cooperation, completion, refusal and attrition rates across populations and contexts.

Project description:BackgroundMobile phone text messages (short message service, SMS) are used pervasively as a form of communication. Almost 100% of the population uses text messaging worldwide and this technology is being suggested as a promising tool in psychiatry. Text messages can be sent either from a classic mobile phone or a web-based application. Reviews are needed to better understand how text messaging can be used in mental health care and other fields of medicine.ObjectiveThe objective of the study was to review the literature regarding the use of mobile phone text messaging in mental health care.MethodsWe conducted a thorough literature review of studies involving text messaging in health care management. Searches included PubMed, PsycINFO, Cochrane, Scopus, Embase and Web of Science databases on May 25, 2015. Studies reporting the use of text messaging as a tool in managing patients with mental health disorders were included. Given the heterogeneity of studies, this review was summarized using a descriptive approach.ResultsFrom 677 initial citations, 36 studies were included in the review. Text messaging was used in a wide range of mental health situations, notably substance abuse (31%), schizophrenia (22%), and affective disorders (17%). We identified four ways in which text messages were used: reminders (14%), information (17%), supportive messages (42%), and self-monitoring procedures (42%). Applications were sometimes combined.ConclusionsWe report growing interest in text messaging since 2006. Text messages have been proposed as a health care tool in a wide spectrum of psychiatric disorders including substance abuse, schizophrenia, affective disorders, and suicide prevention. Most papers described pilot studies, while some randomized clinical trials (RCTs) were also reported. Overall, a positive attitude toward text messages was reported. RCTs reported improved treatment adherence and symptom surveillance. Other positive points included an increase in appointment attendance and in satisfaction with management and health care services. Insight into message content, preventative strategies, and innovative approaches derived from the mental health field may be applicable in other medical specialties.

Dataset Information

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

Background

Objective

Methods

Results

Conclusions

Publications

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets