ObjectiveTo develop a patient satisfaction evaluation scale for day surgery and test its reliability and validity, so as to provide a scientific and effective tool for day surgery patient satisfaction assessment.MethodsThe literature review method was used to form an entry pool, and the initial version of the scale was formed in conjunction with the expert review method. And then a preliminary survey was conducted to obtain the tentative version of the scale. Finally, 290 day surgery patients discharged between June 15th and July 15th, 2019 were selected to accomplish a survey to check the reliability and validity of the scale.ResultsFinally, a day surgery patient satisfaction evaluation scale was formed, containing 3 stages (pre-hospital, hospitalization, and postdischarge follow-up), 3 dimensions (medical staff evaluation, medical service evaluation, and environment and process evaluation), and 40 items. After the formal survey, the overall Cronbach’s α coefficient of the scale was 0.980, the Spearman-Brown coefficient was 0.933, the Guttman’s half-coefficient was 0.932, and the content validity was 0.87-1.00.ConclusionThe day surgery patient satisfaction evaluation scale was proven good reliability and validity, which can be used as a measurement tool for day surgery patients and applied to clinical practice.
Objective To primarily test the reliability and validity of the Kashin-Beck Disease (KBD) affected big joints function assessing system for adult Tibetans in Rangtang County. Method From June to July 2009, 142 KBD patients were investigated with the function assessing system in Rangtang County of Ngawa. Cronbach’s α coefficient was calculated to estimate internal consistency reliability. Pearson’s r for the correlation of the items with the total score of the scale was computed to test the internal validity. Principal component factor analysis with varimax rotation analysis was conducted to explore construct validity. Result Both the response and complete rates of the scale were 100%. The time for completing the scale was 7.8±3.4 minutes. Cronbach’s α was 0.857, which revealed satisfactory internal consistency reliability. Pearson correlation analysis revealed significant correlation between the scores of each item and the total score of the scale (Plt;0.05). Pearson’s r value of each item was more than 0.4, only except the items of “sitting with legs crossed” and “standing at attention”. The principal factor analysis extracted three latent factors explaining 68.1% of the variation together. The latent factors weights of the items were over 0.4 except the items of “standing at attention”, "taking food” and “wiping after defecation”. Conclusion The reliability and validity of KBD affected big joints function assessing system for adult Tibetans in Rangtang County was good in this primary test, the function assessing system has to be widely applied and further assessed among Tibetans suffered with KBD, in order to provide a standard evaluation criterion in KBD integrate control.
ObjectivesThis study aimed to evaluate the validity and reliability of the clinical practice guidelines (CPGs) applicability evaluation tool, a preliminary revised tool, by using it to appraise specific clinical guidelines.MethodsMedical staffs were sampled from relevant departments in domestic medical institutions to use tool to evaluate the two guidelines. Spearman-Brown coefficient of odd-even split-half method and Cronbach's alpha coefficient were used to evaluate the split-half reliability and internal consistency reliability. The convergent and discriminant validity were evaluated by correlation analysis and correlation coefficient comparison hypothesis test, and the structural validity was investigated by confirmatory factor analysis based on structural equation.ResultsThe split-half reliability of the evaluation tool was 0.86, and the Cronbach's coefficient of the whole tool and each dimension were greater than 0.7 for two guidelines. The success rates of tool convergent and discriminant validity calibration were 100%. In the second-order confirmatory factor analysis model, the χ2 and df were 3.38 and 2.46, the comparative fit index (CFI) were 0.872 and 0.974, the goodness of fit index (GFI) were 0.954 and 0.983, and the adjusted goodness of fit index (AGFI) were 0.846 and 0.959 for two guidelines respectively. Both standard root mean square residual (SRMR) and root mean square error of approximation (RMSEA) were less than 0.09. Both P values of RMSEA hypothesis test were greater than 0.05.ConclusionsThe evaluation scale is a valid and reliable instrument for assessing the applicability of CPGs, which should be further evaluated in practical applications in the future.
ObjectivesTo compare and analyze existing pharmaceutical economic evaluations quality assessment instruments, and to provide suggestions on how to choose the most appropriate instrument.MethodsPubMed, EMbase, ScienceDirect, Web of Science, CNKI, WanFang Data and VIP databases were electronically searched to collect studies on existing pharmaceutical economic evaluations quality assessment instruments from inception to December, 2017. Two reviewers independently screened literature, extracted data and analyzed studies in terms of items, design methods, scopes and characteristics.ResultsTwelve original checklists with good reliability and validity were found. The first quality assessment method was designed in 1987 and the latest one was published in 2013. The number of checklist items ranged from 11 to 61.ConclusionThere is no consolidated method for assessing the quality of pharmaceutical economics evaluations. Evaluators can choose appropriate evaluation tools according to the purpose, type and operability of evaluation.
ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.
Objective To evaluate the reliability and validity of IBS-QOL scale in irritable bowel syndrome (IBS) patients. Methods IBS-QOL scale was applied to survey the quality of life of 123 IBS patients. The split-half and internal consistency method were used to evaluate the reliability, and with the construct method to evaluate the validity. Results The split-half reliability was 0.86. Cronbach’s α-coefficient of all domains was between 0.71 and 0.89 except body image and food avoidance; In the correlation analysis, the correlations between items and its subscale structure were above 0.60 (except interference with activity), but there were no correlations between items and other subscale structure. Eight components from factorial analysis were in accordance with theoretical structure.The cumulative contribution rate was 72.7%. Conclusions The reliability and validity of IBS-QOL scale are acceptable. It might be useful for us to assess the QOL of IBS patients in China.
ObjectiveTo compare and evaluate the discrimination, validity, and reliability of different data envelopment analysis (DEA) models for measuring the effectiveness of models by selecting different input and output indicators of the model.MethodsData from health statistical reports and pilot program of diagnosis-related groups of tertiary hospitals in Hubei Province from 2017 to 2018 were used to analyze the discrimination, content and structure validity, and reliability of the models. Six DEA models were established by enriching the details of input and output on the basis of the input and output indicators of the conventional DEA model of hospitals.ResultsFrom the view of discrimination, the results of all models were left-skewed, the cost-efficiency model had the lowest left-skewed degree (skewness coefficient: -0.14) and was the flattest (kurtosis coefficient: -1.02). From the view of structure validity, the results of the cost-efficiency model were positively correlated with total weights, outpatient visits, and inpatient visits (r=0.328, 0.329, 0.315; P<0.05). From the perspective of content validity, the interpretation of model was more consistent with theory of production after revision of input and output indicators. From the view of reliability, the cost efficiency model had the largest correlation coefficient between the data of 2017 and 2018 (r=0.880, P<0.05).ConclusionsAfter refining the input and output indicators of the DEA model, the discrimination, validity, and reliability of the model are higher, and the results are more reasonable. Using indicators such as discrimination, validity, and reliability can measure the effectiveness of the DEA model, and then optimize the model by selecting different input and output indicators.
ObjectiveTo conduct meta-analysis with the reliability of objective structured clinical examination (OSCE), so as to the reliability of OSCE used in the tests for evaluating clinical capacities of medical students. MethodsArticles about evaluating clinical capacities of medical students using OSCE and using comprehensive coefficient of Cronbach's α to measure the reliability of OSCE were electronically searched in PubMed, ScienceDirect, CNKI, WanFang data and VIP from Jan. 1998 to May. 2013. Two reviewers screened literature according to the inclusion and exclusion criteria, extracted data, and assessed the methodological quality of the included studies. Then meta-analysis was performed using SSPS 17.0 software. ResultsThirty-four studies involving 53 coefficients of Cronbach's α were included, of which, there were 18 articles written in English involving 28 coefficients of Cronbach's α and 16 articles written in Chinese involving 25 coefficients of Cronbach's α. The results of meta-analysis showed that:the total coefficient of Cronbach's α of OSCE was 0.700 (95%CI 0.660 to 0.737). The coefficient of Cronbach's α of internationally-published literature was 0.745 (95%CI 0.696 to 0.790) and that of nationally-published literature was 0.648 (95%CI 0.584 to 0.705), with a significant difference between two groups. ConclusionCurrently, the reliability of internationally/nationally-used OSCE is 0.7, which has relatively better reliability when used in the tests for evaluating clinical capacities of medical students at home and aboard. However, the reliability of OSCE at abroad is fairly better than that at home.
ObjectiveTo evaluate the reliability and validity of the Quality of Working Life Scale (QWL7-32). MethodsThe QWL7-32 scale was used to survey 487 drilling workers. The presence of chronic diseases was regarded as an effector for evaluating physical health, and the result of SCL-90 measurement was regarded as an effector for evaluating psychological health. The reliability and validity of the scale were statistically analyzed. ResultsThe results of the Pearson correlation coefficient was 0.713, the Cronbach's alpha coefficient was 0.920, and the Splithalf reliability coefficient was 0.942. The result of confirmatory factor analysis showed that the construct validity of scale was good, and the accumulative rate of 7 variances was 62.59%. The results of correlation analysis and t test showed that the validity of scale criterion was also good. In QWL7-32 scale, each dimension showed a good correlation with its relevant item but poor correlation with any other items. ConclusionThe QWL7-32 has a good reliability and validity.
Active medical device is a kind of medical device which is widely used. In order to realize the goal of high-quality development, product with high reliability is a necessary requirement for the domestic active medical device industry. By means of literature research, data collection, field research, materials comprehensive combing and analysis, this paper systematically analyzes and studies the current situations and the existing problems of reliability and evaluation from the dimensions of Chinese active medical device industry policy, enterprise situation and evaluation method. In addition, by considering the technical characteristics of reliability work, concrete suggestions for solving the problems are given from the directions of standard and guiding principle, so as to provide reference for active medical device industry to develop scientific and objective reliability technical standard system and guiding principle, which are in accord with the current characteristics of Chinese active medical device industry and supervision.