ObjectiveTo develop a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy and conduct reliability and validity tests. MethodsCombining literature reviews, qualitative interviews, and expert consultations, we summarized key elements of perineal injury prevention during pregnancy and synthesized the best evidence. Through multiple discussions within the core working group, a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy was formulated. Using convenience sampling, pregnant women were recruited, and a pre-survey was conducted using the questionnaire. Pre-survey results were analyzed using item analysis and reliability and validity testing methods to validate and refine the questionnaire. ResultsThe questionnaire was compiled based on the theory of evidence-based decision-making. The initial version of the questionnaire was developed by combining systematic evaluation, network meta-analysis, and semi-structured interviews. The questionnaire was modified and improved through expert consultation, group discussion, and pre-investigation, which ensured that the questionnaire had good reliability, validity, and practicability. The Cronbach's α coefficient was 0.87, the split-half reliability was 0.71, and the content validity index was 0.97 of the survey questionnaire. ConclusionThe present version of the perineal injury preventive measures preference and values questionnaire has good reliability, validity, and practicability. It can serve as a valuable tool for investigating preferences and values related to perineal injury prevention during pregnancy.
Objective To develop a behavioral assessment scale for medication management plans in women of childbearing age with epilepsy and to test its reliability and validity. Methods Based on the Theory of Planned Behavior, a pool of questionnaire items was initially drafted through literature review and focus group discussions. A two-round Delphi expert consultation was conducted with 15 experts to form a test version of the behavioral assessment scale for medication management plans in women of childbearing age with epilepsy (including 27 items and 5 dimensions). Convenience sampling was used to conduct surveys among women of childbearing age with epilepsy in some tertiary hospitals in Chuxiong, Shenzhen and Wuhan from February to May 2024 (the first time) and from June to October 2024 (the second time). ResultsThe effective recovery rates of the two rounds of questionnaires were 95.5% and 94.6%, respectively. The final scale included 24 items and 5 dimensions, with good reliability and validity: the content validity index (S-CVI) was 0.934, Cronbach's α coefficient was 0.876, split-half reliability was 0.819, and test-retest reliability was 0.901; exploratory factor analysis extracted 5 factors (cumulative variance explained rate 73.97%, item load 0.42~0.85), and confirmatory factor analysis showed that the model had good fit (χ2/df=1.849, RMSEA=0.075, CFI, GFI, AGFI, IFI, TLI all>0.85). Conclusion The scale meets the reliability and validity standards and can be used to assess the medication management plans and behaviors of women of childbearing age with epilepsy.
ObjectiveTo evaluate the reliability and validity of the Quality of Working Life Scale (QWL7-32). MethodsThe QWL7-32 scale was used to survey 487 drilling workers. The presence of chronic diseases was regarded as an effector for evaluating physical health, and the result of SCL-90 measurement was regarded as an effector for evaluating psychological health. The reliability and validity of the scale were statistically analyzed. ResultsThe results of the Pearson correlation coefficient was 0.713, the Cronbach's alpha coefficient was 0.920, and the Splithalf reliability coefficient was 0.942. The result of confirmatory factor analysis showed that the construct validity of scale was good, and the accumulative rate of 7 variances was 62.59%. The results of correlation analysis and t test showed that the validity of scale criterion was also good. In QWL7-32 scale, each dimension showed a good correlation with its relevant item but poor correlation with any other items. ConclusionThe QWL7-32 has a good reliability and validity.
【摘要】 目的 评价SF-36量表在测量地震伤残人员生存质量中的信度和效度。 方法 利用自填法及访谈相结合的方式调查201例绵竹市某镇地震伤残人员，用重测信度和Cronbach’s α系数分析SF-36信度；因子分析方法分析效度。 结果 SF-36各领域的重测信度分别为:生理功能（PF）0.78、生理问题对功能的限制（RP）0.85、躯体疼痛（BP）0.92、健康总体评价（GH）0.82、活力（VT）0.77、社会功能（SF）0.71、心理问题对功能的限制（RE）0.79、精神健康（MH）0.66；各领域的Cronbach’s α系数分别为:PF 0.89、RP 0.75、BP 0.84、GH 0.86、VT 0.78、SF 0.72、RE0.86、MH 0.50。因子分析共提取了6个主成分，基本反映了量表的8个维度，与量表的结构构思基本相符。 结论 自填法及面对面访谈相结合的方式，将SF-36量表用于该地地震伤残人员生存质量测定具有较好的信度和效度。【Abstract】 Objective To evaluate the validity and reliability of the MOS-36-item Short Form of Health Survey (SF-36) measuring the quality of life (QOL) of disabled people injured in the earthquake. Methods A total of 201 disabled people injured in the earthquake in a town of Mianzhu city were investigated via questionnaire combined with a face-to-face interview. The reliability of the SF-36 was assessed by test-retest reliability and Cronbach’s α coefficient. The validity was assessed through factor analysis. Results The test-retest reliability of the SF-36 included: physical functioning (PF) 0.78, role limitation due to physical problems (RP) 0.85, body pain (BP) 0.92, general health (GH) 0.82, vitality (VT) 0.77, social functioning (SF) 0.71, role limitation due to emotional problems (RE) 0.79, and mental health (MH) 0.66. The Cronbach’s α coefficients were as the follows: PF 0.89, RP 0.75, BP 0.84, GH 0.86, VT 0.78, SF 0.72, RE 0.86, and MH 0.50. Six principal components were extracted by factor analysis and the constructs of the obtained instrument were consistent with the conceived concept in essence. Conclusion The SF-36 survey could measure the QOL in disabled people injured in the earthquake with better reliability and validity by questionnaire combined with a face-to-face interview.
ObjectiveTo compare the performance of 36-item short form health survey (SF-36) and World Health Organization quality of life-bref (WHOQOL-Bref) in assessing quality of life (QOL) in patients with pulmonary tuberculosis (TB). MethodsThe WHOQOL-Bref questionnaire and the SF-36 questionnaire were administered to patients with tuberculosis undergoing treatment from July to September 2013. The statistical methods of reliability analysis, factor analysis and the Pearson correlation coefficient analysis were used. ResultsIt showed that the WHOQOL-Bref and the SF-36 both had good reliability (Cronbach α=0.863 and 0.920, respectively). Constructive validity of the two instruments were checked by factor analysis and the Pearson correlation coefficient analysis, which indicated that both the two instruments had good validity. Among scales measuring similar concepts, many subscales of the SF-36 and the four domains of the WHOQOL-Bref unexpectedly had a fair correlation with one another. For example, the physical QOL, psychological QOL, and social relation QOL domains of the WHOQOL-Bref and physical functioning, mental health, and social functioning of the SF-36 were 0.482, 0.745, and 0.572, respectively. ConclusionThe WHOQOL-Bref and the SF-36 have an approximately equivalent practicability in assessing the quality of life in patients with TB.
ObjectiveTo compare and evaluate the discrimination, validity, and reliability of different data envelopment analysis (DEA) models for measuring the effectiveness of models by selecting different input and output indicators of the model.MethodsData from health statistical reports and pilot program of diagnosis-related groups of tertiary hospitals in Hubei Province from 2017 to 2018 were used to analyze the discrimination, content and structure validity, and reliability of the models. Six DEA models were established by enriching the details of input and output on the basis of the input and output indicators of the conventional DEA model of hospitals.ResultsFrom the view of discrimination, the results of all models were left-skewed, the cost-efficiency model had the lowest left-skewed degree (skewness coefficient: -0.14) and was the flattest (kurtosis coefficient: -1.02). From the view of structure validity, the results of the cost-efficiency model were positively correlated with total weights, outpatient visits, and inpatient visits (r=0.328, 0.329, 0.315; P<0.05). From the perspective of content validity, the interpretation of model was more consistent with theory of production after revision of input and output indicators. From the view of reliability, the cost efficiency model had the largest correlation coefficient between the data of 2017 and 2018 (r=0.880, P<0.05).ConclusionsAfter refining the input and output indicators of the DEA model, the discrimination, validity, and reliability of the model are higher, and the results are more reasonable. Using indicators such as discrimination, validity, and reliability can measure the effectiveness of the DEA model, and then optimize the model by selecting different input and output indicators.
ObjectivesTo develop a tool to assess the credibility of cohort studies regarding anticoagulants treatment for patients with atrial fibrillation.MethodsMEDLINE, EMbase and CBM databases were retrieved for eligible studies on the methodological quality and credibility of the cohort study. The retrieval period was from inception to December 19th, 2017, and the languages were limited to Chinese and English. Based on the search results, the items on the methodology quality of the research or the credibility of the results were collected. Through brainstorming of the core group, the collected items were expanded and sorted out to a preliminary scale. Furthermore, we conducted 4 rounds of internal expert seminars to discuss and evaluate the preliminary scale content and discuss the scale framework. Finally, we organized domestic authoritative experts to conduct 4 external evaluations on the scale and formed the final scale.ResultsA total of 7 734 literatures were obtained from primary search, in which 17 of which were included. Fifty-five tools with 780 items for the quality assessment of observational studies were collected from the included studies. After removing duplicated keywords with similar meanings, we obtained the " keyword pool” with 46 keywords, which were preliminarily formed 46 items. After discussion of the core group, which aimed to supplement the potential items, eliminate the items irrelevant to methodology, and integrate the items with partial overlapping meanings, a preliminary scale of 43 items was formed. According to the four rounds of internal expert consultative meetings, these items were integrated to form a preliminary scale of 40 items. After further evaluation by four rounds of external expert consultative meetings, a consensus was reached and a scale of 21 items from seven domains (i.e., definition of question, measurement, follow-up, confounder, missing data, statistical analysis, and results assessment) was finally formed.ConclusionsThis study developed an assessment tool for the credibility of the results from the cohort studies regarding anticoagulants treatment in patients with atrial fibrillation, which has practical clinical value. Clinicians can refer to the results of credibility assessment by using this tool to better assist clinical decision-making in clinical practice. In addition, in the preparation of relevant guidelines, this tool can be used to assess the credibility of results from cohort studies.
Objective To develop an evaluation tool for the screening of high risk population for oral complications in critically ill patients, which can be performed accurately and scientifically. Methods Basing on the related foreign oral assessment scale, combined with the method of brainstorming, expert consultation, method of clinical status and so on, the item pool of the assessment scale was determined. Five nursing experts and two oral experts assessed the content validity and 50 ICU nurses were tested. Then, the screening accuracy of the assessment scale was proved by application in 100 critically ill patients selected randomly. Results The Cronbach’s a coefficient of final version of the High Risk Assessment Scale for Oral Complications in Critically Ill Patients (including seven parts contents of oral health assessment and oral pH value test) was 0.815, the content validity index (Sr-CVI/Ave) was 0.932. The results of 50 nurses to the 91.2% assessment items of the assessment scale were very important and important. For screening related indicators of oral complications in high-risk patients, the sensitivity of the assessment scale was 97.53%, the specificity was 94.11%, the positive predictive value was 98.75%, the negative predictive value was 88.89%, and the crude agreement was 95%. Conclusion There are good reliability, validity and a high accuracy of screening test in the High Risk Assessment Scale for Oral Complications in Critically Ill Patients. It can be used for screening patients at high risk for oral complications in critically ill patients, and help clinical nurses to complete the oral health status of the critically ill patients quickly.
Network meta-analysis (NMA) is a method that can compare and rank the effects of different interventions, which plays an important role in evidence translation and evidence-based decision-making. In 2014, the GRADE working group first introduced the GRADE method for NMA evidence certainty grading. Since then, its method system has been gradually supplemented and improved. In recent years, the GRADE working group has further improved the methods for evaluating intransitivity and imprecision in NMA, and has made recommendations for the presentation and interpretation of NMA results, forming a complete methodological chain of NMA evidence certainty grading and result interpretation consisting of 6 steps. Our team updated the method system of GRADE applied in NMA with specific cases to provide references for relevant researchers.
High-quality randomized controlled trials are the best source of evidence to explain the relationship between health interventions and outcomes. However, in cases where they are insufficient, indirect, or inappropriate, researchers may need to include non-randomized studies of interventions to strengthen the evidence body and improve the certainty (quality) of evidence. The latest research from the GRADE working group provides a way for researchers to integrate randomized and non-randomized evidence. The present paper introduced the relevant methods to provide guidance for systematic reviewers, health technology assessors, and guideline developers.