The formation, evaluation and grade division of real-world evidence (RWE) are bottlenecks restricting the in-depth development and scientific application of real-world study methods. This paper briefly reviewed the design grade and evidence grade of clinical medical research, and proposed the key points of evidence grade of real-world clinical research, including emphasizing the comprehensive evaluation of internal authenticity and external authenticity, determining the "starting point" of real-world evidence, and using the real-world evidence quality evaluation method. Based on the internationally recognized "grading of recommendations assessment, development, and evaluation (GRADE)", combined with the classification and characteristics of real-world evidence, a preliminary grading scheme was formed. An example was given to illustrate the grading suggestion.
There are several main obstacles to structure clinical questions in the process of developing evidence-based clinical practice guidelines, such as clinicians have misconceptions about clinical question structure, and clinical questions do not fit clinical practice. These obstacles results in the incomplete structure and not standardized expression of the clinical questions, and reduce the quality and applicability of guidelines. To overcome these obstacles, this article introduced the application and specific details of clinical question framing and expression with practical examples, to assist clinicians in understanding clinical questions and to provide methodological references for clinical question formulation in the guidelines.
In the process of guideline development and construction of clinical questions, it is necessary to guide clinicians to propose clinical problems into PICO (population, intervention, control, outcome) structured clinical questions. However, there are still unclear criteria to define and judge the appropriateness of the width of the PICO elements of a clinical question. Either too wide or too narrow can make the PICO question unsuitable to be a question for clinical practice guidelines to answer. We graded the clinical questions to be eight grades (3, 2, 1, 0, −1, −2, −3, mixed) according to the number of the PIC elements, which obviously needed to be adjusted to evaluate applicability of the appropriateness of the width of the clinical questions. Our work can provide methodological references for clinicians and guideline developers.
Objective To understand the feasibility of application of objective performance criteria single arm trial in clinical efficacy evaluation of traditional Chinese medicine, and put forward theoretical countermeasures for the difficulties in application, so as to provide references for promoting the application of objective performance criteria single arm trial in clinical efficacy evaluation of traditional Chinese medicine in the future. Methods Semi-structured qualitative interviews were conducted among clinical experts and methodologists who were involved in objective performance criteria single arm trials using purposive sampling combined with snowball sampling and a preset interview outline. To explore the application situations, influencing factors and difficulties in the application process of objective performance criteria single arm trial in the clinical efficacy evaluation of traditional Chinese medicine, and put forward theoretical countermeasures. Results A total of 12 respondents were interviewed, including 7 clinical experts and 5 methodologists. The interview content was summarized and formed into 216 codes. After category analysis, 5 categories were formed, including the applicable situations, advantages, limitations, difficulties in the application process and theoretical countermeasures. The respondents believed that objective performance criteria single arm trial could be used as an alternative plan when controlled trials could not be carried out, or as a preliminary exploration or evidence supplement. It had the advantages of reducing sample size, good patient compliance, saving resource input, and relatively rigorous design. However, its application was limited due to low awareness and unclear level of evidence. The application difficulties included the setting of objective performance criteria, sample size calculation, quality control and statistical analysis. It was suggested to form a standard to promote its application in the efficacy evaluation of traditional Chinese medicine. Conclusion The design of objective performance criteria single arm trial is consistent with the characteristics of clinical research of traditional Chinese medicine. However, because there is no control group, the validity of objective performance criteria single arm trial is challenged, which hinders its further application in the clinical efficacy evaluation of traditional Chinese medicine. By standardizing the selection of objective performance criteria, calculation of sample size, statistical analysis methods and research implementation steps, the strength of its demonstration and the recognition can be improved to a certain extent, but attention should be paid to avoid its misuse. In the future, the objective performance criteria single arm trial may be used as a basis to further explore the new direction of scientific research methods for clinical efficacy evaluation of traditional Chinese medicine.
Objective The modification of Chinese patent medicines (CPM) instructions is currently the focus of national drug regulation, with policies and regulations being established. Nevertheless, the policies pertaining to CPM instructions have not been thoroughly investigated. This study analyzes the direction and current issues with existing policy items to give a reference for future optimization and adjustment of policies linked to CPM instructions. Methods The official website of the National Medical Products Administration (NMPA) and National Health Commission (NHC) were searched to collect policy documents related to the CPM instructions issued at the national level in China from January 1st 2000 to June 1st 2024. Based on the classification of policy tools (supply-based policy tools, demand-based policy tools, environment-based policy tools) and the dimension of policy development (policy planning, policy implementation, policy supervision, and policy evaluation ), a two-dimensional analytical framework of "policy tools and policy process" was constructed by using the content analysis method and the quantitative analysis method, and policy documents were analyzed. Results The 27 policy texts included in the analysis generated 104 policy entries in total, wherein, environment-based policy tools (74.04%) were used the most in the dimension of policy tools, followed by demand-based policy tools (24.04%) and supply-based policy tools (1.92%). In the dimension of policy development, policy planning tools, policy implementation tools, policy supervision tools, and policy evaluation tools accounted for 24.04%, 52.88%, 17.31%, and 5.77%, respectively. An in-depth analysis of the content of the policy entries discovered that the existing policy took into account the specification of the content of the instruction and the standardization of the expression of writing, the instruction application guidance, etc, and more and more attention was being paid to the content of the characteristics of TCM in the instruction. Conclusion Currently, there is an insufficient amount of policy documents on CPM standards, which are overly focused on environment-based policy tools and the policy implementation process. To achieve the policy goal of regulating and applying CPM specifications, it is recommended to create a balanced and coordinated structure of policy instruments, emphasise the direct promotion and pulling effect of supply and demand, increase the weight of policy evaluation and supervision, and develop a standard system for evaluating CPM specifications.
ObjectiveTo explore the parameter selection of different sample size estimation methods and the differences in estimation results in single-group target value clinical trials with rate as the outcome evaluation index. MethodsWe conducted a literature review to assess the method of target value selection for single-group target value clinical trials. Then, different values of target value (P0), clinical expected value (P1), and class II error level (β) were set through numerical simulation. Sample size results estimated using different sample size estimation methods were obtained using PASS software. The coefficient of variation, range/mean, analysis of variance and other methods were used to compare the differences between different methods. ResultsAnalysis of the data simulation results showed: when the expected value P1 was fixed, the sample size first decreased rapidly and then decreased slowly along with the increase or decrease of the targeted value P0 on both sides of the sample size limit value. When the difference between P0 and P1 was within 0.15, the ratio before and after correction could be controlled within 0.9. When the difference between P0 and P1 was more than 0.6, the ratio before and after correction approached 0.5. When P0+P1≈1, the ratio of different standard error choices (Sp0 or Sp1) to the estimated sample size was close to 1. When 0.65<P0+P1<1.35, the ratio of different standard error choices (Sp0 or Sp1) to the estimated sample size was about 3:1. When the confidence was 0.8, P0 and P1 were between 0.25 and 0.75 and between 0.20 and 0.80, respectively. We found little difference among the sample sizes estimated using these five methods (CV<0.10, range/mean<0.2). ConclusionThere are some differences among different sample size estimation methods, however, when P0 and P1 values are around 0.5, the differences between different methods are small, suggesting that appropriate methods should be selected for sample size estimation.
When prioritizing clinical questions in the development of the clinical practice guidelines, clinical questions with high recognition and low variability, or high score and less disagreement among experts were often prioritized, while questions with high recognition but high variability were excluded. By this approach, clinical questions with practical value but also showed high variability due to different causes were not accepted as priorities. There were some methodological and clinical limitations by doing so. By summarizing the causes and connotations of expert opinion variability in terms of clinical experience, expertise and values, this paper analyzed the advantages of the variability quantification application, and proposed corresponding methodological recommendations, so as to provide references for guideline developers in the priority selection of clinical questions.
In the formulation of the clinical question of traditional Chinese medicine clinical practice guidelines, even if the intervention elements (intervention or control) have an appropriate scope, guideline developers are still faced with a variety of interventions. By analyzing the difficulty and necessity of priority selection of intervention interventions, we propose the approach of extending expert evidence to the process of priority selection of intervention interventions, and further provide the methodology of expert evidence data collection table design, application, data presentation and expert decision-making method to provide references and guidance for guideline developers.
As evidence-based practice (EBP) continues to be valued, the guideline implementation has become an important field for research and practice in health care. In order to better guide the guideline implementation in the field of health care, this paper combines the EBP experience gained from several EBP programs carried out in our hospital those years, in aim of exploring and sharing the methodology of guideline implementation in domestic clinical settings.
Currently, the recommendations of the clinical practice guidelines related to acupuncture in China and abroad are opaque to the source of the acupuncture prescription, there is a lack of comprehensive evaluation of the rationality of the acupuncture prescription, and the standards for the selection of the acupuncture prescription are opaque and nonstandard, and the writing and reporting details are insufficient, thus affecting the clinical applicability of the guidelines. To a certain extent, the utilization rate of the recommendations of the guidelines is low. This paper discusses the origin, rationality comprehensive evaluation, priority selection, writing and reporting of acupuncture prescriptions, and puts forward detailed methodological suggestions, to provide guidance makers of methodological optimization thoughts and suggestions for the evaluation, selection and writing of acupuncture prescriptions in the recommendations.