Email Alert RSS
Volume 14 Issue 2
Mar.  2023
Turn off MathJax
Article Contents
Abstract
References
Related Articles
LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. DOI: 10.12290/xhyxzz.2022-0317
Citation: LIU Hui, SU Renfeng, SHI Anya, YAO Yuanyuan, ZHOU Qi, WANG Zijun, TIE Rui, LU Mengying, ZHANG Hao, SUN Haonan, ZHAO Junxian, ZHAO Siya, YANG Kehu, LIU Xingrong, CHEN Yaolong. Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(2): 390-398. DOI: 10.12290/xhyxzz.2022-0317
shu

Methodological Quality Analysis of Systematic Review/Meta-analysis Published in Chinese Science Citation Database Journals

  • 1.

    School of Public Health, Lanzhou University, Lanzhou 730000, China

  • 2.

    The Second Clinical Medical Hospital, Lanzhou University, Lanzhou 730000, China

  • 3.

    Evidence-based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou 730000, China

  • 4.

    The First School of Clinical Medicine, Lanzhou University, Lanzhou 730000, China

  • 5.

    Institute of Health Data Science, Lanzhou University, Lanzhou 730000, China

  • 6.

    Research Unit of Evidence-based Evaluation and Guidelines, Chinese Academy of Medical Sciences, School of Basic Medical Sciences, Lanzhou University, Lanzhou 730000, China

  • 7.

    WHO Collaborating Center for Guideline Implementation and Knowledge Translation, Lanzhou 730000, China

  • 8.

    Lanzhou University, An Affiliate of the Cochrane China Network, Lanzhou 730000, China

  • 9.

    Lanzhou University GRADE Center, Lanzhou 730000, China

Funds: 

Fundamental Research Funds for the Central Universities lzujbky-2021-ey13

CAMS Innovation Fund for Medical Sciences- Research Unit of Evidence-based Evaluation and Guidelines 2021RU017

Lanzhou University "Belt and Road Initiative" Special Fund 

More Information
  • Corresponding author:

    LIU Xingrong, E-mail: liuxr@lzu.edu.cn

    CHEN Yaolong, E-mail: chevidence@lzu.edu.cn

  • Received Date: June 08, 2022
  • Accepted Date: July 03, 2022
  • Available Online: July 26, 2022
  • Issue Publish Date: March 29, 2023
    Graphical Abstract
    • Abstract
  •   Objective  To evaluate the methodological quality of systematic review/meta analysis (SR/MA) published in Chinese Science Citation Database (CSCD) journals in 2020, with the aim of providing suggestions for researchers in China to develop SR/MA and reference for editors and reviewers to review SR/MA.
      Methods  The list of journals was formed with a sample of journals published by the Chinese Medical Association Publishing House and included in CSCD. Four researchers working in pairs conducted independently manual searches on the official websites of the journals to include SR/MA published in 2020, and one researcher conducted a supplementary search on China National Knowledge Infrastructure. After identifying the included literature, the researchers worked in pairs to extract information independently, evaluated methodological quality by using AMSTAR 2(A Measurement Tool to Assess Systematic Reviews 2) and performed statistical analysis of the results.
      Results  A total of 79 journals from the Chinese Medical Association Publishing House were included in CSCD, 46 of which published SR/MA in 2020, and 126 SR/MA were included for analysis after screening according to inclusion and exclusion criteria. AMSTAR 2 evaluation results showed that the average score of SR/MA was 10.38±1.91. The scored proportion of 9 items was more than 70%. SR/MA met partially/met a minimum of 5 AMSTAR 2 items and a maximum of 12 items. Before the key items were adjusted, over 90% of SR/MA's credibility rating was critically low. After adjusting the key items according to the actual Chinese situation, about 40% of SR/MA's credibility rating was medium and low, respectively. The results of the stratified analysis showed that the use of GRADE, adherence to the PRISMA statement, the number of authors greater than 5, the language of publication, the type of included studies including RCTs, and the reporting of funding were not factors that influenced the methodological quality of SR/MA.
      Conclusions  The methodological quality of SR/MA published in CSCD journals in 2020 need to improve. Attention should be paid to the registration, retrieval, inclusion and exclusion criteria of SR/MA as well as financial support, so as to effectively improve the quality of SR/MA.
    • FullText(HTML)
    • References (39)
  • [1]
    Muka T, Glisic M, Milic J, et al. A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research[J]. Eur J Epidemiol, 2020, 35: 49-60. DOI: 10.1007/s10654-019-00576-5
    [2]
    靳英辉, 吴世文, 拜争刚, 等. 系统评价与Meta分析的内涵及价值[J]. 同济大学学报(医学版), 2019, 40: 105-111. https://www.cnki.com.cn/Article/CJFDTOTAL-TJIY201901021.htm
    [3]
    Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on[J]. Lancet, 2017, 390: 415-423. DOI: 10.1016/S0140-6736(16)31592-6
    [4]
    李幼平, 刘雪梅. 系统评价的起源、发展和作用[J]. 中国循证医学杂志, 2011, 11: 2-6. DOI: 10.3969/j.issn.1672-2531.2011.01.002
    [5]
    Manchikanti L. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management, part I: introduction and general considerations[J]. Pain Physician, 2008, 11: 161-186.
    [6]
    Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences[J]. JAMA, 2005, 293: 2362-2366. DOI: 10.1001/jama.293.19.2362
    [7]
    Young C, Horton R. Putting clinical trials into context[J]. Lancet, 2005, 366: 107-108. DOI: 10.1016/S0140-6736(05)66846-8
    [8]
    Ioannidis JP, Greenland S, Hlatky MA, et al. Increasing value and reducing waste in research design, conduct, and analysis[J]. Lancet, 2014, 383: 166-175. DOI: 10.1016/S0140-6736(13)62227-8
    [9]
    李秀霞, 郭康乐, 商雪, 等. 针刺临床有效性优势病症的系统评价再评价[J]. 中国循证医学杂志, 2021, 21: 703-709. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202106012.htm
    [10]
    王志稳, 冷敏敏, 赵雅洁, 等. 近5年我国护理领域干预性研究系统评价的方法学质量分析[J]. 中国护理管理, 2020, 20: 485-489. https://www.cnki.com.cn/Article/CJFDTOTAL-GLHL202004006.htm
    [11]
    钟娟, 郑芸, 李刚, 等. 中草药治疗变应性鼻炎系统评价再评价[J]. 中华中医药杂志, 2017, 32: 263-266. https://www.cnki.com.cn/Article/CJFDTOTAL-BXYY201701072.htm
    [12]
    王盼杰, 王稼祥, 蔡润津, 等. 我国学者发表系统评价再评价研究现状分析[J]. 中国药物评价, 2019, 36: 5-9. https://www.cnki.com.cn/Article/CJFDTOTAL-YAPJ201901003.htm
    [13]
    中华医学会杂志社指南与标准研究中心, 世界卫生组织指南实施与知识转化合作中心. 2020中华医学会系列杂志发表指南评价报告[J]. 中华医学杂志, 2021, 101: 1839-1847.
    [14]
    张方圆, 沈傲梅, 曾宪涛, 等. 系统评价方法学质量评价工具AMSTAR 2解读[J]. 中国循证心血管医学杂志, 2018, 10: 14-18. https://www.cnki.com.cn/Article/CJFDTOTAL-PZXX201801003.htm
    [15]
    Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both[J]. BMJ, 2017, 358: j4008.
    [16]
    葛龙, 潘蓓, 潘佳雪, 等. 解读AMSTAR-2: 基于随机和(或)非随机对照试验系统评价的质量评价工具[J]. 中国药物评价, 2017, 34: 334-338. https://www.cnki.com.cn/Article/CJFDTOTAL-YAPJ201705004.htm
    [17]
    方程, 邓巍, 樊景春, 等. 系统评价与Meta分析的注册平台简介[J]. 同济大学学报(医学版), 2019, 40: 380-387. https://www.cnki.com.cn/Article/CJFDTOTAL-TJIY201903023.htm
    [18]
    董悦颖. Meta分析方法学质量与报告质量评价的主要问题[J]. 中国卫生统计, 2017, 34: 1006-1008. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGWT201706048.htm
    [19]
    中华医学会杂志社.中华医学会系列杂志稿约通则[EB/OL]. (2008-12)[2022-03-24]. http://www.cmaph.org/r/cms/guanwang/pdf/web/viewer.html?file=/files/u/cms/guanwang/201910/25101508od3v.pdf.
    [20]
    Cao L, Yao L, Hui X, et al. Clinical Epidemiology in China series. Paper 3: The methodological and reporting quality of systematic reviews and meta-analyses published by China' researchers in English-language is higher than those published in Chinese-language[J]. J Clin Epidemiol, 2021, 140: 178-188.
    [21]
    王虎城, 杨丰文, 庞稳泰, 等. 参附注射液治疗心力衰竭的系统评价再评价[J]. 中国中医急症, 2020, 29: 41-45. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYJZ202001011.htm
    [22]
    Gao Y, Cai Y, Yang K, et al. Methodological and reporting quality in non-Cochrane systematic review updates could be improved: a comparative study[J]. J Clin Epidemiol, 2020, 119: 36-46.
    [23]
    Ji Z, Zhang J, Menniti-Ippolito F, et al. The quality of Cochrane systematic reviews of acupuncture: an overview[J]. BMC Complement Med Ther, 2020, 20: 307.
    [24]
    Booth A, Clarke M, Ghersi D, et al. An international registry of systematic-review protocols[J]. Lancet, 2011, 377: 108-109.
    [25]
    陶欢, 杨乐天, 平安, 等. 随机或非随机防治性研究系统评价的质量评价工具AMSTAR 2解读[J]. 中国循证医学杂志, 2018, 18: 101-108. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201801017.htm
    [26]
    张旭, 左丽倩, 刘明秀, 等. 108篇系统评价或Meta分析的方法学质量评价: 基于AMSTAR-2[J]. 中国社会医学杂志, 2021, 38: 476-480. https://www.cnki.com.cn/Article/CJFDTOTAL-GWSY202104028.htm
    [27]
    张夏天, 胡烨胤, 张晓雨, 等. 2013-2017年发表的推拿系统评价的再评价[J]. 中国循证医学杂志, 2019, 19: 361-367. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201903019.htm
    [28]
    王娅, 刘艳飞, 王哲, 等. 2015-2019年中药治疗原发性高血压的系统评价再评价[J]. 中国循证医学杂志, 2019, 19: 1460-1469. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201912013.htm
    [29]
    王佳琳, 闫佰荟, 王璐, 等. 中文肿瘤学干预类Meta分析论文摘要报告质量评价分析[J]. 中华医学图书情报杂志, 2020, 29: 24-31. https://www.cnki.com.cn/Article/CJFDTOTAL-YXTS202010004.htm
    [30]
    周建国, 吕水萍, 张钰, 等. 中国学者在PROSPERO平台注册系统评价/Meta分析的现状调查[J]. 中国循证医学杂志, 2016, 16: 466-470. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201604014.htm
    [31]
    《临床肝胆病杂志》编辑部. 《临床肝胆病杂志》优先录用在PROSPERO平台注册的Meta分析[J]. 临床肝胆病杂志, 2020, 36: 2328. https://www.cnki.com.cn/Article/CJFDTOTAL-LCGD202010049.htm
    [32]
    王晓宇, 王虎城, 刘蕾蕾, 等. 小儿推拿类系统评价/Meta分析的质量评价[J]. 中国循证医学杂志, 2019, 19: 1106-1112. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ201909015.htm
    [33]
    韦所苏, 韦挥德, 黄晓红, 等. 1998-2014年《中华医学杂志》发表的Meta分析文献质量评价[J]. 中华医学杂志, 2015, 95: 621-626. https://www.cnki.com.cn/Article/CJFDTOTAL-ZYLN201611012.htm
    [34]
    DeAngelis CD, Fontanarosa PB. Impugning the integrity of medical science: the adverse effects of industry influence[J]. JAMA, 2008, 299: 1833-1835.
    [35]
    Yaphe J, Edman R, Knishkowy B, et al. The association between funding by commercial interests and study outcome in randomized controlled drug trials[J]. Fam Pract, 2001, 18: 565-568.
    [36]
    代欣玥, 张菀桐, 刘艳飞, 等. 高压氧治疗糖尿病足的系统评价再评价[J]. 中国循证医学杂志, 2020, 20: 809-816. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202007011.htm
    [37]
    谭香艺, 杨祎玲, 赵久波, 等. 正念冥想治疗创伤后应激障碍有效性及安全性的系统评价再评价[J]. 中国全科医学, 2021, 24: 2721-2728. https://www.cnki.com.cn/Article/CJFDTOTAL-QKYX202121017.htm
    [38]
    杨珂璐, 金鑫瑶, 刘明, 等. 中药注射剂治疗病毒性肺炎的系统评价再评价[J]. 中国循证医学杂志, 2020, 20: 1326-1333. https://www.cnki.com.cn/Article/CJFDTOTAL-ZZXZ202011013.htm
    [39]
    Werner SS, Binder N, Toews I, et al. Use of GRADE in evidence syntheses published in high-impact-factor nutrition journals: A methodological survey[J]. J Clin Epidemiol, 2021, 35: 54-69.
    • Related Articles

  • Related Articles

    [1]SUN Yuxin, HAN Bingtai, GUO Xiaoyuan, ZHENG Xueqing, CHEN Shi, YANG Hongbo, PAN Hui. Effect of Exercise on Blood Glucose Metabolism of Type 2 Diabetes Patients in East Asian Population: A Meta-Analysis[J]. Medical Journal of Peking Union Medical College Hospital, 2025, 16(2): 492-505. DOI: 10.12290/xhyxzz.2024-0296
    [2]LI Zhimao, WANG Dandi, ZHANG Ting, MEI Qimin, LIU Yecheng, ZHU Huadong. Comparative Efficacy of Amiodarone and Lidocaine in Patients with Cardiac Arrest: A Systematic Review and Meta-analysis[J]. Medical Journal of Peking Union Medical College Hospital, 2025, 16(2): 406-415. DOI: 10.12290/xhyxzz.2024-0840
    [3]SUN Yuxin, GUO Xiaoyuan, CHEN Shi, PAN Hui, ZHU Huijuan. Meta-Analysis of the Effect of Resistance Exercise Prescription on Glucose and Lipid Metabolism in Overweight and Obese Adults[J]. Medical Journal of Peking Union Medical College Hospital, 2025, 16(1): 235-247. DOI: 10.12290/xhyxzz.2024-0225
    [4]CHEN Tianren, DU Zhongying, TANG Lu, CHEN Wenqiang, WANG Chun'ai. Effect of Erector Plane Muscle Block and Thoracic Paravertebral Block on Postoperative Analgesia in Patients with Breast Cancer: A Meta-analysis[J]. Medical Journal of Peking Union Medical College Hospital. DOI: 10.12290/xhyxzz.2024-0351
    [5]WANG Ziyi, LU Cuncun, HUANG Jiayi, ZHANG Jinglei, SHANG Wenru, CUI Lu, LIU Wendi, DENG Xiuxiu, ZHAO Xiaoxiao, YANG Kehu, LI Xiuxia. Investigation and Evaluation of Systematic Reviews of Prediction Models Published in Chinese Journals: Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2024, 15(4): 927-935. DOI: 10.12290/xhyxzz.2023-0418
    [6]SU Renfeng, YU Xuan, SHI Qianling, LUO Xufei, SUN Yajia, LAN Hui, REN Mengjuan, WU Shouyuan, WANG Ping, WANG Ling, ZHAO Junxian, CHEN Yaolong. Current Situation and Progress of Evidence Synthesis Methodology[J]. Medical Journal of Peking Union Medical College Hospital, 2023, 14(6): 1301-1309. DOI: 10.12290/xhyxzz.2023-0062
    [7]LIU Yunlan, ZHANG Jingyi, SHI Qianling, YANG Nan, WANG Zijun, LUO Xufei, REN Mengjuan, XUN Yangqin, ZHOU Qi, LIU Hui, LYU Meng, CHEN Yaolong. Investigation and Evaluation of Chinese Clinical Practice Guidelines Published in Medical Journals in 2019:Methodological and Reporting Quality[J]. Medical Journal of Peking Union Medical College Hospital, 2022, 13(2): 324-331. DOI: 10.12290/xhyxzz.2022-0027
    [8]Yi-bing ZHU, Wei LI. How Do Clinicians Understand Meta-analysis[J]. Medical Journal of Peking Union Medical College Hospital, 2020, 11(3): 314-319. DOI: 10.3969/j.issn.1674-9081.20200073
    [9]Xiao-xia PENG. Methodological Limitations and Applicable Context of Meta-analysis[J]. Medical Journal of Peking Union Medical College Hospital, 2017, 8(6): 381-386. DOI: 10.3969/j.issn.1674-9081.2017.06.012
    [10]Ni XU, Cong-wei LIU, Fang-tian DONG. Dexamethasone Intravitreal Implant Compared with Anti-vascular Endothelial Growth Factor Injection for Macular Edema Secondary to Retinal Vein Occlusion: a Meta-analysis[J]. Medical Journal of Peking Union Medical College Hospital, 2016, 7(3): 168-175. DOI: 10.3969/j.issn.1674-9081.2016.03.002

  • Cited by

    Periodical cited type(28)

    1. 李妍，韩彤昕，毛华伟. 线上与线下医学人文教学结合应用的研究与探索. 中国继续医学教育. 2025(01): 185-188 .
    2. 李研，赵琳琳. 英美医学教育中戏剧元素的人文透视. 中国医学伦理学. 2025(03): 385-391 .
    3. 张慧颖，王锦帆，马宇昊，何源. 新时代中国医学人文研究热点及趋势探析. 中国医学伦理学. 2025(03): 336-345 .
    4. 王红宇，刘金强，丁俊杰，王红，孟志剑，唐聚花，张思森. 医患沟通技能培训在急重症医学住院医生规培中的应用. 中国现代医生. 2024(02): 74-76 .
    5. 向琳，王浩辰，黄天宇，何鲲. 基于“医教研德”复合型人才培养模式口腔种植学教学改革思考与探索. 中国医药导报. 2024(04): 70-73 .
    6. 俞婧，王瑞，武云. 基于VOSviewer的我国叙事医学相关文献的可视化分析及启示. 中国毕业后医学教育. 2024(03): 207-213 .
    7. 余航，安琪，金李，吴远，陈涛，肖懿慧. BOPPPS教学模式融合课程思政在本科生内科学见习中的应用. 医学教育研究与实践. 2024(03): 349-354 .
    8. 周殷华，程瑜，崔昌杰，田晓辉，符隆文，方婵，廖晓星，陈起坤. 医文融合视域下临床医学人文教学体系研究. 中国医学伦理学. 2024(07): 860-866 .
    9. 王京，贺欢欣，董智瑞，董健，赵明东. 住培医师人文素养的培育. 中国继续医学教育. 2024(20): 186-189 .
    10. 敖玲敏，沈菊. 中华优秀传统文化融入大学生心理健康教育的价值之维与实践之路. 黑龙江高教研究. 2024(12): 120-126 .
    11. 王倩，巩红，刘昌，李雁，李研，辛娟，张月浪. 以临床人文岗位胜任力为导向的医学人文多元教育渠道的探索. 医学教育研究与实践. 2023(01): 68-72 .
    12. 徐燕玲，顾漪. 临床医师医学人文认知现状调查. 中国现代医生. 2023(05): 135-138 .
    13. 冯悦，庞维，郑丽，李胜军，孙逊，冯辉. 新医科和新文科交叉融合对免疫学创新人才培养的探索性改革. 中国免疫学杂志. 2023(06): 1203-1206 .
    14. 柳舟，张亮，王璐，朱睿瑶，王慧娟，张静，雷佳羲，詹丽英. 重症医学科医学人文素质教育的改革与实践. 中国继续医学教育. 2023(12): 10-14 .
    15. 阳磊，彭蓓，张婉丽. 口腔科住院医师规范化培训医学人文教育改革实践. 经济研究导刊. 2023(12): 123-125 .
    16. 赵娟，徐斌. 进修医师自身免疫性肝炎临床带教体会. 继续医学教育. 2023(06): 129-132 .
    17. 刘琴，何自强，骆佳佳，冯凯娜. 以提升人文关怀能力为导向的护理学导论教学模式应用研究. 沈阳医学院学报. 2023(05): 540-543 .
    18. 谢佳君，何勇涛，黄国琼，秦宇彤，王方芳，栗昕，黄春基. 立德树人背景下医学生德育素质培养研究. 中国社会医学杂志. 2023(05): 540-543 .
    19. 吕晓龙，严旭，章涵. 以强化人文素养为导向的全科医学生叙事医学课程模式构建. 济源职业技术学院学报. 2023(04): 33-37 .
    20. 吕少春，宋汉君，栾海艳，何穆涵. 基于医学模拟教学的医学生临床能力培养研究. 医学教育研究与实践. 2022(03): 294-297 .
    21. 李超. 培养高素质临床医生路径分析. 继续医学教育. 2022(04): 61-64 .
    22. 冯矗，陈飞，张树霞，刘古月，李晓宇. 医学人文关怀教育融入外科实习的实践探索. 中医药管理杂志. 2022(11): 88-90 .
    23. 高铭，韩涛，池靖涵，杜振兰，杨常栓，侯豫，花少栋. 创新互动式医学人文教育在儿科住院医师规范化培训中的作用研究. 中国医学伦理学. 2022(07): 806-810 .
    24. 胡艳超，王洪涛，王怡雯，周戬平. 医学人文教育在心血管内科混合式教学中的应用. 医学教育研究与实践. 2022(05): 648-652 .
    25. 叶榆莹. 英语电影字幕翻译对医学生人文教育的作用探究. 才智. 2022(33): 62-65 .
    26. 陶庆才. 抗疫精神融入医学院校课程思政的研究与实践. 浙江医学教育. 2022(05): 268-270+299 .
    27. 张宏伟，熊梓彤，林芷伊. 英国医学人文关怀及其医学教育启示. 农垦医学. 2022(06): 561-564 .
    28. 祝贺，敖俊红，杨蓉娅，李海涛. 全媒体时代医学摄影的边界教育在皮肤病与性病科临床教学中的意义. 实用皮肤病学杂志. 2022(06): 367-369 .

    Other cited types(6)

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (971) PDF downloads (73) Cited by(34)
    Related
    Address：Room 302,Third Floor,Building 7, No. 1 Shuaifuyuan, Wangfujing, Dongcheng District, Beijing 100730, China
    Tel：010-69154261/4262
    E - mail：medj@pumch.cn mjpumch@126.com
    Copyright of website：Editorial Office of Medical Journal of Peking Union Medical College Hospital

      Supported by: Beijing Renhe Information Technology Co., Ltd.  Baidu Analytics

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return
      x Close Forever Close