大语言模型辅助循证健康科普作品制作的可行性验证

Feasibility of Large Language Models Assisting in the Creation of Health Science Popularization Works

  • 摘要: 目的 通过调研公众健康科普需求,设计大语言模型提示词,辅助制作循证健康科普作品,并进行质量评估以探讨其可行性。方法 采用问卷星调研公众健康生活方式信息需求,采用Kimi大语言模型制作健康科普作品,并根据文献和专家反馈优化提示词。由2名健康教育工作者采用DISCERN工具对生成作品进行独立评估,运用SPSS 24.0软件进行数据统计分析。结果 发布机构难以信任71.37%)、专业术语较多64.71%)和获取渠道不畅60.00%)是阻碍居民获取和使用健康信息的主要因素。提示词由系统提示词和用户提示词构成,包括角色设置的介绍、文本生成的内容、结构和输出格式的规范3部分,可有效指导大语言模型生成以标题、简介、具体干预、小结等规范结构,呈现通俗易懂的健康科普作品。优化提示词后,生成作品的DISCERN评分提高了4.40 ± 2.51)分,差异具有统计学意义P=0.04)。结论 健康科普是促进居民健康信息获取与使用的重要因素,通过开发提示词辅助大语言模型制作健康科普作品潜力巨大,能够为健康科普工作提供便利,提升其制作的科学性与效率。

     

    Abstract: Objective To explore the feasibility of using Large Language Models (LLMs) to generate evidence-based health science popularization materials by surveying public needs, designing specific prompts, and evaluating the quality of the generated content. Methods An online survey was conducted via SoJump platform to investigate public needs for healthy lifestyle information. The Kimi LLM was employed to generate health science popularization materials, with prompts optimized based on literature review and expert feedback. Two health educators independently evaluated the generated materials using the DISCERN instrument. Data were analyzed using SPSS 24.0 software. Results The primary barriers hindering residents from accessing and using health information were distrust of publishing institutions (71.37%), excessive use of technical terminology (64.71%), and inaccessible channels (60.00%). The designed prompts, consisting of system and user prompts, comprised three sections:role definition, content generation, and structure/output formatting specifications. These prompts effectively guided the LLM to produce accessible health science materials with a standardized structure, including a title, introduction, specific interventions, and summary. Following prompt optimization, the DISCERN scores of the generated materials increased by (4.40 ± 2.51) points, representing a statistically significant difference (P=0.04). Conclusion Health science popularization is a crucial factor in promoting the acquisition and utilization of health information among residents. Developing prompts to assist LLMs in creating health science materials holds significant potential; it facilitates health education work and enhances both the scientific accuracy and efficiency of content production.

     

/

返回文章
返回