Evaluating the Akari AI Platform for Health Content Creators
Problem
Developers and funders lack evidence on whether AI-assisted health content informs audiences better than non-AI-assisted posts on social media.
Content creators on social media play an important role in shaping public understanding of health for audiences who increasingly look to digital platforms for information. However, the accuracy and effectiveness of creator-generated health content can vary widely.
Akari is an AI-powered platform designed to help creators produce accurate, engaging health content. While such platforms offer structured guidance to improve content quality and alignment with evidence, the real-world impact of the content on audience knowledge, attitudes, and beliefs has not been tested. Science to People initiated this evaluation to generate evidence on whether Akari’s AI-assisted health content is more effective than traditional, non-AI-assisted approaches.
Solution
NORC designed a randomized study with a nationally representative sample, comparing content made using Akari to content made without AI assistance.
NORC partnered with Science to People to design and implement the evaluation. We advised on the theoretical model guiding the evaluation and developed a research plan.
We fielded a survey on AmeriSpeak®, NORC’s probability-based panel designed to represent the U.S. household population, reaching approximately 1,000 respondents. Respondents completed baseline measures of health knowledge, attitudes, and beliefs before being randomly assigned to view either Akari-assisted content or content created without AI. Follow-up questions measured changes after exposure to the content and differences between exposure groups.
Result
The evaluation produced direct evidence on effectiveness of Akari’s AI-assisted health content.
Our analyses of the survey data revealed how Akari-assisted creator content impacted respondents’ health knowledge, attitudes, and beliefs compared to traditional content approaches. We delivered a summary report, demographic banner tables, and weighted raw data files with respondent profile variables.
The findings informed decisions about the Akari’s ongoing development priorities. Our study also provides a replicable model for funders and developers to evaluate other emerging health communication tools.
Related Tags
Project Leads
-
Amelia Burke-Garcia
DirectorPrincipal Investigator -
Rachel (Kappel) Van Vleet
Research ScientistProject Director -
Kara Rader
Research ScientistSurvey Analysis Lead