Powered by the Evidence-based Practice Centers
SHARE:
FacebookTwitterFacebookPrintShare

Evaluation of Mental Health Mobile Applications

Technical Brief May 20, 2022
Evaluation of Mental Health Mobile Applications

Main Points

  • We developed and pilot tested a framework to assess mental health mobile applications (apps).
  • The Framework to Assist Stakeholders in Technology Evaluation for Recovery (FASTER) to Mental Health and Wellness assesses the risk/safety, technical functionality, and mental health features of apps.
  • FASTER can be used by advocacy organizations, payers, healthcare systems, and others to inform selection of mental health mobile apps.

Structured Abstract

Background. Mental health mobile applications (apps) have the potential to expand the provision of mental health and wellness services to traditionally underserved populations. There is a lack of guidance on how to choose wisely from the thousands of mental health apps without clear evidence of safety, efficacy, and consumer protections.

Purpose. This Technical Brief proposes a framework to assess mental health mobile applications with the aim to facilitate selection of apps. The results of applying the framework will yield summary statements on the strengths and limitations of the apps and are intended for use by providers and patients/caregivers.

Methods. We reviewed systematic reviews of mental health apps and reviewed published and gray literature on mental health app frameworks, and we conducted four Key Informant group discussions to identify gaps in existing mental health frameworks and key framework criteria. These reviews and discussions informed the development of a draft framework to assess mental health apps. Iterative testing and refinement of the framework was done in seven successive rounds through double application of the framework to a total of 45 apps. Items in the framework with an interrater reliability under 90 percent were discussed among the evaluation team for revisions of the framework or guidance.

Findings. Our review of the existing frameworks identified gaps in the assessment of risks that users may face from apps, such as privacy and security disclosures and regulatory safeguards to protect the users. Key Informant discussions identified priority criteria to include in the framework, including safety and efficacy of mental health apps. We developed the Framework to Assist Stakeholders in Technology Evaluation for Recovery (FASTER) to Mental Health and Wellness and it comprises three sections: Section 1. Risks and Mitigation Strategies, assesses the integrity and risk profile of the app; Section 2. Function, focuses on descriptive aspects related to accessibility, costs, organizational credibility, evidence and clinical foundation, privacy/security, usability, functions for remote monitoring of the user, access to crisis services, and artificial intelligence (AI); and Section 3. Mental Health App Features, focuses on specific mental health app features, such as journaling and mood tracking.

Conclusion. FASTER may be used to help appraise and select mental health mobile apps. Future application, testing, and refinements may be required to determine the framework’s suitability and reliability across multiple mental health conditions, as well as to account for the rapidly expanding applications of AI, gamification, and other new technology approaches.

Citation

Agarwal S, Jalan M, Wilcox HC, Sharma R, Hill R, Pantalone E, Thrul J, Rainey JC, Robinson KA. Evaluation of Mental Health Mobile Applications. Technical Brief 41. (Prepared by the Johns Hopkins University Evidence-based Practice Center under Contract No. 75Q80120D00003.) AHRQ Publication No. 22-EHC016. Rockville, MD: Agency for Healthcare Research and Quality; May 2022. DOI: https://doi.org/10.23970/AHRQEPCTB41. Posted final reports are located on the Effective Health Care Program search page.

Project Timeline

Evaluation of Mental Health Applications

Mar 1, 2021
Topic Initiated
May 3, 2021
May 20, 2022
Technical Brief
Page last reviewed June 2022
Page originally created May 2022

Internet Citation: Technical Brief: Evaluation of Mental Health Mobile Applications. Content last reviewed June 2022. Effective Health Care Program, Agency for Healthcare Research and Quality, Rockville, MD.
https://effectivehealthcare.ahrq.gov/products/mental-health-apps/report

Select to copy citation