The Evidence Library

What we actually know, and what we only repeat.

An annotated library of the research that matters on engagement and abandonment in digital mental health. Not a reading list. Every entry says what the study found and what I think it means for the people building, funding and buying these tools.

8 entries Updated August 2026

Why this exists

Most citations in this field are inherited, not read.

The same handful of statistics get passed between decks and grant applications until nobody remembers what the underlying study actually measured, or in what population, or how long ago.

This library is my working attempt to fix that for myself. Each entry is one I have read in full. Where I disagree with a paper, or think it is routinely over-claimed, I say so. Where the finding is solid and under-used, I say that too.

Every citation here has been verified against Crossref. If you find an error, tell me and I will correct it and note the correction.

The library

Filter by what you're chasing.

Newest annotations first. Citation counts are from Crossref and give a rough sense of how load-bearing each paper is in the field.

2019

Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis

Baumel, A., Muench, F., Edan, S., & Kane, J. M. Journal of Medical Internet Research, 21(9), e14567.

Independently collected usage data across 93 popular mental health apps, not developer-reported numbers. Median daily active user rate was 4.0%. Median 15-day retention was 3.9%, and median 30-day retention was 3.3%.

This is the single most important number in the field and it is still routinely softened in decks to "engagement is a challenge." Three in a hundred users are still there after a month. The reason it matters is the source: this is panel data, not self-report and not the developer's own analytics, which is exactly where optimistic numbers usually come from. If you are building in this space and your retention projections do not start from something like this baseline, you are planning against a fiction.

Read the paper 921 citations
  • Engagement
  • Real-world data
2020

Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review

Linardon, J., & Fuller-Tyszkiewicz, M. Journal of Consulting and Clinical Psychology, 88(1).

A meta-analysis of dropout and adherence across smartphone mental health trials, establishing that attrition is substantial even under the favorable conditions of a controlled study with recruited, consented, often compensated participants.

Read this next to Baumel and the gap does the arguing for you. Trial attrition is bad; real-world attrition is far worse. That gap is the most under-discussed number in digital mental health, because efficacy is established in the first condition and the product ships into the second. An intervention that works in people who stay is not the same claim as an intervention that works.

Read the paper 558 citations
  • Meta-analysis
  • Attrition
2004

Inhibitors and Enablers as Dual Factor Concepts in Technology Usage

Cenfetelli, R. T. Journal of the Association for Information Systems, 5(11).

Argues that the things which discourage technology use are not simply the absence of the things that encourage it. Inhibitors and enablers operate as independent dimensions rather than opposite ends of one scale.

Twenty years old, from outside health entirely, and still the most useful theoretical frame available for this problem. It is the foundation my own instrument is built on. The practical consequence is the part teams miss: removing friction and adding value are different interventions with different returns, and doing one well does not substitute for the other. A product can be delightful and still bleed users, because delight does not cancel friction. It sits beside it.

Read the paper 220 citations
  • Foundational
  • Dual-factor
2017

Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies

Greenhalgh, T., Wherton, J., Papoutsi, C., et al. Journal of Medical Internet Research, 19(11), e367.

The NASSS framework. Locates the reasons health technologies fail across seven domains, from the condition itself to the wider system, arguing that complexity in any domain predicts non-adoption or abandonment.

The most cited thing on this list by a wide margin, and deservedly, but it is frequently used as a citation rather than as a tool. NASSS is a framework for organizational and system complexity. It is excellent at explaining why a telehealth program dies in a health system, and it was never designed to tell a product team which screen is losing them users on Tuesday. Both questions are real. Reaching for NASSS to answer the second one is a category error I see often in grant applications.

Read the paper 2,186 citations
  • NASSS
  • Implementation
2025

Investigating Post-adoption Abandonment of Mental Health Mobile Applications among Young Adults

Harris, D. Two-stage study, University at Albany, 2025. Recognized for distinguished research contribution.

Two studies. Topic modeling and semantic classification across 170,127 user reviews, then a survey of 314 young adults. Inhibitors retained a direct effect on abandonment even after controlling for satisfaction and perceived usefulness. It also identified a graduation effect: users who discontinue after achieving the outcome they came for.

The finding I did not expect and now consider the most practically important is the graduation effect. It means a meaningful share of what the field counts as failure is success wearing the same clothes, and no engagement dashboard currently distinguishes them. The honest limitation: the sample is young adults, cross-sectional, and the model operates at the composite level. Anyone applying it to a clinical or older population should say so out loud.

Read it in full Open access
  • My work
  • Graduation effect
2024

Exploring Digital Affordances in Online Mental Health Resources: A Scoping Review of Methodologies and Populations

Harris, D. International Journal of Human–Computer Interaction.

A scoping review mapping how digital affordances in online mental health resources have been studied, and in whom.

What struck me writing it was how narrow the studied populations are relative to the populations these tools are marketed to. The methodological range is wide; the demographic range is not. That mismatch should make anyone cautious about generalizing engagement findings, mine included.

Read the paper
  • My work
  • Scoping review
2024

Crisis Intercept Mapping for Community-Based Suicide Prevention: An Assessment of the Crisis Infrastructure and Future Considerations for 988

Harris, B. R., Harris, D., Flanagan, E., Mariani, A., & Hay, T. A. Community Mental Health Journal.

An assessment of community crisis infrastructure using a structured mapping method, with implications for how 988 functions at the local level.

Included here because the failure mode is the same one at a different scale. People fall out of crisis systems at the handoffs between services, exactly as they fall out of apps at the transitions between screens. In both cases the loss is invisible to whoever owns only one segment of the path.

Read the paper
  • My work
  • Crisis systems
2023

Exploring the Association Between Suicide Prevention Public Service Announcements and User Comments on YouTube: A Computational Text Analysis Approach

Harris, D., & Krishnan, A. Journal of Health Communication.

Computational text analysis of public responses to suicide prevention messaging, examining what audiences actually say back to campaigns designed to reach them.

This is where my method started. Large-scale user-generated text is an underused evidence source in this field, partly because it is messy and partly because it says things campaigns would rather not hear. It is also, unlike a survey, unprompted. People are telling you what they think without being asked a question that shapes the answer.

Read the paper
  • My work
  • Text analysis

Putting it to work

Reading it is
the easy part.

A Friction Audit applies this evidence base to one specific product: what is likely driving your users out, which friction to fix first, and whether the churn you're seeing is failure or graduation.