The below evaluation is an example of the types of information you may find when using our Model to assess specific apps. This sample evaluation is not intended to enable you to make a decision about choosing these specific apps for actual use, as such a decision is a personal one that you will make based on your own unique preferences, needs, and evaluation. We strongly encourage you to download these apps for yourself and use our Model to conduct your own assessment.
This evaluation was completed December 6th and 7th, 2019, and is based on publicly available information found by our Panel at that time. In June 2020, APA's contacted the app developers and offered to them an opportunity to provide feedback on these assessments. Comments from developers who responded are included here. These comments do not necessarily reflect publicy available information at the time of the original assessment or presently.
Access & Background
On which platforms/operating systems does the app work? Does it also work on desktop?
Yes, iOS and Android.
Has the app been updated in the last 180 days?
No, last updated May 2019.
Does the app identify ownership?
Yes, the Advocates for Human Potential (AHP).
Does the app identify funding sources and conflicts of interest?
Yes, AHP funds the app. The reviewer was unable to find information about conflicts of interest.
Does the app come from a trusted source?
Yes, a peer expert.
Does the app claim to be medical?
No.
Are there additional or hidden costs?
No.
Does the app work offline?
Yes.
Does the app work with accessibility features of the iPhone/Android? Is it accessible for those with impaired vision or other disabilities?
No app accessibility settings are apparent within the app to this reviewer.
Privacy & Safety
Is there a transparent privacy policy that is clear and accessible before use?
The reviewer was able to find a privacy policy, but found it to be unclear.
Does the app collect, use, and/or transmit sensitive data? If yes, does it claim to do so securely?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.
Does the app declare data use and purpose?
This reviewer was unable to determine given information provided by the developer.
Does the app describe use of PHI?
This reviewer was unable to determine use of PHI given information provided by the developer.
Can you opt out of data collection or delete data?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.
Is data maintained in the device or on the web?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.
Does the app explain security systems used?
No.
What third parties does the app share data with?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.
If appropriate, is the app equipped to respond to potential harms or safety concerns?
Clinical Foundation
Does the app appear to do what it claims to do?
Yes.
Is there evidence of specific benefit from academic institutions, publications, end user feedback or research studies?
No; but traditional WRAP is associated with many positive benefits; not transparent on the website.
Does the app have a clinical/recovery foundation relevant to your intended use?
Yes, relapse prevention plan and self-management.
Is the app content correct, well-written, and relevant?
Yes.
What are the relevant sources or references supporting the app use cases?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.
Was there an attempt to validate app usability and feasibility?
Unclear.
Is there evidence of effectiveness/efficacy?
WRAP is an established, evidence-based treatment with positive benefits; unclear if the app supports the same positive benefits through virtual services.
Usability
Does the app seem easy to use?
Yes.
What are the main engagement styles of the app?
Wellness Toolbox; daily plans (Crisis, Post-Crisis, Daily Plans, etc.).
Do the app and its features align with your needs and priorities?
Yes, with respect to the needs and priorities of this reviewer.
Is it customizable?
Yes, can customize treatment plans.
Does the app clearly define its functional scope?
Therapeutic Goal
Can data be easily shared and interpreted in a way that's consistent with the stated purpose of the app?
The app will email users' WRAP plans.
Do you own your data?
Unclear.
Can the app share data with EMR and other data tools (Apple HealthKit, FitBit)?
Unclear.
Is the app for individual use or to be used in collaboration with a provider? If intended to be used with a provider, does the app have the ability to export or transfer data?
Yes, the user can e-mail WRAP App-collected user information to provider for treatment purposes.
Does the app lead to any positive behavior change or skill acquisition?
Traditional WRAP is associated with positive features and outcomes; unclear to this reviewer based on evidence provided as to whether the WRAP app replicates this as-is.
Does the app improve therapeutic alliance between patient and provider?
This reviewer was unable to determine a clear answer to this question given information provided by the developer.