The below evaluation is an example of the types of information you may find when using our Model to assess specific apps. This sample evaluation is not intended to enable you to make a decision about choosing these specific apps for actual use, as such a decision is a personal one that you will make based on your own unique preferences, needs, and evaluation. We strongly encourage you to download these apps for yourself and use our Model to conduct your own assessment.
This evaluation was completed December 6th and 7th, 2019, and is based on publicly available information found by our Panel at that time. In June 2020, APA's contacted the app developers and offered to them an opportunity to provide feedback on these assessments. Comments from developers who responded are included here. These comments do not necessarily reflect publicy available information at the time of the original assessment or presently.
Access & Background
On which platforms/operating systems does the app work? Does it also work on desktop?
iOS and Android (Google Play).
Has the app been updated in the last 180 days?
No, the iOS version was last updated more than a year ago, and the Android Google Play Store version was updated three years ago.
Does the app identify ownership?
Yes, the Defense Health Agency Center for Connected Health (formerly the National Center for Telehealth and Technology).
Does the app identify funding sources and conflicts of interest?
No.
Does the app come from a trusted source?
Yes, the app was developed by the Defense Health Agency.
Does the app claim to be medical?
No.
Are there additional or hidden costs?
No.
Does the app work offline?
Yes.
Does the app work with accessibility features of the iPhone/Android? Is it accessible for those with impaired vision or other disabilities?
Unclear.
Privacy & Safety
Is there a transparent privacy policy that is clear and accessible before use?
None that the reviewer could find.
Does the app collect, use, and/or transmit sensitive data? If yes, does it claim to do so securely?
It can collect sensitive data from the user. In the "Help" section, it does not state what "anonymous data" are being sent, nor to whom, so this reviewer was unable to determine if it is done so securely.
Does the app declare data use and purpose?
Not that the reviewer could find.
Does the app describe use of PHI?
Not that the reviewer could find.
Can you opt out of data collection or delete data?
Data can be cleared from the app.
Is data maintained in the device or on the web?
Data is maintained on the device.
Does the app explain security systems used?
Unclear if data are encrypted. A PIN and 2 security questions are used for security.
What third parties does the app share data with?
Answer is not readily apparent.
If appropriate, is the app equipped to respond to potential harms or safety concerns?
Does not appear to be: typing "suicide" in the journal section does not result in action by the app.
Clinical Foundation
Does the app appear to do what it claims to do?
Yes. The app tracks and graphs mood patterns.
Is there evidence of specific benefit from academic institutions, publications, end user feedback or research studies?
Yes, Utility of the T2 Mood Tracker mobile application among army warrior transition unit service members
Mil. Med., 179 (12) (2014), pp. 1453-1457.
Does the app have a clinical/recovery foundation relevant to your intended use?
Yes, for mood tracking.
Is the app content correct, well-written, and relevant?
Somewhat. It could benefit from additional in-app descriptions of functions and options.
What are the relevant sources or references supporting the app use cases?
There are some studies by the DHA. For example, Bush et al. (2014); Mil. Med., 179 (12) (2014), pp. 1453-1457.
Was there an attempt to validate app usability and feasibility?
Yes.
Is there evidence of effectiveness/efficacy?
Usability
Does the app seem easy to use?
There appear to be no obvious difficulties in use; however, it may not be intuitive for some users, in the opinion of this reviewer. Some in-app features may take more time and effort to interpret or use.
What are the main engagement styles of the app?
App uses alarms, requests for entering and tracking moods.
Do the app and its features align with your needs and priorities?
Yes, with respect to the needs and priorities of this reviewer.
Is it customizable?
Yes, user can customize the mood tracking function to their needs.
Does the app clearly define its functional scope?
Yes, this app claims to be a mood tracker and according to this reviewer, that is what this app does.
Therapeutic Goal
Can data be easily shared and interpreted in a way that's consistent with the stated purpose of the app?
No. The app says it can, but the functions do not work. iOS graph does not show any data. Google Play Android version buttons for "Saved Reports" and "Create Reports" do not do anything unless you have provided storage access permissions in the very first introduction screen, and the need for the user to grant permissions is not clear.
Do you own your data?
No.
Can the app share data with EMR and other data tools (Apple HealthKit, FitBit)?
Fitbit functionality not tested.
Is the app for individual use or to be used in collaboration with a provider? If intended to be used with a provider, does the app have the ability to export or transfer data?
Not readily apparent to this reviewer. User should determine.
Does the app lead to any positive behavior change or skill acquisition?
Not readily apparent to this reviewer. User should determine.
Does the app improve therapeutic alliance between patient and provider?
Not readily apparent to this reviewer. User should determine.