Background: Apps for smartphones are opening an important range of opportunities for improving the care of people with alcohol use disorders (AUDs). Aims: This study aimed to evaluate the quality of English language apps for AUDs and to compare paid and free apps. The keywords ‘alcohol', ‘alcohol addiction', ‘alcohol help' and ‘stop drinking' were entered into the iTunes Store search engine. Apps were evaluated using a standardized assessment designed to rate the quality of apps in terms of accountability, interactivity, self-help score and evidence-based content. The Brief DISCERN score and the criteria of the ‘Health on the Net' label were also used as content quality indicators. Results and Conclusions: Of the 137 unique apps identified, 52 met the inclusion criteria. Overall, the content quality and self-help scores of these AUD apps were poor. The main quality indicators were not linked to payment status. Multiple linear regressions showed that the Brief DISCERN score significantly predicted content quality. Poor content quality and self-help scores of AUD smartphone apps underline the gap between their potential promises and the overall quality of available products in stores. The quality indicators used in the present study may be used for further app developments.

Keywords:
Internet, Apps, Smartphone, Alcohol, Alcohol use disorder, Internet interventions, Cognitive behavior therapy
1.
Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, Burstein R, Murray CJ, Vos T: Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet 2013;382:1575-1586.
2.
Colom J, Scafato E, Segura L, Gandin C, Struzzo P: Brief interventions implementation on alcohol from the European health systems perspective. Front Psychiatry 2014;5:161.
3.
Saunders SM, Zygowicz KM, D'Angelo BR: Person-related and treatment-related barriers to alcohol treatment. J Subst Abuse Treat 2006;30:261-270.
4.
Wallace P, Bendtsen P: Internet applications for screening and brief interventions for alcohol in primary care settings - implementation and sustainability. Front Psychiatry 2014;5:151.
5.
Healey A, Kay-Lambkin F, Bowman J, Childs S: Avoiding emotional bonds: an examination of the dimensions of therapeutic alliance among cannabis users. Front Psychiatry 2013;4:70.
6.
Milward J, Day E, Wadsworth E, Strang J, Lynskey M: Mobile phone ownership, usage and readiness to use by patients in drug treatment. Drug Alcohol Depend 2015;146:111-115.
7.
Giroux D, Bacon S, King DK, Dulin P, Gonzalez V: Examining perceptions of a smartphone-based intervention system for alcohol use disorders. Telemed J E Health 2014;20:923-929.
8.
Aboujaoude E, Salame W, Naim L: Telemental health: a status update. World Psychiatry 2015;14:223-230.
9.
Trefflich F, Kalckreuth S, Mergl R, Rummel-Kluge C: Psychiatric patients' internet use corresponds to the internet use of the general public. Psychiatry Res 2015;226:136-141.
10.
Khazaal Y, Chatton A, Cochand S, Hoch A, Khankarli MB, Khan R, Zullino DF: Internet use by patients with psychiatric disorders in search for general and medical informations. Psychiatr Q 2008;79:301-309.
11.
Raiff BR, Jarvis BP, Turturici M, Dallery J: Acceptability of an internet-based contingency management intervention for smoking cessation: views of smokers, nonsmokers, and healthcare professionals. Exp Clin Psychopharmacol 2013;21:204-213.
12.
Khazaal Y, Chatton A, Monney G, Nallet A, Khan R, Zullino D, Etter JF: Internal consistency and measurement equivalence of the cannabis screening questions on the paper-and-pencil face-to-face assist versus the online instrument. Subst Abuse Treat Prev Policy 2015;10:8.
13.
BinDhim NF, Shaman AM, Trevena L, Basyouni MH, Pont LG, Alhawassi TM: Depression screening via a smartphone app: cross-country user characteristics and feasibility. J Am Med Inform Assoc 2015;22:29-34.
14.
Mosa AS, Yoo I, Sheets L: A systematic review of healthcare applications for smartphones. BMC Med Inform Decis Mak 2012;12:67.
15.
Proudfoot J, Parker G, Hadzi Pavlovic D, Manicavasagar V, Adler E, Whitton A: Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res 2010;12:e64.
16.
Cortez NG, Cohen IG, Kesselheim AS: FDA regulation of mobile health technologies. N Engl J Med 2014;371:372-379.
17.
Codyre P: Will an app fill the gap? Innovative technology to provide point-of-care information. Front Public Health 2014;2:9.
18.
Martínez-Pérez B, de la Torre-Díez I, López-Coronado M: Mobile health applications for the most prevalent conditions by the world health organization: review and analysis. J Med Internet Res 2013;15:e120.
19.
Becker S, Miron-Shatz T, Schumacher N, Krocza J, Diamantidis C, Albrecht UV: mHealth 2.0: experiences, possibilities, and perspectives. JMIR Mhealth Uhealth 2014;2:e24.
20.
Boulos MN, Brewer AC, Karimkhani C, Buller DB, Dellavalle RP: Mobile medical and health apps: state of the art, concerns, regulatory control and certification. Online J Public Health Inform 2014;5:229.
21.
Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J: A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med 2013;45:732-736.
22.
Abroms LC, Padmanabhan N, Thaweethai L, Phillips T: iPhone apps for smoking cessation: a content analysis. Am J Prev Med 2011;40:279-285.
23.
Breton ER, Fuemmeler BF, Abroms LC: Weight loss-there is an app for that! But does it adhere to evidence-informed practices? Transl Behav Med 2011;1:523-529.
24.
Cohn AM, Hunter-Reel D, Hagman BT, Mitchell J: Promoting behavior change from alcohol use through mobile technology: the future of ecological momentary assessment. Alcohol Clin Exp Res 2011;35:2209-2215.
25.
Choi J, Noh GY, Park DJ: Smoking cessation apps for smartphones: content analysis with the self-determination theory. J Med Internet Res 2014;16:e44.
26.
Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D: Evidence-based strategies in weight-loss mobile apps. Am J Prev Med 2013;45:576-582.
27.
Bennett ME, Toffey K, Dickerson F, Himelhoch S, Katsafanas E, Savage CLG: A review of android apps for smoking cessation. J Smok Cessat 2015;10:106-115.
28.
Schoffman DE, Turner-McGrievy G, Jones SJ, Wilcox S: Mobile apps for pediatric obesity prevention and treatment, healthy eating, and physical activity promotion: just fun and games? Transl Behav Med 2013;3:320-325.
29.
Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R: Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health 2014;14:646.
30.
West JH, Hall PC, Hanson CL, Barnes MD, Giraud-Carrier C, Barrett J: There's an app for that: content analysis of paid health and fitness apps. J Med Internet Res 2012;14:e72.
31.
Azar KM, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, Palaniappan LP: Mobile applications for weight management: theory-based content analysis. Am J Prev Med 2013;45:583-589.
32.
Conroy MB, Yang K, Elci OU, Gabriel KP, Styn MA, Wang J, Kriska AM, Sereika SM, Burke LE: Physical activity self-monitoring and weight loss: 6-month results of the SMART trial. Med Sci Sports Exerc 2011;43:1568-1574.
33.
Conroy DE, Yang CH, Maher JP: Behavior change techniques in top-ranked mobile apps for physical activity. Am J Prev Med 2014;46:649-652.
34.
Pandey A, Hasan S, Dubey D, Sarangi S: Smartphone apps as a source of cancer information: changing trends in health information-seeking behavior. J Cancer Educ 2013;28:138-142.
35.
Breland JY, Yeh VM, Yu J: Adherence to evidence-based guidelines among diabetes self-management apps. Transl Behav Med 2013;3:277-286.
36.
Demidowich AP, Lu K, Tamler R, Bloomgarden Z: An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare 2012;18:235-238.
37.
Huckvale K, Car M, Morrison C, Car J: Apps for asthma self-management: a systematic assessment of content and tools. BMC Med 2012;10:144.
38.
Eng DS, Lee JM: The promise and peril of mobile health applications for diabetes and endocrinology. Pediatr Diabetes 2013;14:231-238.
39.
Robustillo Cortés Mde L, Cantudo Cuenca MR, Morillo Verdugo R, Calvo Cidoncha E: High quantity but limited quality in healthcare applications intended for HIV-infected patients. Telemed J E Health 2014;20:729-735.
40.
Mobasheri MH, Johnston M, King D, Leff D, Thiruchelvam P, Darzi A: Smartphone breast applications - what's the evidence? Breast 2014;23:683-689.
41.
Reynoldson C, Stones C, Allsop M, Gardner P, Bennett MI, Closs SJ, Jones R, Knapp P: Assessing the quality and usability of smartphone apps for pain self-management. Pain Med 2014;15:898-909.
42.
Pandher PS, Bhullar KK: Smartphone applications for seizure management. Health Informatics J 2016;22:209-220.
43.
Behar J, Roebuck A, Domingos JS, Gederi E, Clifford GD: A review of current sleep screening applications for smartphones. Physiol Meas 2013;34:R29-R46.
44.
Van Singer M, Chatton A, Khazaal Y: Quality of smartphone apps related to panic disorder. Front Psychiatry 2015;6:96.
45.
Nicholas J, Larsen ME, Proudfoot J, Christensen H: Mobile apps for bipolar disorder: a systematic review of features and content quality. J Med Internet Res 2015;17:e198.
46.
Norberg MM, Rooke SE, Albertella L, Copeland J, Kavanagh DJ, Lau AYS: The first mhealth app for managing cannabis use: gauging its potential helpfulness. J Addict Behav Ther Rehabil 2014;3:1-3.
47.
Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, Levy MS, Driscoll H, Chisholm SM, Dillenburg L, Isham A, Shah D: A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiatry 2014;71:566-572.
48.
Monney G, Penzenstadler L, Dupraz O, Etter JF, Khazaal Y: mHealth app for cannabis users: satisfaction and perceived usefulness. Front Psychiatry 2015;6:120.
49.
Comino S, Manenti FM, Mariuzzo F: Updates Management in Mobile Applications. iTunes vs Google Play, 2016.
50.
Eysenbach G, Köhler C: How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ 2002;324:573-577.
51.
Khazaal Y, Chatton A, Zullino D, Khan R: HON label and DISCERN as content quality indicators of health-related websites. Psychiatr Q 2012;83:15-27.
52.
Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, Billieux J, Zullino D: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns 2009;77:33-37.
53.
Zermatten A, Khazaal Y, Coquard O, Chatton A, Bondolfi G: Quality of Web-based information on depression. Depress Anxiety 2010;27:852-858.
54.
Boyer C, Gaudinat A, Baujard V, Geissbühler A: Health on the net foundation: assessing the quality of health web pages all over the world. Stud Health Technol Inform 2007;129(pt 2):1017-1021.
55.
Silberg WM, Lundberg GD, Musacchio RA: Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor - let the reader and viewer beware. JAMA 1997;277:1244-1245.
56.
Abbott VP: Web page quality: can we measure it and what do we find? A report of exploratory findings. J Public Health Med 2000;22:191-197.
57.
Commission of the European Communities, Brussels: eEurope 2002: quality criteria for health related websites. J Med Internet Res 2002;4:E15.
58.
Morel V, Chatton A, Cochand S, Zullino D, Khazaal Y: Quality of web-based information on bipolar disorder. J Affect Disord 2008;110:265-269.
59.
American Psychiatric Association: Practice Guideline for the Treatment of Patients with Substance Use Disorders, ed 2. American Psychiatric Association Practice Guidelines for the Treatment of Psychiatric Disorders: Compendium 2005. Arlington, American Psychiatric Association, 2006, pp 291-563.
60.
Boyer C, Selby M, Scherrer JR, Appel RD: The health on the net code of conduct for medical and health websites. Comput Biol Med 1998;28:603-610.
61.
Charnock D, Shepperd S, Needham G, Gann R: Discern: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health 1999;53:105-111.
62.
Griffiths KM, Christensen H: The quality and accessibility of Australian depression sites on the World Wide Web. Med J Aust 2002;176(suppl):S97-S104.
63.
Ademiluyi G, Rees CE, Sheard CE: Evaluating the reliability and validity of three tools to assess the quality of health information on the internet. Patient Educ Couns 2003;50:151-155.
64.
Kisely S, Ong G, Takyar A: A survey of the quality of web based information on the treatment of schizophrenia and attention deficit hyperactivity disorder. Aust N Z J Psychiatry 2003;37:85-91.
65.
Khazaal Y, Fernandez S, Cochand S, Reboh I, Zullino D: Quality of web-based information on social phobia: a cross-sectional study. Depress Anxiety 2008;25:461-465.
66.
Khazaal Y, Chatton A, Cochand S, Jermann F, Osiek C, Bondolfi G, Zullino D: Quality of web-based information on pathological gambling. J Gambl Stud 2008;24:357-366.
67.
Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA 2002;287:2691-2700.
68.
Chan DS, Willicombe A, Reid TD, Beaton C, Arnold D, Ward J, Davies IL, Lewis WG: Relative quality of internet-derived gastrointestinal cancer information. J Cancer Educ 2012;27:676-679.
69.
Babor TE, Higgins-Biddle J, Dauser D, Higgins P, Burleson JA: Alcohol screening and brief intervention in primary care settings: implementation models and predictors. J Stud Alcohol 2005;66:361-368.
70.
Weaver ER, Horyniak DR, Jenkinson R, Dietze P, Lim MS: ‘Let's get wasted!' And other apps: characteristics, acceptability, and use of alcohol-related smartphone applications. JMIR Mhealth Uhealth 2013;1:e9.
71.
Fleming TM, de Beurs D, Khazaal Y, Gaggioli A, Riva G, Botella C, Baños RM, Aschieri F, Bavin LM, Kleiboer A, Merry S, Lau HM, Riper H: Maximizing the impact of e-therapy and serious gaming: time for a paradigm shift. Front Psychiatry 2016;7:65.
72.
Huguet A, Rao S, McGrath PJ, Wozney L, Wheaton M, Conrod J, Rozario S: A systematic review of cognitive behavioral therapy and behavioral activation apps for depression. PLoS One 2016;11:e0154248.
73.
Griffiths KM, Christensen H: Website quality indicators for consumers. J Med Internet Res 2005;7:e55.
74.
Nilsson-Ihrfelt E, Fjällskog ML, Blomqvist C, Ahlgren J, Edlund P, Hansen J, Malmberg L, Villman K, Andersson G: Breast cancer on the internet: the quality of Swedish breast cancer websites. Breast 2004;13:376-382.
75.
Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, Zullino D: Quality of web-based information on alcohol dependence. Drug Educ Prev Polic 2010;17:248-260.
76.
Van Singer M, Chatton A, Khazaal Y: Quality of smartphone apps related to panic disorder. Front Psychiatry 2015;6:96.
77.
Griffiths KM, Christensen H: Quality of web based information on treatment of depression: cross sectional survey. BMJ 2000;321:1511-1515.
© 2016 S. Karger AG, Basel
2016
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.