Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published online November 30, 2016

Evaluation of a national telemedicine initiative in the Veterans Health Administration: Factors associated with successful implementation

Abstract

Background

The Consolidated Framework for Implementation Research was used to evaluate implementation facilitators and barriers of Specialty Care Access Network-Extension for Community Healthcare Outcomes (SCAN-ECHO) within the Veterans Health Administration. SCAN-ECHO is a video teleconferencing-based programme where specialist teams train and mentor remotely-located primary care providers in providing routine speciality care for common chronic illnesses. The goal of SCAN-ECHO was to improve access to speciality care for Veterans. The aim of this study was to provide guidance and support for the implementation and spread of SCAN-ECHO.

Methods

Semi-structured telephone interviews with 55 key informants (primary care providers, specialists and support staff) were conducted post-implementation with nine sites and analysed using Consolidated Framework for Implementation Research constructs. Data were analysed to distinguish sites based on level of implementation measured by the numbers of SCAN-ECHO sessions. Surveys with all SCAN-ECHO sites further explored implementation information.

Results

Analysis of the interviews revealed three of 14 Consolidated Framework for Implementation Research constructs that distinguished between low and high implementation sites: design quality and packaging; compatibility; and reflecting and evaluating. The survey data generally supported these findings, while also revealing a fourth distinguishing construct – leadership engagement. All sites expressed positive attitudes toward SCAN-ECHO, despite struggling with the complexity of programme implementation.

Conclusions

Recommendations based on the findings include: (a) expend more effort in developing and distributing educational materials; (b) restructure the delivery process to improve programme compatibility; (c) establish an audit and feedback mechanism for monitoring and improving the programme; (d) engage in more upfront planning to reduce complexity; and (e) obtain local leadership support for providing primary care providers with dedicated time for participation.

Get full access to this article

View all access and purchase options for this article.

References

1. McQueen L, Mittman BS, Demakis JG. Overview of the Veterans Health Administration (VHA) Quality Enhancement Research Initiative (QUERI). J Am Med Inform Assoc 2004; 11: 339–343.
2. Rosenblatt RA, Andrilla CH, Catlin M, et al. Geographic and specialty distribution of US physicians trained to treat opioid use disorder. Ann Fam Med 2015; 13: 23–26.
3. Baldwin LM, Andrilla CH, Porter MP, et al. Treatment of early-stage prostate cancer among rural and urban patients. Cancer 2013; 119: 3067–3075.
4. Rosenblatt RA, Andrilla CH, Curtin T, et al. shortages of medical personnel at community health centers: Implications for planned expansion. JAMA 2006; 295: 1042–1049.
5. Kirsh S, Ho P, Aron D. Providing specialty consultant expertise to primary care: An expanding spectrum of modalities. Mayo Clin Proc 2014; 89: 1416–1426.
6. Kirsh S, Su G, Sales A, et al. Access to outpatient specialty care: Solutions from an integrated health care system. Am J Med Qual 2014; 30(1): 88–90.
7. Arora S, Geppert CM, Kalishman S, et al. Academic health center management of chronic diseases through knowledge networks: Project ECHO. Acad Med 2007; 82: 154–160.
8. Colleran K, Harding E, Kipp BJ, et al. Building capacity to reduce disparities in diabetes: Training community health workers using an integrated distance learning model. Diabetes Educ 2012; 38: 386–396.
9. Dubin RE, Flannery J, Taenzer P, et al. ECHO Ontario chronic pain & opioid stewardship: Providing access and building capacity for primary care providers in underserviced, rural, and remote communities. Stud Health Technol Inform 2015; 209: 15–22.
10. Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci 2013; 8: 51–51.
11. Kirk MA, Kelley C, Yankey N, et al. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci 2016, pp. 11–72.
12. Cresswell JW. A concise introduction to mixed methods research, Los Angeles: Sage, 2015.
13. Hill CE, Knox S, Thompson BJ, et al. Consensual qualitative research: An update. J Couns Psychol 2005; 52: 196–205.
14. Hill CE, Thompson BJ, Williams EN. A guide to conducting consensual qualitative research. Couns Psychol 1997; 25: 517–572.
15. Rihoux B, Ragin CC Why compare? Why configurational comparative methods? In: Rihoux B, Ragin CC (eds). Configurational comparative methods, Los Angeles: Sage, 2009, pp. xvii–xx.
16. Averill JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res 2002; 12: 855–866.
17. Damschroder L, Aron D, Keith R, et al. (2009) Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci 4(1): 50.
18. Powell BJ, McMillen C, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev 2012; 69: 123–157.
19. Jarvis-Selinger S, Chan E, Payne R, et al. Clinical telehealth across the disciplines: Lessons learned. Telemed J E Health 2008; 14: 720–725.
20. Lee A and Billings M. Telehealth implementation in a skilled nursing facility: Case report for physical therapist practice in Washington. Phys Ther 2016; 96: 252–259.
21. Saigi-Rubíó F, Jiménez-Zarco A, Torrent-Sellens J. Determinants of the intention to use telemedicine: Evidence from primary care physicians. Int J Technol Assess Health Care 2016; 32: 29–36.
22. Vinson M, McCallum R, Thornlow DK, et al. Design, implementation, and evaluation of population-specific telehealth nursing services. Nurs Econ 2011; 29: 265–265.
23. May C, Harrison R, Finch T, et al. Understanding the normalization of telemedicine services through qualitative evaluation. J Am Med Inform Assoc 2003; 10: 596–604.
24. Ohl M, Dillon D, Moeckli J, et al. Mixed-methods evaluation of a telehealth collaborative care program for persons with HIV infection in a rural setting. J Gen Intern Med 2013; 28: 1165–1173.
25. Wade VA, Taylor AD, Kidd MR, et al. Transitioning a home telehealth project into a sustainable, large-scale service: A qualitative study. BMC Health Serv Res 2016; 16: 183–193.
26. Broens THF, Huis in’t Veld RMHA, Vollenbroek-Hutten MMR, et al. Determinants of successful telemedicine implementations: A literature study. J Telemed Telecare 2007; 13: 303–309.

Cite article

Cite article

Cite article

OR

Download to reference manager

If you have citation software installed, you can download article citation data to the citation manager of your choice

Share options

Share

Share this article

Share with email
EMAIL ARTICLE LINK
Share on social media

Share access to this article

Sharing links are not relevant where the article is open access and not available if you do not have a subscription.

For more information view the Sage Journals article sharing page.

Information, rights and permissions

Information

Published In

Article first published online: November 30, 2016
Issue published: April 2018

Keywords

  1. Implementation research
  2. speciality care
  3. chronic illness
  4. telehealth
  5. telemedicine
  6. healthcare training
  7. healthcare education

Rights and permissions

© The Author(s) 2016.
Request permissions for this article.
PubMed: 27909208

Authors

Affiliations

Lauren Stevenson
Louis Stokes Cleveland VA Medical Center, USA
Sherry Ball
Louis Stokes Cleveland VA Medical Center, USA
Leah M Haverhals
Eastern Colorado Health Care System, USA
David C Aron
Louis Stokes Cleveland VA Medical Center, USA
Julie Lowery
VA Ann Arbor Health Care System, USA

Notes

Lauren Stevenson, Louis Stokes Cleveland VA Medical Center, 10701 East Boulevard, Cleveland, OH 44106, USA. Email: [email protected]

Metrics and citations

Metrics

Journals metrics

This article was published in Journal of Telemedicine and Telecare.

VIEW ALL JOURNAL METRICS

Article usage*

Total views and downloads: 904

*Article usage tracking started in December 2016


Articles citing this one

Receive email alerts when this article is cited

Web of Science: 29 view articles Opens in new tab

Crossref: 0

  1. The ENGAGE study: a 3-arm randomized hybrid type 1 effectiveness and i...
    Go to citation Crossref Google Scholar
  2. What Should Healthcare Systems Consider When Modernizing Call Centers?...
    Go to citation Crossref Google Scholar
  3. Feasibility of Implementing a Mindfulness-Based Online Program for Lat...
    Go to citation Crossref Google Scholar
  4. Improving the self‐efficacy, knowledge, and attitude of nurses regardi...
    Go to citation Crossref Google Scholar
  5. Describing implementation outcomes for a virtual community of practice...
    Go to citation Crossref Google Scholar
  6. A scoping review of applications of the Consolidated Framework for Imp...
    Go to citation Crossref Google Scholar
  7. Participatory user requirements elicitation, validation, and prioritiz...
    Go to citation Crossref Google Scholar
  8. Addressing Hypertension Outcomes Using Telehealth and Population Healt...
    Go to citation Crossref Google Scholar
  9. Understanding Telemedicine's “New Normal”: Variations in Telemedicine ...
    Go to citation Crossref Google Scholar
  10. The Future of Sleep Medicine: A Patient-Centered Model of Care
    Go to citation Crossref Google Scholar
  11. Workforce Development to Improve Access to Pain Care for Veterans: A Q...
    Go to citation Crossref Google Scholar
  12. Evaluation of multi-level barriers and facilitators in a large diabeti...
    Go to citation Crossref Google Scholar
  13. Identifying and understanding the contextual factors that shaped mid-i...
    Go to citation Crossref Google Scholar
  14. Barriers and facilitators to implementing telehealth services during t...
    Go to citation Crossref Google Scholar
  15. Describing the delivery of clinical pharmacy services via telehealth: ...
    Go to citation Crossref Google Scholar
  16. A Shortage of Neurologists – We Must Act Now
    Go to citation Crossref Google Scholar
  17. Provider Perceptions of Telemedicine Video Visits to Home in a Veteran...
    Go to citation Crossref Google Scholar
  18. Misalignment between coronavirus financial aid and public health polic...
    Go to citation Crossref Google Scholar
  19. Implementing a complex psychosocial intervention for unstably housed V...
    Go to citation Crossref Google Scholar
  20. Barriers and facilitators in implementing a pilot, pragmatic, telemedi...
    Go to citation Crossref Google Scholar
  21. A systematic scoping review of change management practices used for te...
    Go to citation Crossref Google Scholar
  22. Virtual academic detailing (e-Detailing): A vital tool during the COVI...
    Go to citation Crossref Google Scholar
  23. A Qualitative Evaluation of the Pain Management VA-ECHO Program Using ...
    Go to citation Crossref Google Scholar
  24. Identifying the Roles of Healthcare Leaders in HIT Implementation: A S...
    Go to citation Crossref Google Scholar
  25. Implementing Exercise in Healthcare Settings: The Potential of Impleme...
    Go to citation Crossref Google Scholar
  26. Telehealth at the US Department of Veterans Affairs after Hurricane Sa...
    Go to citation Crossref Google ScholarPub Med
  27. Blind spots in telemedicine: a qualitative study of staff workarounds ...
    Go to citation Crossref Google Scholar
  28. Virtual Consultations Through the Veterans Administration SCAN‐ECHO Pr...
    Go to citation Crossref Google Scholar
  29. A pilot study using telehealth to implement antimicrobial stewardship ...
    Go to citation Crossref Google Scholar
  30. Telestroke Adoption Among Community Hospitals in North Carolina: A Cro...
    Go to citation Crossref Google Scholar
  31. Feasibility of Smartphones for Real-time Assessment of Adherence Behav...
    Go to citation Crossref Google Scholar
  32. Smartphones for Real-time Assessment of Adherence Behavior and Symptom...
    Go to citation Crossref Google Scholar
  33. Association of Provider Specialty and Multidisciplinary Care With Hepa...
    Go to citation Crossref Google Scholar
  34. The Development of a Telemedicine Planning Framework Based on Needs As...
    Go to citation Crossref Google Scholar

Figures and tables

Figures & Media

Tables

View Options

Get access

Access options

If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:


Alternatively, view purchase options below:

Purchase 24 hour online access to view and download content.

Access journal content via a DeepDyve subscription or find out more about this option.

View options

PDF/ePub

View PDF/ePub

Full Text

View Full Text