The Utilization and Impact of Live Interactive and Store-and-Forward Teledermatology in a Veterans Affairs Medical Center During the COVID-19 Pandemic
Introduction
The utilization of telehealth has rapidly grown in recent years given its potential ability to improve access to specialized expertise for underserved communities, including patients from rural communities.1,2 The Veterans Health Administration (VHA) has developed one of the largest teledermatology programs in the United States and has had a standardized national teledermatology program since 2012.3 Teledermatology has been shown to be safe and effective for the diagnosis and management of dermatologic conditions, including malignant melanoma.4,5
Additionally, clinical outcomes of skin cancer management using teledermatology have been shown to be comparable with outcomes from conventional referrals within the VHA system.6 The VHA offers various forms of telehealth, including store-and-forward telehealth (SFT), clinical video telehealth (CVT), and Veterans Affairs Video Connect (VVC). SFT is an asynchronous telehealth modality; CVT and VVC are live interactive telehealth modalities. CVT entails patients utilizing video equipment at a clinic site, while VVC entails patients utilizing personal video equipment at home to conduct medical visits.
In teledermatology, the SFT teledermatology process involves primary care clinics entering a series of consultation orders, providing remote dermatologist telereaders with relevant clinical history and images obtained on-site by a trained imager. CVT involves patients visiting a clinical site, such as those located in rural areas, and being connected to providers in main medical centers, often located in urban areas. VVC, the newest platform, was started in 2018 and allows veterans to utilize a videoconferencing application to have real-time access to a dermatologist from any location, including their own homes. SFT was and continues to be the most widely adopted and utilized form of teledermatology to date within the health system.7
Public health recommendations to maintain social distancing during the coronavirus 2019 (COVID-19) pandemic led to rapid shutdowns of in-person nonemergency medical care and necessitated rapid expansion of telehealth programs. Teledermatology emerged as a promising method of continuing dermatologic care during the pandemic. However, VHA’s predominant SFT teledermatology platform was not poised to meet this need immediately given the workflow’s reliance on in-person imaging of lesions of concern.7 To better address this need, the VVC platform was rapidly implemented by the dermatology service at the San Francisco Veterans Affairs Health Care System (SFVAHCS) in March 2020 after San Francisco Bay Area jurisdictions instituted stay-at-home orders.
There have been some studies on the utilization patterns, reach, and ultimate impact of teledermatology programs during the COVID-19 pandemic, but none to date within the VHA.8 Although telehealth has been generally viewed as a promising means of addressing care needs for medically underserved communities, the use of teledermatology platforms in rural communities throughout the COVID-19 pandemic remains poorly understood.1
There have also been no studies on the rapidly implemented VVC platform for dermatologic care within the VHA. In this study, we report on the reach and impact of the SFT and VVC teledermatology platforms during the COVID-19 pandemic within a single Veterans Affairs (VA) medical facility.
Methods
This study was deemed to be quality improvement by our institution and did not require review by the Institutional Review Board. Teledermatology visits analyzed included SFT and VVC encounters. CVT encounters have not been utilized by the dermatology service at SFVAHCS. Encounters analyzed were within the SFVAHCS, which comprises the San Francisco VA Medical Center, located at Fort Miley, and its community-based outpatient clinics (CBOCs) located in the California cities of Santa Rosa, Ukiah, Clearlake, and Eureka.
All completed SFT encounters from March 2020 through December 2020 for patients referred from the SFVAHCS CBOCs were analyzed. All face-to-face (FTF) encounters and VVC encounters serving SFVAHCS patients and interfacility consult patients during this time period were also analyzed.
To assess the reach of our teledermatology platforms, data on completed encounters were obtained by query of the VA Corporate Data Warehouse (CDW) and abstraction from the Computerized Patient Record System (CPRS). Demographic characteristics were obtained from the CDW. Each patient’s location status was determined by classifying each patient’s zip code as highly rural, rural, insular island, or urban according to the Rural–Urban Commuting Area system.9
To assess the impact of these encounters, the primary diagnosis of each visit was obtained by manual chart review of clinical notes, and biopsy results were obtained through pathology reports in the CPRS. Diagnostic accuracy of SFT and VVC was assessed by examining concordance between teledermatologists’ clinical diagnoses with the reference standard of histopathological diagnoses.
A teledermatologist diagnosis was deemed concordant with the respective histopathological diagnosis if the teledermatologists’ differential diagnosis was either an exact match or a partial match. An exact match was defined as a clinical diagnosis identical to the histopathological diagnosis; a partial match was defined as a clinical differential diagnosis that contained the histopathological diagnosis.
Statistical analyses included Kruskal–Wallis tests and Dunn tests for continuous variables and chi-squared tests for categorical variables. Non-normal distributions for continuous variables were confirmed using Shapiro–Wilk tests. Post hoc analyses were performed for chi-squared tests with p < 0.05, with p-values adjusted using the Bonferroni correction. All statistical analyses were performed using statistical software (R; R Foundation for Statistical Computing).
Results
Patient Population
From March to December 2020, 1,540 patients were seen through FTF visits, 266 through VVC visits, and 438 through SFT visits. Male patients accounted for a majority of encounters across all encounter types (Table 1). There were significantly more female patients utilizing VVC compared with both SFT (p < 0.01) and FTF encounters (p < 0.01).
| CHARACTERISTIC | SFT (n = 438) | VVC (n = 266) | FTF (n = 1,540) | p |
|---|---|---|---|---|
| Age, years, median (IQR) | 71 (61–75) | 63 (41–73) | 73 (63–77) | <0.01 |
| Location, n (%) | ||||
| Highly rural/rural | 223 (51) | 36 (14) | 193 (13) | <0.01 |
| Urban | 215 (49) | 230 (86) | 1,347 (87) | |
| Gender, n (%) | ||||
| Female | 33 (8) | 43 (16) | 95 (6) | <0.01 |
| Male | 405 (92) | 223 (84) | 1,445 (94) | |
Patients seen through VVC were also younger, with patients’ median age at 63 (IQR 41–73) years, compared with those seen through SFT at 71 (61–75) years and FTF visits at 73 (63–77) years (Table 1). SFT was utilized significantly more by patients who lived in highly rural and rural areas. Fifty-one percent of patients seen through SFT had addresses in highly rural or rural areas, compared with 14% provided care through VVC and 13% through FTF encounters.
Teledermatology Encounter Characteristics
There were 2,250 FTF encounters, 347 VVC encounters, and 470 SFT encounters that occurred between March and December 2020 (Fig. 1). FTF encounters occurred on-site at SFVAHCS and SFT encounters were initiated by providers located at off-site CBOCs, while VVC encounters were conducted for Fort Miley, CBOC, and interfacility transfer patients. FTF and SFT encounters declined steeply throughout March given the reliance on on-site activities to facilitate these visits, reflective of the consequences of shutdowns and diverting nonurgent medical services.

Fig. 1. Trends in utilization of FTF dermatology versus SFT teledermatology versus VVC throughout 2020. FTF, face-to-face; SFT, store-and-forward telehealth; VVC, Veterans Affairs Video Connect.
Use of VVC, a platform not previously used by our facility for dermatologic care, scaled up rapidly to meet the gaps in care left by FTF and SFT encounter closures. Wait times for VVC visits and SFT encounters, defined as the number of business days between the day the consult was placed and the day of the appointment or consult completion, were significantly different. The median wait times for VVC, SFT, and FTF encounters were significantly different at 5 days, 3 days, and 16 days, respectively (p < 0.01).
The primary diagnoses addressed in each SFT and VVC encounter were categorized into the categories of benign, infectious, inflammatory, malignant, neoplasm of uncertain behavior, and premalignant (Table 2). The distribution of primary diagnoses addressed was significantly different between VVC and SFT. A majority of VVC encounters involved a primary diagnosis of an inflammatory lesion or condition (66%), while the most frequently addressed primary diagnoses in SFT were benign lesions (35%) and neoplasms of uncertain behavior (25%) (Table 2).
| DIAGNOSTIC CATEGORIES | SFT (n = 470) | VVC (n = 347) | p |
|---|---|---|---|
| Benign | 165 (35) | 49 (14) | <0.01 |
| Infectious | 35 (8) | 18 (5) | |
| Inflammatory | 95 (20) | 229 (66) | |
| Malignant | 11 (2) | 7 (2) | |
| Neoplasm of uncertain behavior | 118 (25) | 30 (9) | |
| Premalignant | 46 (10) | 14 (4) |
Teledermatology Encounter Outcomes
Rates of recommendations for medications or lesion biopsies were used to assess the impact of SFT and VVC encounters on disease management. Significantly more VVC visits (78%) resulted in a medication recommendation by the teledermatologist compared with a lower rate seen in SFT visits (37%) (Table 3). In contrast, significantly more SFT encounters resulted in biopsy recommendations (23% vs. 2% of VVC visits). Sixty-one percent and 57% of biopsies recommended through SFT and VVC during the study period were performed, respectively.
| OUTCOME | SFT (n = 470) | VVC (n = 347) | p |
|---|---|---|---|
| Medication recommended | 173 (37) | 271 (78) | <0.01 |
| Prescribed by referring MD | 144 (83) | N/A | |
| Biopsy recommended | 108 (23) | 7 (2) | <0.01 |
| Biopsy performed | 66 (61) | 4 (57) |
Diagnostic accuracy of SFT and VVC visits was also analyzed by examining the concordance between teledermatologists’ differential diagnoses and histopathological diagnoses. Of the 71 biopsies that were performed as recommended by SFT telereaders, 76% of clinical teledermatology diagnoses were concordant with histopathological diagnoses. Of the four biopsies performed as recommended by dermatologists over VVC, 50% were concordant with histopathological diagnoses.
Forty-five percent (32 of 71) and 25% (1 of 4) of lesions biopsied per recommendation by SFT and VVC, respectively, were malignancies (Table 4). The single malignancy biopsied per recommendation by VVC was a nonmelanoma skin cancer (NMSC). Among the 32 malignancies biopsied per recommendation by SFT, 27 were NMSCs and 5 were melanomas.
| HISTOPATHOLOGIC DIAGNOSIS | SFT (n = 71) | VVC (n = 4) | p |
|---|---|---|---|
| Malignant | 32 (45) | 1 (25) | <0.01 |
| Premalignant | 3 (4) | 0 | |
| Benign | 28 (40) | 1 (25) | |
| Inflammatory/infectious | 8 (11) | 2 (50) |
Discussion
The VHA has already been a leader in the field of telehealth, and the COVID-19 pandemic necessitated further utilization of its teledermatology programs. We found that both SFT and VVC teledermatology helped meet patient care needs throughout the year. The median wait times for VVC and SFT (5 days and 3 days, respectively) were shorter than, and in impressive contrast to, the median wait time for FTF encounters during the same time period (16 days). These encounters had high impact on patient care and management; 60% of SFT and 80% of VVC encounters resulted in either medication or biopsy recommendations. Furthermore, 45% and 25% of biopsies recommended through SFT and VVC were malignancies requiring further intervention.
Although VVC was not previously implemented by our facility’s dermatology department, the platform rapidly ramped up when FTF and SFT services were paused. These SFT, VVC, and FTF utilization trends mirror the effects of governmental and SFVAHCS policies that affected in-person appointments. FTF and SFT use increased throughout June through November, mirroring policies during those months in which patients were able to access in-person care.
This then declined again after November, mirroring COVID-19 case surges during these months, limiting and possibly discouraging patients from seeking in-person care. However, VVC appointments reached a steady state of utilization and did not fluctuate along with these trends, raising questions about the factors limiting the reach of this platform.
The differences in demographic characteristics of patients served by these different forms of telehealth provide insight into the specific reach of each program. VVC users were significantly younger than both SFT and FTF patients and had a significantly lower representation of patients from rural areas. Almost half of the veteran population is over 65 years old and older veterans are more likely to reside in rural areas.10 Usage of the internet and My HealtheVet, the VA’s online personal health record portal, among VHA enrollees is also most prevalent among younger patients.11
Studies have indicated that for patients with complex medical dermatology conditions, outcomes improve with close clinical follow-up and that teledermatology providers prefer a synchronous teledermatology modality for these cases.8,12 Rural veteran satisfaction with teledermatology care has also been shown to be equivalent to FTF care.13 Given the relatively longer wait times for FTF dermatologic care and the barriers that elderly veterans residing in rural areas face, it is imperative that efforts are made to improve their access to VVC to reduce travel costs and deliver efficient care.
Further study of access to a home internet connection and proper videoconferencing equipment of this patient population is warranted, as other studies have shown that veterans in rural areas are less likely to meet the technology requirements of VVC.10,14 This finding further supports the importance of continuation of VHA initiatives to provide high-need veterans with technological equipment, such as tablets with broadband access, to support access to quality care.14 In the context of comorbidities being more common in the elderly and also associated with worse COVID-19 health outcomes, expanding access to care that does not require on-site visits and potential exposure to the virus is especially pertinent.
There was a significant association between gender and teledermatology care platform use; significantly more females utilized VVC, with 16% of patients identifying as female. Our VVC patients had a median age of 63, so a contributing factor may be that the middle-age group (45–64 years old) represents the largest group of women veterans.15 Nevertheless, current projections by the VHA indicate that women compose 10% of the veteran population and that this representation continues to grow rapidly each year.15,16
Women have historically underutilized VHA services for a variety of reasons beyond barriers involving technology requirements.17,18 Unique challenges faced by women veterans include negative experiences within VHA grounds, with one-fourth of a sample of women veterans reporting experiencing harassment in VHA health care grounds.18 Previous studies have also indicated that women veterans view videoconferencing as an acceptable platform for medical care and that they may prefer seeking dermatologic care from dermatologists instead of their primary care providers.19 Thus, further investigation on how the VVC platform could possibly be better at meeting the needs of women veterans is warranted.
Our study also showed that the SFT platform was more commonly utilized for consultation on neoplasms, while the VVC platform was more commonly utilized for inflammatory lesions, which is consistent with a decision tree algorithm that was utilized by the SFVAHCS dermatology service for patient triage and diversion away from FTF appointments during times of shutdown. This is also consistent with studies that have shown similar diagnostic category distribution.8,12
Given the higher resolution of digital images submitted for SFT compared with the more variable resolution during VVC, we have found the SFT platform to be more appropriate for detailed review of neoplasm morphologies. In contrast, VVC has been more effective for inflammatory rashes given the ability of teledermatologists to gather more details of the patient’s history through interactive interview and provide direct counseling on management. Our clinical outcome measures of rates of medication and biopsy recommendations are as expected and consistent with the diagnostic categories associated with each teledermatology platform.
Rates of biopsy recommendations were higher in the SFT group given that a majority of encounters were associated with requests for neoplasm evaluation. Rates of medication recommendations were higher in the VVC group given that a majority of encounters were associated with inflammatory conditions requiring medication interventions. Furthermore, VVC establishes a physician–patient relationship, allowing the teledermatologist to directly prescribe recommended medications. In contrast, our dermatologists serve as strict teleconsultants when using the SFT platform by providing recommendations to the referring providers, who then enter orders themselves and provide necessary patient counseling.
There are inherently more workflow-related challenges for the SFT system with the intermediary referring provider. Although the rate of prescription of teledermatologist-recommended treatments by our referring providers is approximately consistent with rates published by other groups, we are actively working to continuously improve this rate.20 For example, the SFVAHCS has piloted a system encouraging more active management by consultants while easing workflow-related challenges for referring providers by having teledermatologists prepare recommended orders within the electronic health record system, which are then reviewed and signed by the referring provider.
Other quality improvement interventions being piloted within the VHA system include teledermatologists directly prescribing low-risk medications.21 Further work and investigation of the impact of these interventions are warranted and could improve our teledermatology program’s impact on clinical outcomes.
Our data on biopsy recommendations are relatively limited, but still provide useful insight. We show our rate of follow-through on biopsy recommendations (61% and 57% of biopsies recommended through SFT and VVC were performed, respectively) to be lower than other published work performed within the VHA (79%).22 However, it is important to note that this prior study examined the time period of 2009 to 2011.
Our lower rates of teledermatology recommendation adherence were likely affected by unprecedented system-level and individual-level challenges that contributed to patients ultimately being unable to come in for their recommended biopsies, including limited FTF visits or fear of risking exposure to the SARS-CoV-2 virus in health care settings during the pandemic. The rates of diagnostic accuracy seen within our small sample size (76% and 50% for SFT and VVC, respectively) are slightly lower than diagnostic accuracy rates reported in other studies, which have ranged from 51% to 92% agreement.23
These are also lower than rates observed in prior studies conducted on SFT and live interactive teledermatology programs within the VHA system.4,24,25 This may be due to a lack of implemented standardization for clinical image capture or the technological requirements within our own health system, limiting the assessments performed by our teledermatologists; however, further investigation is needed to elucidate contributing factors.
Limitations of our study include its focus on a single institution serving a limited region and lack of comparison with a control group from previous years.
Conclusions
Our study indicates that teledermatology programs contributed to meeting veteran care needs during the pandemic, made an impact on clinical outcomes, and had significantly shorter wait times relative to FTF care. The demographic characteristics of patients who utilized these care modalities shed light on factors to consider in efforts to improve access as teledermatology programs continue to expand, especially during this period of accelerated implementation and growth due to the COVID-19 pandemic’s effects on health care delivery.
Telehealth is a continuously evolving model of care delivery. Given its theoretical ability to increase specialty care access and the recent expansions of telemedicine reimbursement, it is clear that teledermatology use will continue to grow. Understanding the utilization and impact of these programs will continue to be crucial to ensuring the quality and cost-effectiveness of teledermatology used to meet veteran care needs.
Acknowledgments
The authors acknowledge the resident physicians of the UCSF Department of Dermatology for their contributions to the quality improvement data, with special thanks to Drs. Daniel Klufas, Sakeen Kashem, and Divya Seth for their assistance with chart reviews for VVC encounters. The authors also acknowledge Dr. Karla Lindquist for her input on the statistical methods and Olevie Lachica for her expert assistance with data analytics.
Disclosure Statement
No competing financial interests exist. The views expressed in this work are those of the authors and do not reflect the position or policy of Veterans Affairs or the U.S. Government.
Funding Information
This work was supported in part by the U.S. Department of Veterans Affairs, Office of Rural Health (to D.H.O.) and in part by Award #1I01 HX002961 from the U.S. Department of Veterans Affairs, Health Services Research and Development Service (to D.H.O.).
References
- 1. . The growth of teledermatology: Expanding to reach the underserved. J Am Acad Dermatol 2020;82:1025–1033. Crossref, Medline, Google Scholar
- 2. . Use of teledermatology to improve dermatological access in rural areas. Telemed J E Health 2019;25:1022–1032. Link, Google Scholar
- 3. . Teledermatology Within the Veterans Health Administration, 2002–2014. Telemed J E Health 2015;21:769–773. Link, Google Scholar
- 4. Teledermatology for diagnosis and management of skin conditions: A systematic review. J Am Acad Dermatol 2011;64:759–772.e21. Crossref, Medline, Google Scholar
- 5. Diagnosis and management of malignant melanoma in store-and-forward teledermatology. Telemed J E Health 2017;23:877–880. Link, Google Scholar
- 6. . The impact of store-and-forward teledermatology on skin cancer diagnosis and treatment. J Am Acad Dermatol 2008;59:260–267. Crossref, Medline, Google Scholar
- 7. . Teledermatology in the United States: An update in a dynamic era. Telemed J E Health 2018;24:691–697. Link, Google Scholar
- 8. Utilization of asynchronous and synchronous teledermatology in a large health care system during the COVID-19 pandemic. Telemed J E Health 2020;27:771–777. Link, Google Scholar
- 9.
Rural-Urban Commuting Area Codes . 2020. Available at https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes/ (last accessedMay 20, 2021 ). Google Scholar - 10. . VA Video connect for clinical care in older adults in a rural state during the COVID-19 pandemic: Cross-sectional study. J Med Internet Res 2020;22:e21561. Crossref, Medline, Google Scholar
- 11. . 2020 Survey of Veteran Enrollees’ Health and Use of Health Care. 2021. Available at https://www.va.gov/HEALTHPOLICYPLANNING/analysis.asp (last accessed
May 20, 2021 ). Google Scholar - 12. . Impact of live interactive teledermatology on diagnosis, disease management, and clinical outcomes. Arch Dermatol 2012;148:61. Crossref, Medline, Google Scholar
- 13. . Teledermatology patient satisfaction in the Pacific Northwest. Telemed J E Health 2012;18:377–381. Link, Google Scholar
- 14. Making connections: Nationwide implementation of video telehealth tablets to address access barriers in veterans. JAMIA Open 2019;2:323–329. Crossref, Medline, Google Scholar
- 15.
Facts and Statistics about Women Veterans . 2020. Available at https://www.womenshealth.va.gov/womenshealth/latestinformation/facts.asp (last accessedMay 20, 2021 ). Google Scholar - 16.
Veteran Population Projection Model 2016: Congressional Briefing . 2019. Available at https://www.va.gov/vetdata/docs/Demographics/VetPop_Infographic_2019.pdf (last accessedMay 20, 2021 ). Google Scholar - 17. The focus they deserve: Improving women veterans’ health care access. Womens Health Issues 2021;31:399–407. Crossref, Medline, Google Scholar
- 18. Prevalence of stranger harassment of women veterans at veterans affairs medical centers and impacts on delayed and missed care. Womens Health Issues 2019;29:107–115. Crossref, Medline, Google Scholar
- 19. . Full-body skin examinations and the female veteran: Prevalence and perspective. Arch Dermatol 2006;142:312–316. Crossref, Medline, Google Scholar
- 20. . Adherence to teledermatology recommendations by primary health care professionals: Strategies for improving follow-up on teledermatology recommendations. JAMA Dermatol 2015;151:1130. Crossref, Medline, Google Scholar
- 21. Implementing teledermatology for rural veterans: An evaluation using the RE-AIM framework. Telemed J E Health 2021;27:218–226. Link, Google Scholar
- 22. A teledermatology care management protocol for tracking completion of teledermatology recommendations. J Telemed Telecare 2012;18:374–378. Crossref, Medline, Google Scholar
- 23. . Teledermatology for the diagnosis and management of skin cancer: A systematic review. JAMA Dermatol 2017;153:319. Crossref, Medline, Google Scholar
- 24. Accuracy of teledermatology for nonpigmented neoplasms. J Am Acad Dermatol 2009;60:579–588. Crossref, Medline, Google Scholar
- 25. . Teledermatology and in-person examinations: A comparison of patient and physician perceptions and diagnostic agreement. Arch Dermatol 1998;134:471–476. Crossref, Medline, Google Scholar

