SlideShare una empresa de Scribd logo
1 de 7
Descargar para leer sin conexión
BMC Health Services Research                                                                                                             BioMed Central



Research article                                                                                                                       Open Access
An economic analysis of email-based telemedicine: A cost
minimisation study of two service models
Liam Caffery1, Anthony C Smith*1 and Paul A Scuffham2

Address: 1Centre for Online Health, University of Queensland, Australia, Level 3 Foundation Building. Royal Children's Hospital, Herston Road,
Herston, Queensland 4029, Australia and 2School of Medicine, Griffith University, Logan Campus L03 2.43. Griffith University, Queensland,
Australia
Email: Liam Caffery - l.caffery@coh.uq.edu.au; Anthony C Smith* - a.smith@pobox.com; Paul A Scuffham - p.scuffham@griffith.edu.au
* Corresponding author




Published: 22 May 2008                                                         Received: 18 December 2007
                                                                               Accepted: 22 May 2008
BMC Health Services Research 2008, 8:107   doi:10.1186/1472-6963-8-107
This article is available from: http://www.biomedcentral.com/1472-6963/8/107
© 2008 Caffery et al; licensee BioMed Central Ltd.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0),
which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.




        Abstract
        Background: Email-based telemedicine has been reported to be an efficient method of delivering online health
        services to patients at a distance and is often described as a low-cost form of telemedicine. The service may be
        low-cost if the healthcare organisation utilise their existing email infrastructure to provide their telemedicine
        service. Many healthcare organisations use commercial-off-the-shelf (COTS) email applications. COTS email
        applications are designed for peer-to-peer communication; hence, in situations where multiple clinicians need to
        be involved, COTS applications may be deficient in delivering telemedicine. Larger services often rely on different
        staff disciplines to run their service and telemedicine tools for supervisors, clinicians and administrative staff are
        not available in COTS applications. Hence, some organisations may choose to develop a purpose-written email
        application to support telemedicine. We have conducted a cost-minimisation analysis of two different service
        models for establishing and operating an email service. The first service model used a COTS email application and
        the second used a purpose-written telemedicine application.
        Methods: The actual costs used in the analysis were from two organisations that originally ran their counselling
        service with a COTS email application and later implemented a purpose-written application. The purpose-written
        application automated a number of the tasks associated with running an email-based service. We calculated a
        threshold at which the higher initial costs for software development were offset by efficiency gains from
        automation. We also performed a sensitivity analysis to determine the effect of individual costs on the threshold.
        Results: The cost of providing an email service at 1000 consultations per annum was $19,930 using a COTS email
        application and $31,925 using a purpose-written application. At 10,000 consultations per annum the cost of
        providing the service using COTS email software was $293,341 compared to $272,749 for the purpose-written
        application. The threshold was calculated at a workload of 5216 consultations per annum. When more than 5216
        email consultations per annum are undertaken, the purpose-written application was cheaper than the COTS
        service model. The sensitivity analysis showed the threshold was most sensitive to changes in administrative staff
        salaries.
        Conclusion: In the context of telemedicine, we have compared two different service models for email-based
        communication – purpose-written and COTS applications. Under the circumstances described in the paper, when
        workload exceeded 5216 email consultations per annum, there were savings made when a purpose-written email
        application was used. This analysis provides a useful economic model for organisations contemplating the use of
        an email-based telemedicine system.



                                                                                                                                         Page 1 of 7
                                                                                                                 (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                    http://www.biomedcentral.com/1472-6963/8/107




Background                                                      person who is aged, with a disability or with a chronic or
Email-based telemedicine is often described as a low-cost       mental illness. Caring places enormous demands on these
form of telemedicine [1-3]. This may be true if the tele-       carers and the negative consequences associated with car-
medicine service uses existing email infrastructure; how-       ing are well documented [7]. It has also been well docu-
ever, a number of authors have identified that                  mented that carers who seek intervention have less
commercial-off-the-shelf (COTS) email applications are          depression, less stress and significant improvement in
deficient at running telemedicine services and an email-        measures of vitality, social functioning and mental health
based telemedicine service is more efficient using a pur-       [7-10]. For these reasons, counselling is an important sup-
pose-written telemedicine application [4,5]. We devel-          port service offered by the charity.
oped a purpose-written application for email-based
telemedicine services. Our purpose-written application is       Following the implementation of our purpose-written
a webmail product designed to support the workflow of           telemedicine software for these two email counselling
supervisors, clinicians and administrative staff of the tele-   organisations in Australia [11], the present study com-
medicine provider. It was developed after requirements          pares the economics of both of these services. We have
analysis was performed for the subject organisations. Tele-     analysed the costs of establishing and operating a tele-
medicine functionalities of our webmail application are         medicine service using COTS email software and com-
described below:                                                pared these with the costs of establishing and operating
                                                                the same telemedicine service with our purpose-written
▪All incoming emails are automatically scanned and              email-based telemedicine application.
flagged if they contained pre-defined keywords.
                                                                The aim of this study was to identify costs associated with
▪Email cases can be triaged and assigned to a particular cli-   providing an email-based telemedicine services using two
nician.                                                         alternative service models and determine the conditions
                                                                required for each service to become economically viable.
▪Auditing tools ensure cases are answered in a timely fash-
ion.                                                            Methods
                                                                We compared the actual costs of operating an email-based
▪Full patient history can be viewed online.                     telemedicine service for the two service models. Both
                                                                organisations involved in our study were operating an
▪Complex cases can be flagged by the clinician, ensuring a      email-based service using COTS software prior to imple-
supervisor endorses the response, before it is sent to the      menting our purpose-written application. The fixed and
client.                                                         variable costs for both service delivery alternatives were
                                                                calculated from data collected from both organisations.
Our application also automates a number of tasks associ-        By evaluating two organisations we were able to more
ated with running a telemedicine service – for example,         accurately determine variable costs at a range of different
the automatic allocation of cases to a clinician with an        workloads.
existing relationship with a client and the automatic pro-
vision of workload statistics.                                  Data Collection
                                                                Workload activity data was collected from both counsel-
We implemented our purpose-written application for two          ling organisations (Table 1). Our subject organisation
counselling organisations. The first organisation is a          recorded information about all email interactions in a
national telephone and email counselling service aimed          database, including the amount of time counsellors spent
specifically for children aged five to eighteen years. The      on each teleconsultation and the service delivery model.
service is free and staffed by over 100 professional coun-      Data extracted from this database was used for counsellor
sellors – 90% of whom have tertiary qualifications in psy-      cost calculations.
chology, social work and related disciplines [6]. Most
client emails are regarding family and peer relationships.      Administrative and supervisory staff recorded the time
Email contact relating to mental health, suicide, eating        they spent on the email service pre- and post- installation
behaviours and self-image are to two to three times higher      of the purpose-written application. Results from this
than for telephone counselling [6] – indicating clients         study form the basis of staff cost calculations for these dis-
enjoy the anonymity of email.                                   ciplines [11].

The second subject organisation is a registered charity that    Capital costs and service fees were actual costs we charged
provides support services to family carers. Carers are          the counselling organisation for developing and hosting
mostly family members who provide voluntary care for a          the purpose-written email application.


                                                                                                                      Page 2 of 7
                                                                                              (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                            http://www.biomedcentral.com/1472-6963/8/107



Table 1: Telemedicine activity for the two counselling organisations.

                                                                          Organisation A                      Organisation B

 Study Period                                                           May 2004 – Aug 2006                 Jun 2005 – Jun 2006
 Total duration (months)                                                        28                                   13
 Total number of email consultations                                          21,207                                369
 Average consultations per month                                                784                                  30
 Consultations per month – range                                             611–1097                              6–53



Assumptions                                                             annum per full-time equivalent, including on-costs. Their
The present cost analysis was based on the assumption                   duties include retrieving patient history when an email
that patient outcomes were the same for both service alter-             was from existing client, auditing client emails to ensure
natives. Costs were calculated from the perspective of the              all incoming emails had been answered and the manual
healthcare organisation in Australian dollars (A$1                      provision of workload data for management reports.
=~US$0.86 or ~0.63 Euro) and included 10% Goods and
Services Tax. Staff pay rates in both counselling organisa-             Fixed Costs
tions were calculated according to the state health depart-             Fixed costs included capital costs to develop and imple-
ment's professional and administrative officer's scale. We              ment the purpose-written email service. The initial capital
added an additional 20% to the salary expenses, to                      outlay was converted into an annual equivalent cost
account for the employee's non-salary costs or "on-costs"               through a process of annuitizing these costs over the life
– for example, superannuation and work cover premiums.                  expectancy of the application [12]. A life expectancy of
                                                                        seven years and a depreciation rate of 14% was used in the
It was unnecessary to employ all disciplines of staff for all           calculations. It was assumed there was no resale value at
workload volumes – for example, if only one counsellor                  the end of the lifecycle. In addition, an annual fixed cost
was employed it would be unwarranted to also employ a                   (service fee) was also incurred by each counselling organ-
supervisor; similarly a small volume service may not                    isation when using the purpose-written application. This
require administrative support. Staff involved in the deliv-            fee covered the hosting and associated technical support
ery of email counselling service suggested the appropriate              required by the purpose-written application.
workload volume to introduce administrative support
and supervisory support was 3000 and 6000 email con-                    Threshold analysis
sultations per annum respectively and only one person                   The threshold was calculated at which the cost of using the
from each discipline was necessary until the workload                   COTS email application was the same as using the pur-
exceed 10,000 email consultations per annum.                            pose written application.

The annual service fee for the purpose-written email appli-             Sensitivity analysis
cation included minor enhancements and maintenance                      A one-way sensitivity analysis was undertaken by varying
programming. For these reasons, it was assumed the soft-                the key input values by 50% and assessing the change on
ware would remain operational for seven years.                          the threshold where both service delivery options are
                                                                        equal. Key inputs included the cost of developing the pur-
Staff Costs                                                             pose-written software, the cost of hosting the software
A counsellor's salary was based on the Professional Officer             (service fee), and staff salaries.
Level 2.6 rate of $67,670 per annum per full time equiva-
lent, including on-costs. Their duties included reading                 Results
and responding to client emails.                                        Fixed Costs
                                                                        The capital cost charged to both counselling organisations
A supervisor's duties include triage of all incoming emails             to implement our purpose-written application was
to assign a priority, allocation of cases to staff and proof-           $30,000, which equated to $6995 after annuitizing. In
ing outgoing responses from counsellors. A supervisor sal-              addition, both counselling organisations incurred an
ary was based on the Professional Officer Level 3.4 rate of             annual fee of $5000 to host the telemedicine application.
$77,842 per annum per full time equivalent, including                   There were no fixed costs associated with running the serv-
20% on-costs.                                                           ice using the COTS software as the original service used
                                                                        the counselling organisation's existing email infrastruc-
Administrative staff costs were based on the Administra-                ture. Fixed costs are summarised in Table 2.
tive Officer Level 2 Increment 8 pay scale or $49,177 per


                                                                                                                             Page 3 of 7
                                                                                                     (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                          http://www.biomedcentral.com/1472-6963/8/107




Table 2: A summary of the fixed and variable costs associated with running both email counselling services.

                                                                                    COTS ($)                Purpose-written ($)

 Fixed costs
 Annual equivalent cost of capital cost (annual)                                        0                            6995
 Service fee (annual)                                                                   0                            5000

 Variable costs
 Supervisory staff (workload 6000+) (annual)                                         77,841                         61,454
 Administrative staff (workload 3000+) (per email)                                    1.62                            0
 Counselling staff (per email)                                                        19.93                         19.93



Variable Costs                                                       Threshold
Staff Costs                                                          The average cost per email consultation is represented
The main costs associated with providing an email service            graphically in Figure 1. We calculated the point at which
were for clinical, supervisory and administrative staff sal-         the two lines intersect, by using linear equations, to be
aries.                                                               between 5000 and 6000 emails consultation per year.
                                                                     Under these conditions, the threshold was reached at a
Counsellors                                                          workload of 5216 email consultations per year; when
Each counsellor cost the organisation $67,670 per                    more than 5216 email consultations are undertaken, pur-
annum. Clinical hours for a counsellor were calculated to            pose-written software was cheaper than the COTS applica-
be 1357 hours per annum after leave and time for non-                tion.
clinical duties were subtracted from salaried hours. From
the data extract we calculated that a counsellor conducted           Sensitivity Analysis
on average 2.5 email consultations per hour regardless of            The threshold was re-calculated for a 50% change in each
the service model. This equated to 3395 email consulta-              of the key input costs. The key input costs were increased
tion per year per counsellor; therefore, the average coun-           by 25% and decreased by 25% resulting in an overall var-
selling cost per email is $19.93.                                    iation of 50%. The change in threshold was expressed as a
                                                                     ratio to the original base threshold (Table 4). A change of
Supervisor                                                           50% to administrative staff costs resulted in the greatest
When the service was using a COTS application, a super-              change to results with a 4.5% change to the original base
visor cost the organisation $77,842 per annum, after                 threshold. All other factors had a lesser effect on results.
implementation of the dedicated system, supervisors esti-            The factors assessed in this sensitivity analysis had rela-
mated they saved eight hours per week [11]. Therefore, the           tively little effect compared with the annual number of
supervisor cost using our purpose-written system was                 emails sent.
$61,454 per annum. Cost for the supervisor was applica-
ble for workloads of 6000 to 10,000 email consultations              Discussion
per annum.                                                           Studies of email-based telemedicine have shown that
                                                                     some roles – namely administrative and supervisory – are
Administrative
When the volume of emails was 10,000 consultations per               Table 3: Total costs associated with operating each email
year the administrative officer reported spending 12.5               counselling service at varying workloads.
hours per week on email duties. This equated to $1.62 per
email. This cost was applied for workload volumes of                  Email consultations per annum     COTS ($)     Purpose-written ($)
3000 to 10,000 emails per annum. The need for adminis-
                                                                                   1000                  19,930              31,925
trative support was eliminated after the introduction of
                                                                                   2000                  39,860              51,855
the purpose-written application because of the automa-                             3000                  64,650              71,785
tion of their duties.                                                              4000                  86,200              91,715
                                                                                   5000                  107,750             111,645
Variable costs are summarised in Table 2.                                          6000                  207,141             193,029
                                                                                   7000                  228,691             212,959
Total fixed and variable costs are shown in Table 3.                               8000                  250,241             232,889
                                                                                   9000                  271,791             252,819
                                                                                  10,000                 293,341             272,749




                                                                                                                              Page 4 of 7
                                                                                                      (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                           http://www.biomedcentral.com/1472-6963/8/107




Figure 1




more automation friendly than clinical roles [11]. Pur-               volume of emails has a greater impact on results than any
pose-written email systems – through automation – can                 of the input factors.
reduce or eliminate these roles. This study has determined
that when more than ~5200 email consultations are                     Purpose-written telemedicine applications will often pro-
undertaken annually, purpose-written software for use in              vide benefits over COTS which may be difficult to quan-
counselling settings reduces costs through freeing up staff           tify. These benefits include: ease of implementation –
time compared with using COTS. The potential savings                  especially in multi-clinician healthcare organisations,
increased as workload increased above the threshold                   auditing tools that ensure no consultation is overlooked
value. The threshold was most sensitive to changes in key-            and faster turn-around-time to client emails. Healthcare
input costs (administrative staff costs, capital costs and            organisations could justify purpose-written telemedicine
service fees) affecting only one of the service models.               applications, not only on cost but on these benefits.
Costs, which affected both service models, resulted in
lesser change – for example, counselling staff salary had             Most telemedicine services require start-up costs associ-
no effect on the threshold. An adjustment of 50% in costs             ated with infrastructure development – for example, pur-
resulted in maximum change of 4.5% to the threshold                   chase of equipment and telecommunications [13-15].
hence, effect was considered small. However, the annual               There are similar start-up costs if the healthcare organisa-

Table 4: Sensitivity analysis: adjusted threshold calculated when individual cost elements are adjusted by 50%

                                 Base Threshold     Adjusted Threshold +25%     Adjusted Threshold -25%         Change      Ratio (%)    Rank

 Capital cost                        5216                    5313                        5119                    194          3.7          2
 Service fee                         5216                    5286                        5147                     139          2.7         3
 Supervisory staff salary            5216                    5176                        5280                    -104         -2.0         4
 Administrative staff salary         5216                    5102                        5336                    -234         -4.5         1
 Counselling staff salary            5216                    5216                        5216                      0            -          5




                                                                                                                                  Page 5 of 7
                                                                                                          (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                     http://www.biomedcentral.com/1472-6963/8/107



tion chooses to develop their own purpose-written email       Developing purpose-written software was found to be a
application. Interestingly, this study found that the soft-   relatively small investment. Before implementing an
ware cost had little effect on the email volume threshold     email-based telemedicine system – health-care providers
where purpose-written software became cost-saving.            should consider important factors, which may influence
Changes in the capital cost (3.7%) to develop the pur-        the overall cost to their organisation.
pose-written software and similarly, the cost of hosting
the software (2.7%) were both small. Therefore, develop-      Competing interests
ing purpose-written software is a relatively small invest-    The authors declare that they have no competing interests.
ment.
                                                              Authors' contributions
This study has compared two options for establishing and      LC and ACS produced the first draft of the manuscript.
running an email service but a healthcare organisation        ACS and PAS provided valuable guidance with the inter-
may have a further service delivery option – namely, non-     pretation of the economic evaluation. All authors contrib-
commercial off-the-shelf email applications that have         uted to the review and editing of the manuscript. All
been developed for telemedicine services. Some software       authors have read and approved the final version of the
authors have made their email-based telemedicine soft-        manuscript.
ware available free of charge [16-18] through open-source
software licensing arrangements. These open-source            Acknowledgements
applications were originally developed for a specific serv-   We thank staff at both counselling organisations for their collaboration on
ice and therefore may or may not be suitable for another      this project.
organisation's email service. They would need to be
assessed on a case-by-case basis prior to implementation.     References
                                                              1.    Della Mea V: Internet electronic mail: a tool for low-cost tele-
An organisation would need to determine if one of the               medicine. J Telemed Telecare 1999, 5(2):84-89.
open-source applications could be adapted for their own       2.    Della Mea V: Prerecorded telemedicine. J Telemed Telecare 2005,
service and whether it provided workflow advantage over             11(6):276-284.
                                                              3.    Swinfen R, Swinfen P: Low-cost telemedicine in the developing
COTS applications. They would also need to evaluate the             world. J Telemed Telecare 2002, 8 Suppl 3:S3:63-5.
costs of providing IT infrastructure to support it. If an     4.    Hersh D, Hersch F, Mikuletic L, Neilson S: A Web-based approach
                                                                    to low-cost telemedicine. J Telemed Telecare 2003, 9 Suppl
open-source application was found to be suitable, the               2:S24-6.
healthcare organisation could avoid the development cost      5.    Wootton R: Design and implementation of an automatic mes-
of a purpose-written application and hence, reduce the              sage-routing system for low-cost telemedicine. J Telemed Tel-
                                                                    ecare 2003, 9 Suppl 1:S44-7.
threshold number of consultations where a telemedicine        6.    Reid W, Caswell D: A national Telephone and Online Counsel-
specific application is more economical than a COTS                 ling Service for Young Australians. In Telepediatrics: Telemedicine
application.                                                        and Child Health Edited by: Wootton R, Batch J. London , Royal Soci-
                                                                    ety of Medicine Press; 2005.
                                                              7.    Eisdorfer C, Czaja SJ, Loewenstein DA, Rubert MP, Arguelles S,
Like any economic evaluation, one must clearly state the            Mitrani VB, Szapocznik J: The effect of a family therapy and tech-
                                                                    nology-based intervention on caregiver depression. Gerontol-
assumptions which form the basis of the analysis. Our               ogist 2003, 43(4):521-531.
assumptions are based on two subject organisations            8.    Beauchamp N, Irvine AB, Seeley J, Johnson B: Worksite-based
which provide online counseling services. Caution must              internet multimedia program for family caregivers of per-
                                                                    sons with dementia. Gerontologist 2005, 45(6):793-801.
be applied in generalising these results to email-based       9.    Grant JS, Elliott TR, Weaver M, Bartolucci AA, Giger JN: Telephone
services which support other medical specialties.                   intervention with family caregivers of stroke survivors after
                                                                    rehabilitation. Stroke 2002, 33(8):2060-2065.
                                                              10.   Marziali E, Donahue P: Caring for others: Internet video-confer-
Conclusion                                                          encing group intervention for family caregivers of older
The results show email-based services whose work volume             adults with neurodegenerative disease. Gerontologist 2006,
                                                                    46(3):398-403.
is greater then 5216 emails consultations per year would      11.   Caffery L, Crew-Wegner K, Reid W, Wootton R: Automatic mes-
realise savings by developing their own purpose-written             sage handling for a national counselling service. J Telemed Tel-
email-based telemedicine application. As workload                   ecare 2004, 10 Suppl 1:18-21.
                                                              12.   Drummond M, O'Brien B, Stoddart G, Torrance G: Methods for
increases above 5216 consultations, the potential savings           the economic evaluation of health care programmes. 2nd
would become greater. Alternatively, if the workload is             edition. Oxford , Oxford University Press; 2000.
                                                              13.   Smith AC, Scuffham P, Wootton R: The costs and potential sav-
less than 5216 consultations it would be cheaper to                 ings of a novel telepaediatric service in Queensland. BMC
implement the service using the organisations existing              Health Serv Res 2007, 7:35.
email system. This analysis provides a useful economic        14.   Bergmo TS: An economic analysis of teleconsultation in
                                                                    otorhinolaryngology. J Telemed Telecare 1997, 3(4):194-199.
model which demonstrates the relationship between             15.   Bergmo TS: An economic analysis of teleradiology versus a vis-
workload and potential savings. The threshold is most               iting radiologist service. J Telemed Telecare 1996, 2(3):136-142.
                                                              16.   Fraser HS, Jazayeri D, Bannach L, Szolovits P, McGrath SJ: TeleMed-
sensitive to changes in administrative staff salary. Change         Mail: free software to facilitate telemedicine in developing
to counselling staff salary has no effect on threshold.             countries. Medinfo 2001, 10(Pt 1):815-819.



                                                                                                                           Page 6 of 7
                                                                                                   (page number not for citation purposes)
BMC Health Services Research 2008, 8:107                                                http://www.biomedcentral.com/1472-6963/8/107



17.   Bergmo TS, Kummervold PE, Gammon D, Dahl LB: Electronic
      patient-provider communication: will it offset office visits
      and telephone consultations in primary care? Int J Med Inform
      2005, 74(9):705-710.
18.   Brauchli K, O'Mahony D, Banach L, Oberholzer M: iPath - a Tele-
      medicine Platform to Support Health Providers in Low
      Resource Settings. Stud Health Technol Inform 2005, 114:11-17.

Pre-publication history
The pre-publication history for this paper can be accessed
here:

http://www.biomedcentral.com/1472-6963/8/107/pre
pub




                                                                                 Publish with Bio Med Central and every
                                                                                scientist can read your work free of charge
                                                                            "BioMed Central will be the most significant development for
                                                                            disseminating the results of biomedical researc h in our lifetime."
                                                                                 Sir Paul Nurse, Cancer Research UK

                                                                               Your research papers will be:
                                                                                 available free of charge to the entire biomedical community
                                                                                 peer reviewed and published immediately upon acceptance
                                                                                 cited in PubMed and archived on PubMed Central
                                                                                 yours — you keep the copyright

                                                                        Submit your manuscript here:                                BioMedcentral
                                                                        http://www.biomedcentral.com/info/publishing_adv.asp




                                                                                                                                          Page 7 of 7
                                                                                                                  (page number not for citation purposes)

Más contenido relacionado

Destacado

Icma Risk Communication Workshops
Icma Risk Communication WorkshopsIcma Risk Communication Workshops
Icma Risk Communication Workshopsmkorzelius
 
Mybatis spring-1.0.2-reference
Mybatis spring-1.0.2-referenceMybatis spring-1.0.2-reference
Mybatis spring-1.0.2-referenceSergio Avila
 
Modernist marble tile collection 2009
Modernist marble tile collection 2009Modernist marble tile collection 2009
Modernist marble tile collection 2009lauragottwald
 
Loft Residence for TV Director Family
Loft Residence for TV Director FamilyLoft Residence for TV Director Family
Loft Residence for TV Director Familylauragottwald
 

Destacado (6)

Icma Risk Communication Workshops
Icma Risk Communication WorkshopsIcma Risk Communication Workshops
Icma Risk Communication Workshops
 
Middlebury College CSO: Interviewing
Middlebury College CSO: InterviewingMiddlebury College CSO: Interviewing
Middlebury College CSO: Interviewing
 
Bioslide
BioslideBioslide
Bioslide
 
Mybatis spring-1.0.2-reference
Mybatis spring-1.0.2-referenceMybatis spring-1.0.2-reference
Mybatis spring-1.0.2-reference
 
Modernist marble tile collection 2009
Modernist marble tile collection 2009Modernist marble tile collection 2009
Modernist marble tile collection 2009
 
Loft Residence for TV Director Family
Loft Residence for TV Director FamilyLoft Residence for TV Director Family
Loft Residence for TV Director Family
 

Similar a Analisis Email Berbasis Telemedis

IRJET- Clinical Medical Knowledge Extraction using Crowdsourcing Techniques
IRJET-  	  Clinical Medical Knowledge Extraction using Crowdsourcing TechniquesIRJET-  	  Clinical Medical Knowledge Extraction using Crowdsourcing Techniques
IRJET- Clinical Medical Knowledge Extraction using Crowdsourcing TechniquesIRJET Journal
 
CLOUD COMPUTING BASED TELEMEDICINE SERVICE
CLOUD COMPUTING BASED TELEMEDICINE SERVICECLOUD COMPUTING BASED TELEMEDICINE SERVICE
CLOUD COMPUTING BASED TELEMEDICINE SERVICEIRJET Journal
 
An approach to enhance the software and services of health care centre
An approach to enhance the software and services of health care centreAn approach to enhance the software and services of health care centre
An approach to enhance the software and services of health care centreAlexander Decker
 
Case study-nhs-central-eastern ol-small
Case study-nhs-central-eastern ol-smallCase study-nhs-central-eastern ol-small
Case study-nhs-central-eastern ol-smalldcslSoftware
 
Framework Architecture for Improving Healthcare Information Systems using Age...
Framework Architecture for Improving Healthcare Information Systems using Age...Framework Architecture for Improving Healthcare Information Systems using Age...
Framework Architecture for Improving Healthcare Information Systems using Age...IJMIT JOURNAL
 
Framework architecture for improving
Framework architecture for improvingFramework architecture for improving
Framework architecture for improvingIJMIT JOURNAL
 
An Analysis Of Telemedicine In Taiwan A Business Model Perspective
An Analysis Of Telemedicine In Taiwan  A Business Model PerspectiveAn Analysis Of Telemedicine In Taiwan  A Business Model Perspective
An Analysis Of Telemedicine In Taiwan A Business Model PerspectiveLori Mitchell
 
Cost benefit EMR
Cost benefit EMRCost benefit EMR
Cost benefit EMR4605_hendra
 
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING  A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING DMV SAI
 
A doctor recommender system based on collaborative and content filtering
A doctor recommender system based on collaborative and  content filteringA doctor recommender system based on collaborative and  content filtering
A doctor recommender system based on collaborative and content filteringIJECEIAES
 
Proposed Framework For Electronic Clinical Record Information System
Proposed Framework For Electronic Clinical Record Information SystemProposed Framework For Electronic Clinical Record Information System
Proposed Framework For Electronic Clinical Record Information Systemijcsa
 
EHR with Health Applications b.sc ii Sem.pptx
EHR with Health Applications b.sc ii Sem.pptxEHR with Health Applications b.sc ii Sem.pptx
EHR with Health Applications b.sc ii Sem.pptxanjalatchi
 
An Operational and Digital Transformation of Primary Care
An Operational and Digital Transformation of Primary CareAn Operational and Digital Transformation of Primary Care
An Operational and Digital Transformation of Primary CareMelissa Nurcombe
 

Similar a Analisis Email Berbasis Telemedis (20)

IRJET- Clinical Medical Knowledge Extraction using Crowdsourcing Techniques
IRJET-  	  Clinical Medical Knowledge Extraction using Crowdsourcing TechniquesIRJET-  	  Clinical Medical Knowledge Extraction using Crowdsourcing Techniques
IRJET- Clinical Medical Knowledge Extraction using Crowdsourcing Techniques
 
CLOUD COMPUTING BASED TELEMEDICINE SERVICE
CLOUD COMPUTING BASED TELEMEDICINE SERVICECLOUD COMPUTING BASED TELEMEDICINE SERVICE
CLOUD COMPUTING BASED TELEMEDICINE SERVICE
 
An approach to enhance the software and services of health care centre
An approach to enhance the software and services of health care centreAn approach to enhance the software and services of health care centre
An approach to enhance the software and services of health care centre
 
Spw Rollout
Spw RolloutSpw Rollout
Spw Rollout
 
Case study-nhs-central-eastern ol-small
Case study-nhs-central-eastern ol-smallCase study-nhs-central-eastern ol-small
Case study-nhs-central-eastern ol-small
 
Framework Architecture for Improving Healthcare Information Systems using Age...
Framework Architecture for Improving Healthcare Information Systems using Age...Framework Architecture for Improving Healthcare Information Systems using Age...
Framework Architecture for Improving Healthcare Information Systems using Age...
 
Framework architecture for improving
Framework architecture for improvingFramework architecture for improving
Framework architecture for improving
 
An Analysis Of Telemedicine In Taiwan A Business Model Perspective
An Analysis Of Telemedicine In Taiwan  A Business Model PerspectiveAn Analysis Of Telemedicine In Taiwan  A Business Model Perspective
An Analysis Of Telemedicine In Taiwan A Business Model Perspective
 
IBM - 9iun2011
IBM - 9iun2011IBM - 9iun2011
IBM - 9iun2011
 
E health
E healthE health
E health
 
Cost benefit EMR
Cost benefit EMRCost benefit EMR
Cost benefit EMR
 
Is 464 lecture 1
Is 464 lecture 1 Is 464 lecture 1
Is 464 lecture 1
 
QIPP end of life care event report
QIPP end of life care event reportQIPP end of life care event report
QIPP end of life care event report
 
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING  A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING
A PROJECT REPORT ON CLOUD ASSISTED PRIVACY PRESERVING MOBILE HEALTH MONITORING
 
A doctor recommender system based on collaborative and content filtering
A doctor recommender system based on collaborative and  content filteringA doctor recommender system based on collaborative and  content filtering
A doctor recommender system based on collaborative and content filtering
 
Proposed Framework For Electronic Clinical Record Information System
Proposed Framework For Electronic Clinical Record Information SystemProposed Framework For Electronic Clinical Record Information System
Proposed Framework For Electronic Clinical Record Information System
 
EHR with Health Applications b.sc ii Sem.pptx
EHR with Health Applications b.sc ii Sem.pptxEHR with Health Applications b.sc ii Sem.pptx
EHR with Health Applications b.sc ii Sem.pptx
 
An Operational and Digital Transformation of Primary Care
An Operational and Digital Transformation of Primary CareAn Operational and Digital Transformation of Primary Care
An Operational and Digital Transformation of Primary Care
 
Software for services
Software for servicesSoftware for services
Software for services
 
E017632934
E017632934E017632934
E017632934
 

Último

All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...Arohi Goyal
 
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...GENUINE ESCORT AGENCY
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...aartirawatdelhi
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...astropune
 
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...Taniya Sharma
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...chandars293
 
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...perfect solution
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Dipal Arora
 
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service AvailableDipal Arora
 
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...narwatsonia7
 
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In AhmedabadO898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In AhmedabadGENUINE ESCORT AGENCY
 
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur  Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Guntur  Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service AvailableDipal Arora
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...hotbabesbook
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 9332606886 ⟟ Call Me For Ge...
Top Rated Bangalore Call Girls Richmond Circle ⟟  9332606886 ⟟ Call Me For Ge...Top Rated Bangalore Call Girls Richmond Circle ⟟  9332606886 ⟟ Call Me For Ge...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 9332606886 ⟟ Call Me For Ge...narwatsonia7
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Servicevidya singh
 
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋TANUJA PANDEY
 

Último (20)

All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
 
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
 
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
Night 7k to 12k Navi Mumbai Call Girl Photo 👉 BOOK NOW 9833363713 👈 ♀️ night ...
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
 
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
 
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 9332606886 𖠋 Will You Mis...
 
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...
College Call Girls in Haridwar 9667172968 Short 4000 Night 10000 Best call gi...
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
 
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Jabalpur Just Call 8250077686 Top Class Call Girl Service Available
 
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...
 
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
 
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In AhmedabadO898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O898O367676 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
 
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur  Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Guntur  Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Guntur Just Call 8250077686 Top Class Call Girl Service Available
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
 
Top Rated Bangalore Call Girls Richmond Circle ⟟ 9332606886 ⟟ Call Me For Ge...
Top Rated Bangalore Call Girls Richmond Circle ⟟  9332606886 ⟟ Call Me For Ge...Top Rated Bangalore Call Girls Richmond Circle ⟟  9332606886 ⟟ Call Me For Ge...
Top Rated Bangalore Call Girls Richmond Circle ⟟ 9332606886 ⟟ Call Me For Ge...
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
 
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls Bahadurpally 7877925207 ₹5000 To 25K With AC Room 💚😋
 

Analisis Email Berbasis Telemedis

  • 1. BMC Health Services Research BioMed Central Research article Open Access An economic analysis of email-based telemedicine: A cost minimisation study of two service models Liam Caffery1, Anthony C Smith*1 and Paul A Scuffham2 Address: 1Centre for Online Health, University of Queensland, Australia, Level 3 Foundation Building. Royal Children's Hospital, Herston Road, Herston, Queensland 4029, Australia and 2School of Medicine, Griffith University, Logan Campus L03 2.43. Griffith University, Queensland, Australia Email: Liam Caffery - l.caffery@coh.uq.edu.au; Anthony C Smith* - a.smith@pobox.com; Paul A Scuffham - p.scuffham@griffith.edu.au * Corresponding author Published: 22 May 2008 Received: 18 December 2007 Accepted: 22 May 2008 BMC Health Services Research 2008, 8:107 doi:10.1186/1472-6963-8-107 This article is available from: http://www.biomedcentral.com/1472-6963/8/107 © 2008 Caffery et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Abstract Background: Email-based telemedicine has been reported to be an efficient method of delivering online health services to patients at a distance and is often described as a low-cost form of telemedicine. The service may be low-cost if the healthcare organisation utilise their existing email infrastructure to provide their telemedicine service. Many healthcare organisations use commercial-off-the-shelf (COTS) email applications. COTS email applications are designed for peer-to-peer communication; hence, in situations where multiple clinicians need to be involved, COTS applications may be deficient in delivering telemedicine. Larger services often rely on different staff disciplines to run their service and telemedicine tools for supervisors, clinicians and administrative staff are not available in COTS applications. Hence, some organisations may choose to develop a purpose-written email application to support telemedicine. We have conducted a cost-minimisation analysis of two different service models for establishing and operating an email service. The first service model used a COTS email application and the second used a purpose-written telemedicine application. Methods: The actual costs used in the analysis were from two organisations that originally ran their counselling service with a COTS email application and later implemented a purpose-written application. The purpose-written application automated a number of the tasks associated with running an email-based service. We calculated a threshold at which the higher initial costs for software development were offset by efficiency gains from automation. We also performed a sensitivity analysis to determine the effect of individual costs on the threshold. Results: The cost of providing an email service at 1000 consultations per annum was $19,930 using a COTS email application and $31,925 using a purpose-written application. At 10,000 consultations per annum the cost of providing the service using COTS email software was $293,341 compared to $272,749 for the purpose-written application. The threshold was calculated at a workload of 5216 consultations per annum. When more than 5216 email consultations per annum are undertaken, the purpose-written application was cheaper than the COTS service model. The sensitivity analysis showed the threshold was most sensitive to changes in administrative staff salaries. Conclusion: In the context of telemedicine, we have compared two different service models for email-based communication – purpose-written and COTS applications. Under the circumstances described in the paper, when workload exceeded 5216 email consultations per annum, there were savings made when a purpose-written email application was used. This analysis provides a useful economic model for organisations contemplating the use of an email-based telemedicine system. Page 1 of 7 (page number not for citation purposes)
  • 2. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 Background person who is aged, with a disability or with a chronic or Email-based telemedicine is often described as a low-cost mental illness. Caring places enormous demands on these form of telemedicine [1-3]. This may be true if the tele- carers and the negative consequences associated with car- medicine service uses existing email infrastructure; how- ing are well documented [7]. It has also been well docu- ever, a number of authors have identified that mented that carers who seek intervention have less commercial-off-the-shelf (COTS) email applications are depression, less stress and significant improvement in deficient at running telemedicine services and an email- measures of vitality, social functioning and mental health based telemedicine service is more efficient using a pur- [7-10]. For these reasons, counselling is an important sup- pose-written telemedicine application [4,5]. We devel- port service offered by the charity. oped a purpose-written application for email-based telemedicine services. Our purpose-written application is Following the implementation of our purpose-written a webmail product designed to support the workflow of telemedicine software for these two email counselling supervisors, clinicians and administrative staff of the tele- organisations in Australia [11], the present study com- medicine provider. It was developed after requirements pares the economics of both of these services. We have analysis was performed for the subject organisations. Tele- analysed the costs of establishing and operating a tele- medicine functionalities of our webmail application are medicine service using COTS email software and com- described below: pared these with the costs of establishing and operating the same telemedicine service with our purpose-written ▪All incoming emails are automatically scanned and email-based telemedicine application. flagged if they contained pre-defined keywords. The aim of this study was to identify costs associated with ▪Email cases can be triaged and assigned to a particular cli- providing an email-based telemedicine services using two nician. alternative service models and determine the conditions required for each service to become economically viable. ▪Auditing tools ensure cases are answered in a timely fash- ion. Methods We compared the actual costs of operating an email-based ▪Full patient history can be viewed online. telemedicine service for the two service models. Both organisations involved in our study were operating an ▪Complex cases can be flagged by the clinician, ensuring a email-based service using COTS software prior to imple- supervisor endorses the response, before it is sent to the menting our purpose-written application. The fixed and client. variable costs for both service delivery alternatives were calculated from data collected from both organisations. Our application also automates a number of tasks associ- By evaluating two organisations we were able to more ated with running a telemedicine service – for example, accurately determine variable costs at a range of different the automatic allocation of cases to a clinician with an workloads. existing relationship with a client and the automatic pro- vision of workload statistics. Data Collection Workload activity data was collected from both counsel- We implemented our purpose-written application for two ling organisations (Table 1). Our subject organisation counselling organisations. The first organisation is a recorded information about all email interactions in a national telephone and email counselling service aimed database, including the amount of time counsellors spent specifically for children aged five to eighteen years. The on each teleconsultation and the service delivery model. service is free and staffed by over 100 professional coun- Data extracted from this database was used for counsellor sellors – 90% of whom have tertiary qualifications in psy- cost calculations. chology, social work and related disciplines [6]. Most client emails are regarding family and peer relationships. Administrative and supervisory staff recorded the time Email contact relating to mental health, suicide, eating they spent on the email service pre- and post- installation behaviours and self-image are to two to three times higher of the purpose-written application. Results from this than for telephone counselling [6] – indicating clients study form the basis of staff cost calculations for these dis- enjoy the anonymity of email. ciplines [11]. The second subject organisation is a registered charity that Capital costs and service fees were actual costs we charged provides support services to family carers. Carers are the counselling organisation for developing and hosting mostly family members who provide voluntary care for a the purpose-written email application. Page 2 of 7 (page number not for citation purposes)
  • 3. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 Table 1: Telemedicine activity for the two counselling organisations. Organisation A Organisation B Study Period May 2004 – Aug 2006 Jun 2005 – Jun 2006 Total duration (months) 28 13 Total number of email consultations 21,207 369 Average consultations per month 784 30 Consultations per month – range 611–1097 6–53 Assumptions annum per full-time equivalent, including on-costs. Their The present cost analysis was based on the assumption duties include retrieving patient history when an email that patient outcomes were the same for both service alter- was from existing client, auditing client emails to ensure natives. Costs were calculated from the perspective of the all incoming emails had been answered and the manual healthcare organisation in Australian dollars (A$1 provision of workload data for management reports. =~US$0.86 or ~0.63 Euro) and included 10% Goods and Services Tax. Staff pay rates in both counselling organisa- Fixed Costs tions were calculated according to the state health depart- Fixed costs included capital costs to develop and imple- ment's professional and administrative officer's scale. We ment the purpose-written email service. The initial capital added an additional 20% to the salary expenses, to outlay was converted into an annual equivalent cost account for the employee's non-salary costs or "on-costs" through a process of annuitizing these costs over the life – for example, superannuation and work cover premiums. expectancy of the application [12]. A life expectancy of seven years and a depreciation rate of 14% was used in the It was unnecessary to employ all disciplines of staff for all calculations. It was assumed there was no resale value at workload volumes – for example, if only one counsellor the end of the lifecycle. In addition, an annual fixed cost was employed it would be unwarranted to also employ a (service fee) was also incurred by each counselling organ- supervisor; similarly a small volume service may not isation when using the purpose-written application. This require administrative support. Staff involved in the deliv- fee covered the hosting and associated technical support ery of email counselling service suggested the appropriate required by the purpose-written application. workload volume to introduce administrative support and supervisory support was 3000 and 6000 email con- Threshold analysis sultations per annum respectively and only one person The threshold was calculated at which the cost of using the from each discipline was necessary until the workload COTS email application was the same as using the pur- exceed 10,000 email consultations per annum. pose written application. The annual service fee for the purpose-written email appli- Sensitivity analysis cation included minor enhancements and maintenance A one-way sensitivity analysis was undertaken by varying programming. For these reasons, it was assumed the soft- the key input values by 50% and assessing the change on ware would remain operational for seven years. the threshold where both service delivery options are equal. Key inputs included the cost of developing the pur- Staff Costs pose-written software, the cost of hosting the software A counsellor's salary was based on the Professional Officer (service fee), and staff salaries. Level 2.6 rate of $67,670 per annum per full time equiva- lent, including on-costs. Their duties included reading Results and responding to client emails. Fixed Costs The capital cost charged to both counselling organisations A supervisor's duties include triage of all incoming emails to implement our purpose-written application was to assign a priority, allocation of cases to staff and proof- $30,000, which equated to $6995 after annuitizing. In ing outgoing responses from counsellors. A supervisor sal- addition, both counselling organisations incurred an ary was based on the Professional Officer Level 3.4 rate of annual fee of $5000 to host the telemedicine application. $77,842 per annum per full time equivalent, including There were no fixed costs associated with running the serv- 20% on-costs. ice using the COTS software as the original service used the counselling organisation's existing email infrastruc- Administrative staff costs were based on the Administra- ture. Fixed costs are summarised in Table 2. tive Officer Level 2 Increment 8 pay scale or $49,177 per Page 3 of 7 (page number not for citation purposes)
  • 4. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 Table 2: A summary of the fixed and variable costs associated with running both email counselling services. COTS ($) Purpose-written ($) Fixed costs Annual equivalent cost of capital cost (annual) 0 6995 Service fee (annual) 0 5000 Variable costs Supervisory staff (workload 6000+) (annual) 77,841 61,454 Administrative staff (workload 3000+) (per email) 1.62 0 Counselling staff (per email) 19.93 19.93 Variable Costs Threshold Staff Costs The average cost per email consultation is represented The main costs associated with providing an email service graphically in Figure 1. We calculated the point at which were for clinical, supervisory and administrative staff sal- the two lines intersect, by using linear equations, to be aries. between 5000 and 6000 emails consultation per year. Under these conditions, the threshold was reached at a Counsellors workload of 5216 email consultations per year; when Each counsellor cost the organisation $67,670 per more than 5216 email consultations are undertaken, pur- annum. Clinical hours for a counsellor were calculated to pose-written software was cheaper than the COTS applica- be 1357 hours per annum after leave and time for non- tion. clinical duties were subtracted from salaried hours. From the data extract we calculated that a counsellor conducted Sensitivity Analysis on average 2.5 email consultations per hour regardless of The threshold was re-calculated for a 50% change in each the service model. This equated to 3395 email consulta- of the key input costs. The key input costs were increased tion per year per counsellor; therefore, the average coun- by 25% and decreased by 25% resulting in an overall var- selling cost per email is $19.93. iation of 50%. The change in threshold was expressed as a ratio to the original base threshold (Table 4). A change of Supervisor 50% to administrative staff costs resulted in the greatest When the service was using a COTS application, a super- change to results with a 4.5% change to the original base visor cost the organisation $77,842 per annum, after threshold. All other factors had a lesser effect on results. implementation of the dedicated system, supervisors esti- The factors assessed in this sensitivity analysis had rela- mated they saved eight hours per week [11]. Therefore, the tively little effect compared with the annual number of supervisor cost using our purpose-written system was emails sent. $61,454 per annum. Cost for the supervisor was applica- ble for workloads of 6000 to 10,000 email consultations Discussion per annum. Studies of email-based telemedicine have shown that some roles – namely administrative and supervisory – are Administrative When the volume of emails was 10,000 consultations per Table 3: Total costs associated with operating each email year the administrative officer reported spending 12.5 counselling service at varying workloads. hours per week on email duties. This equated to $1.62 per email. This cost was applied for workload volumes of Email consultations per annum COTS ($) Purpose-written ($) 3000 to 10,000 emails per annum. The need for adminis- 1000 19,930 31,925 trative support was eliminated after the introduction of 2000 39,860 51,855 the purpose-written application because of the automa- 3000 64,650 71,785 tion of their duties. 4000 86,200 91,715 5000 107,750 111,645 Variable costs are summarised in Table 2. 6000 207,141 193,029 7000 228,691 212,959 Total fixed and variable costs are shown in Table 3. 8000 250,241 232,889 9000 271,791 252,819 10,000 293,341 272,749 Page 4 of 7 (page number not for citation purposes)
  • 5. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 Figure 1 more automation friendly than clinical roles [11]. Pur- volume of emails has a greater impact on results than any pose-written email systems – through automation – can of the input factors. reduce or eliminate these roles. This study has determined that when more than ~5200 email consultations are Purpose-written telemedicine applications will often pro- undertaken annually, purpose-written software for use in vide benefits over COTS which may be difficult to quan- counselling settings reduces costs through freeing up staff tify. These benefits include: ease of implementation – time compared with using COTS. The potential savings especially in multi-clinician healthcare organisations, increased as workload increased above the threshold auditing tools that ensure no consultation is overlooked value. The threshold was most sensitive to changes in key- and faster turn-around-time to client emails. Healthcare input costs (administrative staff costs, capital costs and organisations could justify purpose-written telemedicine service fees) affecting only one of the service models. applications, not only on cost but on these benefits. Costs, which affected both service models, resulted in lesser change – for example, counselling staff salary had Most telemedicine services require start-up costs associ- no effect on the threshold. An adjustment of 50% in costs ated with infrastructure development – for example, pur- resulted in maximum change of 4.5% to the threshold chase of equipment and telecommunications [13-15]. hence, effect was considered small. However, the annual There are similar start-up costs if the healthcare organisa- Table 4: Sensitivity analysis: adjusted threshold calculated when individual cost elements are adjusted by 50% Base Threshold Adjusted Threshold +25% Adjusted Threshold -25% Change Ratio (%) Rank Capital cost 5216 5313 5119 194 3.7 2 Service fee 5216 5286 5147 139 2.7 3 Supervisory staff salary 5216 5176 5280 -104 -2.0 4 Administrative staff salary 5216 5102 5336 -234 -4.5 1 Counselling staff salary 5216 5216 5216 0 - 5 Page 5 of 7 (page number not for citation purposes)
  • 6. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 tion chooses to develop their own purpose-written email Developing purpose-written software was found to be a application. Interestingly, this study found that the soft- relatively small investment. Before implementing an ware cost had little effect on the email volume threshold email-based telemedicine system – health-care providers where purpose-written software became cost-saving. should consider important factors, which may influence Changes in the capital cost (3.7%) to develop the pur- the overall cost to their organisation. pose-written software and similarly, the cost of hosting the software (2.7%) were both small. Therefore, develop- Competing interests ing purpose-written software is a relatively small invest- The authors declare that they have no competing interests. ment. Authors' contributions This study has compared two options for establishing and LC and ACS produced the first draft of the manuscript. running an email service but a healthcare organisation ACS and PAS provided valuable guidance with the inter- may have a further service delivery option – namely, non- pretation of the economic evaluation. All authors contrib- commercial off-the-shelf email applications that have uted to the review and editing of the manuscript. All been developed for telemedicine services. Some software authors have read and approved the final version of the authors have made their email-based telemedicine soft- manuscript. ware available free of charge [16-18] through open-source software licensing arrangements. These open-source Acknowledgements applications were originally developed for a specific serv- We thank staff at both counselling organisations for their collaboration on ice and therefore may or may not be suitable for another this project. organisation's email service. They would need to be assessed on a case-by-case basis prior to implementation. References 1. Della Mea V: Internet electronic mail: a tool for low-cost tele- An organisation would need to determine if one of the medicine. J Telemed Telecare 1999, 5(2):84-89. open-source applications could be adapted for their own 2. Della Mea V: Prerecorded telemedicine. J Telemed Telecare 2005, service and whether it provided workflow advantage over 11(6):276-284. 3. Swinfen R, Swinfen P: Low-cost telemedicine in the developing COTS applications. They would also need to evaluate the world. J Telemed Telecare 2002, 8 Suppl 3:S3:63-5. costs of providing IT infrastructure to support it. If an 4. Hersh D, Hersch F, Mikuletic L, Neilson S: A Web-based approach to low-cost telemedicine. J Telemed Telecare 2003, 9 Suppl open-source application was found to be suitable, the 2:S24-6. healthcare organisation could avoid the development cost 5. Wootton R: Design and implementation of an automatic mes- of a purpose-written application and hence, reduce the sage-routing system for low-cost telemedicine. J Telemed Tel- ecare 2003, 9 Suppl 1:S44-7. threshold number of consultations where a telemedicine 6. Reid W, Caswell D: A national Telephone and Online Counsel- specific application is more economical than a COTS ling Service for Young Australians. In Telepediatrics: Telemedicine application. and Child Health Edited by: Wootton R, Batch J. London , Royal Soci- ety of Medicine Press; 2005. 7. Eisdorfer C, Czaja SJ, Loewenstein DA, Rubert MP, Arguelles S, Like any economic evaluation, one must clearly state the Mitrani VB, Szapocznik J: The effect of a family therapy and tech- nology-based intervention on caregiver depression. Gerontol- assumptions which form the basis of the analysis. Our ogist 2003, 43(4):521-531. assumptions are based on two subject organisations 8. Beauchamp N, Irvine AB, Seeley J, Johnson B: Worksite-based which provide online counseling services. Caution must internet multimedia program for family caregivers of per- sons with dementia. Gerontologist 2005, 45(6):793-801. be applied in generalising these results to email-based 9. Grant JS, Elliott TR, Weaver M, Bartolucci AA, Giger JN: Telephone services which support other medical specialties. intervention with family caregivers of stroke survivors after rehabilitation. Stroke 2002, 33(8):2060-2065. 10. Marziali E, Donahue P: Caring for others: Internet video-confer- Conclusion encing group intervention for family caregivers of older The results show email-based services whose work volume adults with neurodegenerative disease. Gerontologist 2006, 46(3):398-403. is greater then 5216 emails consultations per year would 11. Caffery L, Crew-Wegner K, Reid W, Wootton R: Automatic mes- realise savings by developing their own purpose-written sage handling for a national counselling service. J Telemed Tel- email-based telemedicine application. As workload ecare 2004, 10 Suppl 1:18-21. 12. Drummond M, O'Brien B, Stoddart G, Torrance G: Methods for increases above 5216 consultations, the potential savings the economic evaluation of health care programmes. 2nd would become greater. Alternatively, if the workload is edition. Oxford , Oxford University Press; 2000. 13. Smith AC, Scuffham P, Wootton R: The costs and potential sav- less than 5216 consultations it would be cheaper to ings of a novel telepaediatric service in Queensland. BMC implement the service using the organisations existing Health Serv Res 2007, 7:35. email system. This analysis provides a useful economic 14. Bergmo TS: An economic analysis of teleconsultation in otorhinolaryngology. J Telemed Telecare 1997, 3(4):194-199. model which demonstrates the relationship between 15. Bergmo TS: An economic analysis of teleradiology versus a vis- workload and potential savings. The threshold is most iting radiologist service. J Telemed Telecare 1996, 2(3):136-142. 16. Fraser HS, Jazayeri D, Bannach L, Szolovits P, McGrath SJ: TeleMed- sensitive to changes in administrative staff salary. Change Mail: free software to facilitate telemedicine in developing to counselling staff salary has no effect on threshold. countries. Medinfo 2001, 10(Pt 1):815-819. Page 6 of 7 (page number not for citation purposes)
  • 7. BMC Health Services Research 2008, 8:107 http://www.biomedcentral.com/1472-6963/8/107 17. Bergmo TS, Kummervold PE, Gammon D, Dahl LB: Electronic patient-provider communication: will it offset office visits and telephone consultations in primary care? Int J Med Inform 2005, 74(9):705-710. 18. Brauchli K, O'Mahony D, Banach L, Oberholzer M: iPath - a Tele- medicine Platform to Support Health Providers in Low Resource Settings. Stud Health Technol Inform 2005, 114:11-17. Pre-publication history The pre-publication history for this paper can be accessed here: http://www.biomedcentral.com/1472-6963/8/107/pre pub Publish with Bio Med Central and every scientist can read your work free of charge "BioMed Central will be the most significant development for disseminating the results of biomedical researc h in our lifetime." Sir Paul Nurse, Cancer Research UK Your research papers will be: available free of charge to the entire biomedical community peer reviewed and published immediately upon acceptance cited in PubMed and archived on PubMed Central yours — you keep the copyright Submit your manuscript here: BioMedcentral http://www.biomedcentral.com/info/publishing_adv.asp Page 7 of 7 (page number not for citation purposes)