The TAUS Quality Dashboard is an industry-shared platform in which translation evaluation and productivity data is visualized in a flexible reporting environment. Users can create customized reports or filter data to be reflected in the charts. Both internal and external benchmarking is supported, offering the possibility to monitor one’s own development and to compare results to industry highs, lows and averages.
1. TAUS Presents:
The Quality Dashboard
Measuring and benchmarking quality, productivity and efficiency of
translation on an industry-shared platform
www.taus.net
2. What About Translation Quality
Old School: “One size fits all”
Since the 1980’s
LISA QA Model, SAE J2450 prescribe today’s quality processes:
1. Static:
• One quality fits all purposes, all content, all audiences
2. Subjective:
• Evaluations are often subjective and anecdotal
3. Costly:
• QE causes friction, delays
• QE can cost up to 25% of total translation costs
4. Non-transparent:
• Necessity without remedy
Dynamic
Quality
Framework
3. Industry Collaborative Program
DQF started in 2011
Adobe
Appen
Autodesk
AVB
CA Technologies
Cisco
Crestec
Crosslang
Dell
DFKI
eBay
EMC
Google
Hewlett Packard
Intel
LDS Church
Lingo24
This slide may not be used or copied without permission from TAUS
Participating members
Lionbridge
Medtronic
Microsoft
Moravia
Nikon
Oracle
Pactera
Pangeanic
Paypal
Philips
PTC
Siemens
Spil Games
Systran
VMware
Welocalize
Yahoo!
4. From DQF Tools to Quality Dashboard
DQF Tools
Since January 2014
Tools on TAUS web site:
to measure:
• Productivity
• Adequacy
• Fluency
to review and count:
• Translation errors
to get:
• Stats and reports
Used by 100+ members
Quality Dashboard
Launched June 2015
DQF integrated in:
• TRADOS Studio
• MateCat
• Memsource (planned)
• WorldServer (planned)
Use of DQF plug-in provides:
• Enhanced statistics
• Benchmarking
Open to everyone
7. The Power and Value of the Quality Dashboard
• DQF collects data and generates reports on the
Dashboard real-time
• Translators, managers, buyers, developers get their
own stats, benchmarks and analytics
• Not only track and benchmark against your own data,
but also against industry averages, between
translators, customers
Quality Evaluation Business Intelligence
8. i
>
August 31, 2015: 566,987,756 words have been measured
287
0
50
100
150
200
250
300
350
May-15
NumberofWordsperHour
Productivity
Across all languages, industries, technologies, processes,
content, translators
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
What is the average productivity?
9. i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
0
50
100
150
200
250
300
350
400
450
MT+PE TM+Human
Productivity
What is the average productivity of MT vs. TM?
10. i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
287
345
0
50
100
150
200
250
300
350
400
Industry Average My Productivity
NumberofWordsperHour
My Productivity Compared to Industry
Average
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
What is my productivity compared to industry?
11. i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
20%
40%
20%
15%
5%
My Distribution of segments
TM + Human TM + MT + Human + PE MT + PE TM only MT only
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
Where do my translations come from?
12. i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
0%
20%
40%
60%
80%
100%
120%
Me Industry Average
My Distribution of Segments Compared
to Industry
TM+Human TM+MT+Human+PE MT+PE TM only MT only
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
Where do my translations come from vs. industry?
13. i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
0
50
100
150
200
250
300
350
400
Project A Project B Project C Project D
Numberofwordsperhour
Projects
Productivity by Language by Project
FR
DE
ZH
KO
NL
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
Language
Time
Technology
Process
Content
Industry
Translator/vendor
Customer
Distribution of
segments
Language
Time
Content
Industry
Project
What is my productivity by language and by project?
14. Benefits of the Quality Dashboard
DQF elevates the discussion about quality to an industry level.
The resulting benefits are:
1. Sharing knowledge and standard references
2. Increased credibility
3. Lower cost
4. Increased satisfaction
5. Increased flexibility
15. What’s next?
Find out more on the TAUS web site:
Download the Quality Dashboard description
Find the API specifications and integrate your translation tool
16. This slide may not be used or copied without permission from TAUS
Notas del editor
TAUS presents the Quality Dashboard.... This does not just fall from the sky. We have been working on this for five years already, but.
What happened?
First let’s go back to see how it started.
Most of us (depending on your age) have grown up with a static view of translation or language quality…. We count errors like punctuation mistakes, spelling errors, wrong terms, grammar mistakes, etc. Based on the number of errors, we give it a pass or a fail. Great … doing this we all fee like school masters. But is it really the only way to assess translation quality?
In sessions with TAUS members – in 2011 – we learned that this model is problematic. It’s static, subjective, costly and non-transparent. The case was made for a more dynamic approach.
DQF started in 2011. with and for the TAUS members. This foundational report (Nov. 2011) lists all the reasons and theories, recommendations and proposals for a new approach, new methods, best practices.
Ingredients: content profiling, seven methods for evaluation
TAUS developed a knowledge base, metrics, templates, etc. We organized QE Summits, set up a User Group and ran consultation sessions for best practices. Our members asked us also to develop the tools and make them available through our web site.
Tools were designed to run evaluations only….. From time-to-time… but users asked us if they could use it as part of translation production every day. They asked if we could make an API available so that they could use the DQF tools from within their existing translation tool environment.