1. Design Science Evaluation for
Enterprise Architecture Business
Value Assessments
Martin Meyer, Markus Helfert
BSC 2013
Riga

2. Agenda
• Motivation and Research Question
• Enterprise Architecture Business Value
Assessments
• Design Science Research (DSR)
– Focus on Evaluation
– MAID
• Further Research
• Summary and Conclusion
• Discussion
2
© Business Informatics Group 2013

3. Motivation and Research
Question
• Enterprise Architecture Business Value
(EABV) not entirely understood
• EABV assessment methods need to be
evaluated
• Design Science Research (DSR)
evaluation methods not detailed
enough
 How can we best evaluate an EABV
assessment approach in a DSR context?
3
© Business Informatics Group 2013

4. EABV Assessments - Overview
4
© Business Informatics Group 2013

5. DSR – IS Research
Framework
Adapted from Hevner et al. (2004)
5
© Business Informatics Group 2013

6. DSR – Research Process –
Artifact Build Cycle
6
© Business Informatics Group 2013

7. DSR – Evaluation Phase
• Evaluation
– Demonstrate
Artifact
Preliminary
Results
– Evaluate Artifact
Evaluation
Report
7
© Business Informatics Group 2013

8. EABV Assessment - Artifacts
• IT Artifacts to solve problems and
satisfy business needs
– EABV Assessment Method (EABV AM)
• EABV Framework (EABV FW)
• EA Balanced Scorecard (EA BSC) (based on
Kaplan et al. 1996)
• EABV Measurement Process (EABV MP)
(based on ISO/IEC 2007)
• EABV Model (EABV M)
8
© Business Informatics Group 2013

9. Measurement And
Infrastructure Diagnostic
(MAID)
• Categories for Criteria
– M & A planning
– Data collection and storage
– Data analysis
– M & A reporting
9
© Business Informatics Group 2013

10. MAID – Example Criteria
10
© Business Informatics Group 2013

11. Future Research – Case Study
• Continue evaluation in organizational
context
– Over several periods
– Facilitate benchmarking capabilities
• Evolve artifacts
– Improve integration, and thereby automation
– Adapt to changing business function
– Artifact versioning
11
© Business Informatics Group 2013

12. Summary and Conclusion
• Provided a flexible research process cycle
–
–
–
–
Clear defined phases, sub phases, and deliverables
Clear roles and responsibilities
Foundation for artifact evolvement
Suitable method for DSR evaluation
• Huge benefit for project management and
collaboration
– Flexible adaption to changing environment
– Phases allow for milestones including deliverables
– Easier to collaborate due to common understanding of
research process
– Adequate evaluation method for application in
organizational context
12
© Business Informatics Group 2013

13. Discussion
13
© Business Informatics Group 2013