At the heart of this DataBench webinar is the goal to share a benchmarking process helping European organisations developing Big Data Technologies to reach for excellence and constantly improve their performance, by measuring their technology development activity against parameters of high business relevance. The webinar aims to provide the audience with a framework and tools to assess the performance and impact of Big Data and AI technologies, by providing real insights coming from DataBench. In addition, representatives from other projects part of the BDV PPP such as DeepHealth and They-Buy-for-You will participate to share the challenges and opportunities they have identified on the use of Big Data, Analytics, AI. The perspective of other projects that also have looked into benchmarking, such as Track&Now and I-BiDaaS will be introduced.

1. DataBench Toolbox
Tomas Pariente Lobo
(Atos)
Virtual BenchLearning
July 8th 2020
08/07/2020 DataBench Project - GA Nr 780966 1

2. DataBench Toolbox
DataBench Project - GA Nr 780966 2
The DataBench Toolbox is a one-stop-shop for Big
Data Benchmarking offering multiple benefits for
different kind of users and businesses
• Reach a larger audience
• Being able to automate their deployment
Benchmark
Providers
• One-stop shop to find benchmarking tools
• Possibility of deploying benchmarks
Technical Users
• Finding interesting knowledge about BD tools and benchmarks
• Getting extra hints on metrics and info from their sectors/use cases
Business Users
• End users of both types: Technical and Business
• Our main target for testing within the project lifetime
PPP Projects

3. A “box of tools”
• The Toolbox gives access to most DataBench results
• Catalogue of Technical Benchmarks
• Business performance benchmarks
• By Industry
• By Use Cases
• Knowledge base (Nuggets)
• Self-assessment tool
• Project Handbook
• Shortcuts to knowledge
• User journeys for different users
• Architectural Blueprints
• FAQs
3
Toolbox
Technical
Benchmarks
Use cases
Industries
Handbook
Self-
assessment
WP1
WP4 WP2
WP3

4. From searching benchmarks/knowledge
to running experiments
4
• HiBench
• SparkBench
• YCSB
• TPCx-IoT
• Yahoo Streaming Benchmark
• BigBench V2
• TPC-H
• TPC-DS
• Hadoop Workload Examples
• PigMix
• Social Network Benchmark
• WatDiv
• Sanzu
• BigDataBench
• AIBench
• Edge AI Bench
• HPC AI500
• ...
Searchable benchmarks
• HiBench
• YCSB
• Yahoo! Streaming
• …
Runnable benchmarks
• Business KPIS
• Quantitative / Qualitative
benchmarks per industry and
use case
• Star performers
• Business features matrix
• Technical benchmarks matrix
• Architectural blueprints per
industry/use case
• Benchmarking communities
• …
Knowledge Nuggets

5. Demo time
5

6. Next Steps
DataBench Project - GA Nr 780966 6
From June to Dec . 2020
Experiments (PPP projects…)
More Content
http://databench.ijs.si/

7. tomas.parientelobo@atos.net
ricardo.ruizsaiz@atos.net
ivan.martinez@atos.net
Evidence Based Big Data Benchmarking to
Improve Business Performance