SlideShare a Scribd company logo
1 of 13
Download to read offline
Experts in numerical software and
High Performance Computing
Cloud Task Execution at Scale
with an example from Quant Finance
Microsoft SC18 Theater presentation
November 2018
John HOLDEN
Mick PONT
2High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
3High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
4High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
► Manage Distribution (CPU/GPU)
► Manage dependencies
► Manage synchronization
► Manage control
► Manage ad-hoc Grid (during Development)
► Manage Cloud(s) (during Testing / Production)
5High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Client
Client
Client
Server
Client-Server
Client
Client
Client
Client-Worker
worker
worker
worker
synchronisation
worker
worker
worker
Master
Master-Worker
6High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
7High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
8High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
• Origami supports DAGs
including: data transfers,
metrics, recovery from
task failure.
• Can run on dev
machines, in-house grid,
production cloud, CPU,
CPU / GPU – mixture.
9High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
10High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Description Elapsed Time
Single core ~ 14 hours
Origami / Grid / Azure Minutes
11High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
12High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Experts in High Performance Computing,
Algorithms and Numerical Software Engineering
www.nag.com | blog.nag.com | @NAGtalk
13High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Experts in High Performance Computing,
Algorithms and Numerical Software Engineering
www.nag.com | blog.nag.com | @NAGtalk

More Related Content

What's hot

Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Pim van der Noll
 
AllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayAllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayMIDIH_EU
 
IBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoIBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoAffecto
 
Streamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceStreamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceSoledad Galli
 
COMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesCOMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesComit Projects Ltd
 
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward
 
Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Danny Moloney (DBA IP), (PhD IP)
 
Grafixoft solutions
Grafixoft solutionsGrafixoft solutions
Grafixoft solutionsGrafixoft
 
2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CONKatsuhiro Honda
 
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and HotelStrusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and Hotelactint
 
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-Commerce Berlin EXPO
 
Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Innova Advanced Consulting
 
Intro to the Data Grid
Intro to the Data GridIntro to the Data Grid
Intro to the Data GridOutSystems
 

What's hot (17)

Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014
 
AllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayAllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_day
 
IBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoIBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demo
 
BIM Al Fouzan
BIM Al FouzanBIM Al Fouzan
BIM Al Fouzan
 
Streamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceStreamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open Source
 
COMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesCOMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slides
 
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
 
Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.
 
Grafixoft solutions
Grafixoft solutionsGrafixoft solutions
Grafixoft solutions
 
pCon - Empower your sales force
pCon - Empower your sales forcepCon - Empower your sales force
pCon - Empower your sales force
 
2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON
 
Programas softwares
Programas  softwares   Programas  softwares
Programas softwares
 
Data science @ scale
Data science @ scaleData science @ scale
Data science @ scale
 
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and HotelStrusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
 
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
 
Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020
 
Intro to the Data Grid
Intro to the Data GridIntro to the Data Grid
Intro to the Data Grid
 

Similar to Cloud Task Execution at Scale with example from quant finance

Introduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesIntroduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesAnjani Phuyal
 
Engage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarEngage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarKTN
 
Measuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & ValueMeasuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & Valueinside-BigData.com
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Bas Geerdink
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Dayscamunda services GmbH
 
Mindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryMindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryIIoTWorld
 
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingThe Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingKai Wähner
 
Apache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerApache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerconfluent
 
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Khai Tran
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudRaul Goycoolea Seoane
 
IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016LibreCon
 
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp
 
Pivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMPivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMconfluent
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION
 
ScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?Tom Paseka
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management ServicesNeev Technologies
 
How Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables GrowthHow Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables Growthndhsshare1
 

Similar to Cloud Task Execution at Scale with example from quant finance (20)

Introduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesIntroduction to Big Data using AWS Services
Introduction to Big Data using AWS Services
 
Engage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarEngage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution Webinar
 
Measuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & ValueMeasuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & Value
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Days
 
Mindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryMindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for Industry
 
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingThe Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
 
Apache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerApache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehner
 
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
 
IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016
 
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
 
Pivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMPivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORM
 
Interactive Image Processing Demos for the Web
Interactive Image Processing Demos for the WebInteractive Image Processing Demos for the Web
Interactive Image Processing Demos for the Web
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clients
 
ScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus DACH Expertise
ScaleFocus DACH Expertise
 
Resume
ResumeResume
Resume
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management Services
 
How Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables GrowthHow Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables Growth
 

More from John Holden

ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathJohn Holden
 
NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)John Holden
 
Wilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenWilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenJohn Holden
 
Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010John Holden
 
Monte Carlo G P U Jan2010
Monte  Carlo  G P U  Jan2010Monte  Carlo  G P U  Jan2010
Monte Carlo G P U Jan2010John Holden
 
N A G P A R I S280101
N A G P A R I S280101N A G P A R I S280101
N A G P A R I S280101John Holden
 

More from John Holden (6)

ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
 
NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)
 
Wilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenWilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John Holden
 
Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010
 
Monte Carlo G P U Jan2010
Monte  Carlo  G P U  Jan2010Monte  Carlo  G P U  Jan2010
Monte Carlo G P U Jan2010
 
N A G P A R I S280101
N A G P A R I S280101N A G P A R I S280101
N A G P A R I S280101
 

Recently uploaded

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 

Recently uploaded (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

Cloud Task Execution at Scale with example from quant finance

  • 1. Experts in numerical software and High Performance Computing Cloud Task Execution at Scale with an example from Quant Finance Microsoft SC18 Theater presentation November 2018 John HOLDEN Mick PONT
  • 2. 2High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 3. 3High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 4. 4High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com ► Manage Distribution (CPU/GPU) ► Manage dependencies ► Manage synchronization ► Manage control ► Manage ad-hoc Grid (during Development) ► Manage Cloud(s) (during Testing / Production)
  • 5. 5High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Client Client Client Server Client-Server Client Client Client Client-Worker worker worker worker synchronisation worker worker worker Master Master-Worker
  • 6. 6High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 7. 7High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 8. 8High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com • Origami supports DAGs including: data transfers, metrics, recovery from task failure. • Can run on dev machines, in-house grid, production cloud, CPU, CPU / GPU – mixture.
  • 9. 9High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 10. 10High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Description Elapsed Time Single core ~ 14 hours Origami / Grid / Azure Minutes
  • 11. 11High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 12. 12High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk
  • 13. 13High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk