SlideShare a Scribd company logo
1 of 42
Download to read offline
Copyright © 2012, SAS Institute Inc. All rights reserved.
ADVANCED VISUALISATION ON MAINFRAME
RMF AND SMF DATA
(APPLYING BIG DATA SOLUTIONS TO IT SYSTEM UTILISATION DATA)
ANDREW GADSBY, MAINFRAME BUSINESS DEVELOPMENT
andrew.gadsby@sas.com
MIKE WROOT, MAINFRAME TECHNICAL SPECIALIST
michael.wroot@sas.com
Copyright © 2012, SAS Institute Inc. All rights reserved.
ABSTRACT ANDREW GADSBY and MIKE WROOT
Title:
Advanced Visualisation and Analytics on Mainframe RMF and SMF Data
(Applying Big Data techniques to IT system utilisation data)
Abstract:
Much has been written about applying analytics to Big Data problems and how advanced visualisation techniques allow
businesses to create new value from Big Data. At SAS we are seeing many customer facing organisations make
extensive use of new visualisation techniques to derive significant business value from the mass of data available to
them.
IT also suffers from its own Big Data problem with the 4 V’s (volume, velocity, variety and variability) applying to IT
systems performance and capacity data. We wondered if it would be possible to apply Big Data visualisation and
analytic techniques to mainframe RMF and SMF data. In particular, we wanted to understand if analysis in this way
could deliver value back into IT.
This session will present an overview of the approach we took to analyse and visualise this data, and illustrate some of
the value that could be derived from such analysis. We will also give a live demonstration of our solution.
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
ACKNOWLEDGEMENT FROM THE MAGIC CIRCLE….
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
“The Greatest Value Of A Picture
Is When It Forces Us To Notice
What We Never Expected To See.”
John W. Tukey, Exploratory Data Analysis 1977
Copyright © 2012, SAS Institute Inc. All rights reserved.
BUSINESS USERS
VIEW
VISUALISATION OF BIG DATA
• Visually Exploring Their Data Using Tablets
• User Self Service is Becoming the Norm
• Speed of Thought Investigation and Discovery
• Building Analytical Data Warehouses (ADW)
• Improved Decision Taking Across the Business
• Static Reports are No Longer Acceptable
Copyright © 2012, SAS Institute Inc. All rights reserved.
Central Entry Point Integration Role-Based Views
DELIVERPREPARE EXPLORE DESIGN
• SAS
®
Mobile BI - native
tablet applications
delivering interactive
reports
• Web and PDF
• Manage data
• Load and join data
• Create calculated
columns
• Perform ad-hoc data
exploration
• Insights generated
through analytic
visualizations
• Create dashboard style
reports for web or
mobile
IN-MEMORY ANALYTICS ENGINE
SAS®
VISUAL
ANALYTICS
A SOLUTION FOR FASTER, SMARTER DECISIONS
www.sas.com/visualanalytics
Copyright © 2012, SAS Institute Inc. All rights reserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS
MEGACORP
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
HOW I.T. LOOKS AT
PERFORMANCE
DATA
VISUALISATION OF I.T. DATA
• Mainframe e.g. MXG, MICS using SMF and RMF data
• Distributed e.g. SAR, NMON…
• Static Reports - GIFs
• Export to Excel
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
LINKING
VISUALISATION TO
I.T. DATA
EXAMPLE HIGH-LEVEL ARCHITECTURE
SAS® VISUAL ANALYTICS ENVIRONMENT
Desktop
Web
Mobile
SAS VA CLIENTS
SMF/RMF
SAR
OpenView
AWR
Workspace Server
Mid-Tier
VA Server
Co-Located Data
Storage
Co-Located Data
Storage
Co-Located Data
Storage
SAS® LASR Analytic
Server
LASR Cluster
Copyright © 2012, SAS Institute Inc. All rights reserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS FOR I.T.
MEGACORP I.T.
Copyright © 2012, SAS Institute Inc. All rights reserved.
OBSERVATIONS &
CONCLUSIONS
VISUALISATION OF I.T. DATA
• Loading and Visualisation of the underlying data was the easy bit
• Understanding what the data means is critical
• Just because you can view things a certain way doesn’t mean it makes sense!
• Good news here as a capacity planning expert you will still keep your job
• Correlation is hard
• Drill down from CPU utilisation at point of time to recreate workload/job step view
is difficult
• Resolving this needs effort at data preparation / load time
• Changes way that capacity planning and forecasting is approached
• Could drive significant reduction in static report production on mainframe (CPU saving ? )
• We are Continuing Development of this Technology and Use Case
Copyright © 2012, SAS Institute Inc. All rights reserved.
QUESTIONS?
THANK YOU

More Related Content

What's hot

Data Science in Enterprise
Data Science in EnterpriseData Science in Enterprise
Data Science in EnterpriseJosh Yeh
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonJeffrey T. Pollock
 
DataOps: Nine steps to transform your data science impact Strata London May 18
DataOps: Nine steps to transform your data science impact  Strata London May 18DataOps: Nine steps to transform your data science impact  Strata London May 18
DataOps: Nine steps to transform your data science impact Strata London May 18Harvinder Atwal
 
Traditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonTraditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonCapgemini
 
The Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubThe Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubCloudera, Inc.
 
Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014Marty Loughlin
 
Best Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyBest Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyWhereScape
 
Unlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and ClouderaUnlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and ClouderaCloudera, Inc.
 
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike FergusonMapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike FergusonMapR Technologies
 
Enterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over EverythingEnterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over EverythingTeamQuest Corporation
 
Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)Cloudera, Inc.
 
IBM Industry Models and Data Lake
IBM Industry Models and Data Lake IBM Industry Models and Data Lake
IBM Industry Models and Data Lake Pat O'Sullivan
 
Hadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata CompanyHadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata CompanyDataWorks Summit
 
GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017Jeremy Maranitch
 
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQLDataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQLDataStax
 
Data-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile DevelopmentData-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile DevelopmentDATAVERSITY
 
IBM Governed Data Lake
IBM Governed Data LakeIBM Governed Data Lake
IBM Governed Data LakeKaran Sachdeva
 
Informatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake EcosystemInformatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake EcosystemCapgemini
 

What's hot (20)

Data Science in Enterprise
Data Science in EnterpriseData Science in Enterprise
Data Science in Enterprise
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lon
 
DataOps: Nine steps to transform your data science impact Strata London May 18
DataOps: Nine steps to transform your data science impact  Strata London May 18DataOps: Nine steps to transform your data science impact  Strata London May 18
DataOps: Nine steps to transform your data science impact Strata London May 18
 
Traditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonTraditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A Comparison
 
The Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubThe Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data Hub
 
Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014
 
Best Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyBest Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse Quickly
 
Visual Analytics
Visual AnalyticsVisual Analytics
Visual Analytics
 
Unlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and ClouderaUnlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and Cloudera
 
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike FergusonMapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
 
Enterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over EverythingEnterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over Everything
 
Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)
 
IBM Industry Models and Data Lake
IBM Industry Models and Data Lake IBM Industry Models and Data Lake
IBM Industry Models and Data Lake
 
How Businesses use Big Data to Impact the Bottom Line
How Businesses use Big Data to Impact the Bottom LineHow Businesses use Big Data to Impact the Bottom Line
How Businesses use Big Data to Impact the Bottom Line
 
Hadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata CompanyHadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata Company
 
GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017
 
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQLDataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
 
Data-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile DevelopmentData-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile Development
 
IBM Governed Data Lake
IBM Governed Data LakeIBM Governed Data Lake
IBM Governed Data Lake
 
Informatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake EcosystemInformatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake Ecosystem
 

Similar to Visualisation and forecasting on IT capacity planning data

High Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is HereHigh Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is HereSAS Institute India Pvt. Ltd
 
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...Enterprise Management Associates
 
Big Data Analytics in Government
Big Data Analytics in GovernmentBig Data Analytics in Government
Big Data Analytics in GovernmentDeepak Ramanathan
 
Create your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouseCreate your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouseJeff Kelly
 
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...Denodo
 
Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.Denodo
 
SAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázkaSAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázkaMarketingArrowECS_CZ
 
Unleashing the Power of your Data
Unleashing the Power of your DataUnleashing the Power of your Data
Unleashing the Power of your DataItai Yaffe
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsightsWilfried Hoge
 
Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Senturus
 
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...Enterprise Management Associates
 
Four Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyFour Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyArcadia Data
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationDenodo
 
BAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneyBAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneySai Paravastu
 
Is your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and ClouderaIs your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and ClouderaCloudera, Inc.
 
Introduction to SAS Forecasting
Introduction to SAS ForecastingIntroduction to SAS Forecasting
Introduction to SAS ForecastingSAS Canada
 
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...Enterprise Management Associates
 
How to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategyHow to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategyRedpath Consulting Group
 

Similar to Visualisation and forecasting on IT capacity planning data (20)

High Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is HereHigh Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is Here
 
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
 
Big Data Analytics in Government
Big Data Analytics in GovernmentBig Data Analytics in Government
Big Data Analytics in Government
 
resume
resumeresume
resume
 
Create your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouseCreate your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouse
 
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
 
Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.
 
SAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázkaSAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázka
 
Unleashing the Power of your Data
Unleashing the Power of your DataUnleashing the Power of your Data
Unleashing the Power of your Data
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsights
 
Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users
 
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
 
Four Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyFour Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics Strategy
 
Business Visualization: Dashboard & Storyboarding
Business Visualization: Dashboard & StoryboardingBusiness Visualization: Dashboard & Storyboarding
Business Visualization: Dashboard & Storyboarding
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
 
BAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneyBAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, Sydney
 
Is your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and ClouderaIs your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and Cloudera
 
Introduction to SAS Forecasting
Introduction to SAS ForecastingIntroduction to SAS Forecasting
Introduction to SAS Forecasting
 
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
 
How to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategyHow to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategy
 

Recently uploaded

Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 

Recently uploaded (20)

Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 

Visualisation and forecasting on IT capacity planning data

  • 1. Copyright © 2012, SAS Institute Inc. All rights reserved. ADVANCED VISUALISATION ON MAINFRAME RMF AND SMF DATA (APPLYING BIG DATA SOLUTIONS TO IT SYSTEM UTILISATION DATA) ANDREW GADSBY, MAINFRAME BUSINESS DEVELOPMENT andrew.gadsby@sas.com MIKE WROOT, MAINFRAME TECHNICAL SPECIALIST michael.wroot@sas.com
  • 2. Copyright © 2012, SAS Institute Inc. All rights reserved. ABSTRACT ANDREW GADSBY and MIKE WROOT Title: Advanced Visualisation and Analytics on Mainframe RMF and SMF Data (Applying Big Data techniques to IT system utilisation data) Abstract: Much has been written about applying analytics to Big Data problems and how advanced visualisation techniques allow businesses to create new value from Big Data. At SAS we are seeing many customer facing organisations make extensive use of new visualisation techniques to derive significant business value from the mass of data available to them. IT also suffers from its own Big Data problem with the 4 V’s (volume, velocity, variety and variability) applying to IT systems performance and capacity data. We wondered if it would be possible to apply Big Data visualisation and analytic techniques to mainframe RMF and SMF data. In particular, we wanted to understand if analysis in this way could deliver value back into IT. This session will present an overview of the approach we took to analyse and visualise this data, and illustrate some of the value that could be derived from such analysis. We will also give a live demonstration of our solution.
  • 3. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 4. Copyright © 2012, SAS Institute Inc. All rights reserved. ACKNOWLEDGEMENT FROM THE MAGIC CIRCLE….
  • 5. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 6. Copyright © 2012, SAS Institute Inc. All rights reserved. “The Greatest Value Of A Picture Is When It Forces Us To Notice What We Never Expected To See.” John W. Tukey, Exploratory Data Analysis 1977
  • 7. Copyright © 2012, SAS Institute Inc. All rights reserved. BUSINESS USERS VIEW VISUALISATION OF BIG DATA • Visually Exploring Their Data Using Tablets • User Self Service is Becoming the Norm • Speed of Thought Investigation and Discovery • Building Analytical Data Warehouses (ADW) • Improved Decision Taking Across the Business • Static Reports are No Longer Acceptable
  • 8. Copyright © 2012, SAS Institute Inc. All rights reserved. Central Entry Point Integration Role-Based Views DELIVERPREPARE EXPLORE DESIGN • SAS ® Mobile BI - native tablet applications delivering interactive reports • Web and PDF • Manage data • Load and join data • Create calculated columns • Perform ad-hoc data exploration • Insights generated through analytic visualizations • Create dashboard style reports for web or mobile IN-MEMORY ANALYTICS ENGINE SAS® VISUAL ANALYTICS A SOLUTION FOR FASTER, SMARTER DECISIONS www.sas.com/visualanalytics
  • 9. Copyright © 2012, SAS Institute Inc. All rights reserved. DEMONSTRATION SAS® VISUAL ANALYTICS MEGACORP
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 21. Copyright © 2012, SAS Institute Inc. All rights reserved. HOW I.T. LOOKS AT PERFORMANCE DATA VISUALISATION OF I.T. DATA • Mainframe e.g. MXG, MICS using SMF and RMF data • Distributed e.g. SAR, NMON… • Static Reports - GIFs • Export to Excel
  • 22. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 23. Copyright © 2012, SAS Institute Inc. All rights reserved. LINKING VISUALISATION TO I.T. DATA EXAMPLE HIGH-LEVEL ARCHITECTURE SAS® VISUAL ANALYTICS ENVIRONMENT Desktop Web Mobile SAS VA CLIENTS SMF/RMF SAR OpenView AWR Workspace Server Mid-Tier VA Server Co-Located Data Storage Co-Located Data Storage Co-Located Data Storage SAS® LASR Analytic Server LASR Cluster
  • 24. Copyright © 2012, SAS Institute Inc. All rights reserved. DEMONSTRATION SAS® VISUAL ANALYTICS FOR I.T. MEGACORP I.T.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41. Copyright © 2012, SAS Institute Inc. All rights reserved. OBSERVATIONS & CONCLUSIONS VISUALISATION OF I.T. DATA • Loading and Visualisation of the underlying data was the easy bit • Understanding what the data means is critical • Just because you can view things a certain way doesn’t mean it makes sense! • Good news here as a capacity planning expert you will still keep your job • Correlation is hard • Drill down from CPU utilisation at point of time to recreate workload/job step view is difficult • Resolving this needs effort at data preparation / load time • Changes way that capacity planning and forecasting is approached • Could drive significant reduction in static report production on mainframe (CPU saving ? ) • We are Continuing Development of this Technology and Use Case
  • 42. Copyright © 2012, SAS Institute Inc. All rights reserved. QUESTIONS? THANK YOU