Se ha denunciado esta presentación.
Se está descargando tu SlideShare. ×

Get a clear vision of your current and future SAP Data Services

Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Cargando en…3
×

Eche un vistazo a continuación

1 de 41 Anuncio

Más Contenido Relacionado

Similares a Get a clear vision of your current and future SAP Data Services (20)

Más de Wiiisdom (20)

Anuncio

Más reciente (20)

Get a clear vision of your current and future SAP Data Services

  1. 1. Submit your questions anytime We will send you the recording Before We Begin www.wiiisdom.com
  2. 2. www.wiiisdom.com Agenda 1 2 3 Sneak Peek to the future: SAP Data Services SAP Data Services Governance Challenges and how to overcome them How SAP Ariba successfully centralized, documented and monitored ETL jobs and metadata
  3. 3. Public Public SAP Data Services & Information Steward Path Global COE January 2023
  4. 4. 5 Public The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP. Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related document, or to develop or release any functionality mentioned therein. This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross negligence. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions. Disclaimer
  5. 5. 6 Public 6 PUBLIC © 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ Analyze all your data to accelerate insights and transform the data you have into the answers you need ANALYTICS Data is the fuel propelling intelligent technologies forward – optimizing processes, and igniting innovation INTELLIGENT TECHNOLOGIES Integrate and extend applications – build new ways to access and interact with your data APP DEVELOPMENT AND INTEGRATION Capture, manage, and govern your data to drive better business outcomes DATABASE AND DATA MANAGEMENT Stratregic Vision SAP Business Technology Platform: The Platform for the Intelligent Enterprise Cloud Platform Enterprise Agreement SAP Analytics Cloud SAP Data Intelligence Cloud SAP HANA Cloud SAP Data Warehouse Cloud
  6. 6. 7 Public SAP Analytics Cloud Business Intelligence, planning and predictive analytics SAP Data Warehouse Cloud Self-service modeling, data democratization, end-to-end data warehouse SAP Data Intelligence Cloud SAP HANA Cloud Data Management (memory, disk, lake), federation and replication Augmented Analytics Business Intelligence Enterprise Planning Data & Business Layer Spaces Multi-model Engine Tiered Data Storage Data Catalog Orchestration Integration Data Flow Unified Data & Analytics powered by the SAP Business Technology Platform More agility in your data and analytics landscape
  7. 7. 8 Public SAP Data Warehouse Cloud Self-service modeling, data democratization, end-to-end data warehouse SAP Data Intelligence Cloud SAP Analytics Cloud Business Intelligence, planning and predictive analytics Augmented Analytics Business Intelligence Enterprise Planning Data & Business Layer Spaces SAP HANA Cloud Data Management (memory, disk, lake), federation and replication Multi-model Engine Tiered Data Storage Data Catalog Orchestration Integration Data Flow Data Management in the SAP Business Technology Platform
  8. 8. 9 Public We are committed to support our DS and IS customers in the long run First and foremost…
  9. 9. 10 Public SAP Data Management Evolution ❑ As we define the future of SAP Data Management portfolio, current on-premise SAP Data Services and SAP Information Steward customers can leverage all their existing investments and efforts while also extending the reach of their data management to the cloud, with SAP Data Intelligence ❑ In 2021 we added the hybrid data management capabilities that enables, existing SAP Data Services and SAP Information Steward setups for all native sources and workloads that are still relevant, for all the time they will still be in use, without requiring any rip and replace nor migration. Additionally, implement all new cloud hybrid, or big data-oriented workloads, including data streaming and data pipelining on SAP Data Intelligence, and seamlessly extending, and reusing existing DS and IS workloads. ❑ In 2022 we did a minor version upgrade of SAP Data Services and Information Steward to 4.3, allowing the compatibility with BusinessObjects 4.3. As a result, our support policy extended the end of mainstream maintenance timeline to end of 2025 and priority 1 support to end of 2027 for both SAP Data Services and SAP Information Steward. W ❑ With the mainstream maintenance of version 4.3 of SAP Data Services and SAP Information Steward suite ending in 2025, we do not want to leave our large customer base behind, and therefore we have decided to release an updated version, code named SAP Data Services 2024 and SAP Information Steward 2024 to provide more time to our on-premises customers to adopt our rapidly evolving, state-of-the-art cloud data integration scenarios.
  10. 10. 11 Public ❑ We are planning to release a new version of the SAP Data Services and SAP Information Steward in 2025 code named SAP Data Services 2024 and SAP Information Steward 2024 ❑ available on-premises and through managed cloud, ❑ Focused on the most widely adopted on-premise scenarios: SAP Data Services and SAP Information Steward for native ETL, Data Quality and Data Governance, ❑ Existing architecture and component map will be followed including Designer, repository, Job Server, supported web applications and BI module ❑ Compatible with proposed SAP BusinessObjects BI 2024 suite ❑ We will provide clear use case migration paths for the components for which we plan the end of support beyond 2027 ❑ Our intention is to only support Windows and Linux platforms ❑ No change is anticipated in the Hybrid Data Management capabilities with Data Intelligence cloud SAP Data Services 2024 and SAP Information Steward 2024
  11. 11. 12 Public Deployment Options Private Cloud Edition With SAP Data Services and SAP Information Steward, private cloud edition, we offer: ❑ A predefined package operated by SAP on the main cloud platform providers, including ❑ Software ❑ Support ❑ Technical managed services ❑ Infrastructure This is a great opportunity to shift from a maintenance contract to a subscription model while leveraging your existing investments in SAP Data Services and SAP Information Steward solutions. Key benefits: ❑ The latest version of SAP Data Services and SAP Information Steward is always available, thanks to yearly upgrades, ❑ 3-tier landscape: development/test, quality assurance and production by default, with optional additional tiers, ❑ Pre-configured hardware landscapes optimized for performance, ❑ Choice of cloud platform providers infrastructure includes AWS, Google Cloud Platform, Microsoft Azure, ❑ End-to-end SLA 99.7%, backup and restore included within standard service scope, ❑ In the future, customers will continue to have the choice for their infrastructure for SAP Data Services and SAP Information Steward solutions, either on-premises or in a managed cloud operated by SAP.
  12. 12. 13 Public Our commitment We know that many customers rely on SAP Data Services and SAP Information Steward solutions for critical use cases and will need to do so beyond 2025. Therefore, we are planning to release a new version in the first half of 2025, code named SAP Data Services 2024 and SAP Information Steward 2024, respectively, that will extend the maintenance timeline for on-premise use cases. Although it is a long time from now, but we have plans to extend the mainstream support through 2030 and priority 1 through 2032 As we did for the upgrade to version 4.3, we will make sure that the upgrade to the new release is as smooth as possible and will provide enough overlap so that each customer can upgrade at their own pace. This new release will be an opportunity for us to continue the modernization started in version 4.3 (user experience, latest 3rd party components versions, system library updates) and streamline the ETL, Data Quality and Data Governance to the core requirements of our active user base In the meantime, and as version 4.2 reaches end of mainstream maintenance at the end of May 2023 – followed by priority one support until end of December 2024 – we strongly recommend all customers to upgrade to version 4.3 to benefit from the latest features, up-to-date platforms, connectivity, and security standards.
  13. 13. 14 Public The following are planned to be removed from SAP Data Services 2024: ❑ AIX and Solaris operating systems ❑ Application layer connectivity of reduced market share applications ❑ Java based adapters for which we have already provided native connectivity Product Rationalization Strategy
  14. 14. 15 Public SoD Blog For more… Help us fine tune our roadmaps of SAP Data Services and SAP Information Steward by providing your input through the dedicated inboxes respectively: SAP Data Services: sap.dataservices@sap.com SAP Information Steward: sap.informationsteward.enhance@sap.com
  15. 15. 16 Public QUESTIONS?
  16. 16. 17 Public Thank you. Patrick Sims Global COE, BTP Customer Success, Data & Analytics patrick.sims@sap.com
  17. 17. www.wiiisdom.com/360suite/ The Problems BODS is a Black Box. => Complex to monitor, manage & maintain ● Limited access to metadata (No BI on ETL capabilities) ● Developer tool, not usually accessible to non technical people (managers/business) ● Offers only fixed (manually-generated PDF) documentation or interactive exploration ● Only shows the current state. Limited historical information ● No reporting capabilities ● Time-consuming and transitory analysis capabilities
  18. 18. www.wiiisdom.com/360suite/ The Challenges ● Inability to document what is going on ● Inability to document changes over time ● Inability to compare repositories ● Difficulty to locate performance bottlenecks ● Difficulty to find specific components (e.g.: contents of scripts, SQL transforms) ● Difficulty to understand impact of changes (e.g.: DB changes and DS affected) ● Inability to provide a holistic view of what is going on
  19. 19. www.wiiisdom.com/360suite/ Impacts Visibility: No BI on ETL capabilities. Trust: Jobs, workflows, etc. Changes overtime and it is hard to determine where the problems are coming from TCO: More resources are needed to maintain the application performances: limited visibility on bottlenecks ● Disconnect with managers/business ● Distracting developers from their main job to provide information about performance/changes/contents ● Lack of proactive monitoring, trend analysis ● Ineffective use of human and system resources. Higher TCO What happens in Data Services stays in Data Services! (Until 360) DS developers are the only ones who have knowledge of what is going on within Data Services
  20. 20. www.wiiisdom.com/360suite/ Easily Aggregate And Centralize The Metadata Stored In SAP BOBJ & Data Services 360Eyes for SAP BusinessObjects extracts metadata from : BOBJ'CMS, Auditor and FileStore. 360Eyes Data Services extracts metadata such as: Query transforms, Data stores Projects, Workflows, Data Flows, Sources, targets, Query mapping, SQL Query, Job scheduling and performance
  21. 21. www.wiiisdom.com/360suite/ Explore SAP Data Services metadata
  22. 22. www.wiiisdom.com/360suite/ Our solutions for a better governance of SAP Data Services ● Documentation: Documenting the contents of their repositories (object catalogue). Name and description of jobs, workflows, dataflows, datastores, database tables, flat files, global variables ● Monitoring: Scheduling and job execution analysis ● Impact Analysis: Workflows/Dataflow contents and usage - where is table X used? ● Change Management: Tracking changes ● Usage: Identify workflows/dataflows not used, jobs with no projects
  23. 23. www.wiiisdom.com/360suite/ 360Eyes for SAP Data Services Solution Highlight: Documentation ● Documenting the contents of their repositories (object catalogue). ○ List of objects by category ○ List of scripts and their code ○ Checking naming conventions, identifying possible duplicates
  24. 24. www.wiiisdom.com/360suite/ 360Eyes for SAP Data Services Solution Highlight: Monitoring ● Scheduling and job execution analysis ○ Monitoring job performance (running times, success/failure) ○ Drill down to job execution details (specific workflow/dataflow/object)
  25. 25. www.wiiisdom.com/360suite/ 360Eyes for SAP Data Services Solution Highlight: Impact Analysis ● Workflows/Dataflow contents - where is table X used? (Report 103) ○ If table or data source updated/removed what’s going to break?
  26. 26. www.wiiisdom.com/360suite/ 360Eyes for SAP Data Services Solution Highlight: Change Management ● Tracking changes (Report 105) ○ Make sure that unexpected changes are captured ○ Compare before and after versions for (manual) rollback if needed ○ Compare across repositories ○ Particularly useful in multi-developer environments
  27. 27. www.wiiisdom.com/360suite/ 360Eyes for SAP Data Services Solution Highlight: Usage Analysis ● Identify workflows/dataflows not used, jobs with no projects (Report 100) ○ System maintenance, cleanup
  28. 28. www.wiiisdom.com/360suite/ 360Eyes for DS use cases Client: “Why would we need 360Eyes for Data Services?” ● Documentation: documenting the contents of their repositories (object catalogue). Name and description of jobs, workflows, dataflows, datastores, database tables, flat files, global variables (Report 100) ○ List of objects by category ○ List of scripts and their code ○ Enforcing naming conventions, identifying possible duplicates ● Monitoring: Scheduling and job execution analysis (Report 102) ○ Monitoring job performance (running times, success/failure) ○ Drill down to job execution details (specific workflow/dataflow/object) ● Impact Analysis: Workflows/Dataflow contents and usage - where is table X used? (Report 103) ○ If table or data source updated/removed what’s going to break?) ● Change Management: Tracking changes (Report 105) ○ Make sure that unexpected changes are captured ○ Compare before and after versions for (manual) rollback if needed ○ Compare across repositories ○ Particularly useful in multi-developer environments
  29. 29. www.wiiisdom.com/360suite/ 360Eyes for DS use cases Client: “Why would we need 360Eyes for Data Services?” ● Usage: Identify workflows/dataflows not used, jobs with no projects (Report 100) ○ System maintenance, cleanup ● Data lineage: Report 104?? - not really ○ Documenting how data moves and changes from source to target (excel example)
  30. 30. www.wiiisdom.com/360suite/ Key takeaways with 360Eyes for SAP Data Services ✅ Document Metadata: Jobs, workflows,... ✅ Compare changes over time ✅ Monitor jobs ✅ Share Job details with GRC team ✅ Faster and cheaper migrations ✅ Reduce DS Operating and Maintenance costs
  31. 31. www.wiiisdom.com ● BOBJ / BODS Administrator, part of “IT Application Business Intelligence” team since 2008. ● My team facilitate and support (IT backbone) the analytics platform that consists of SAP Business Objects for reporting, SAP Analytics cloud (SAC) & Lumira for Dashboarding and BODS for ETL (Extract / Transformation / Loading) to build Data marts. ● We use Business Objects since 2004/2005 from Business XI R2 era almost like two decades and BODS since 2012 almost a decade. ● We support Ariba’s various internal departments such as Product engineering, Customer Support Organization, Sales, Cloud Analytics team etc. Vasudevan Gnanasivam my role with SAP Ariba
  32. 32. www.wiiisdom.com ● SAP Ariba is e-Procurement company that provides supply chain / spend management cloud solutions for large and mid-size companies. ● Also, “Ariba Network”, now known as “SAP Business Network” is a dynamic, digital marketplace where millions of buyers and suppliers, from 190 countries, transact trillions of dollars in business commerce every year. ● Ariba became a part of SAP cloud commerce division since 2012. About SAP Ariba
  33. 33. www.wiiisdom.com BOBJ Platform: 4.3 SP2 Patch 3 ● Production install: 2 ● Backend DB: Hana 2.0 ● OS: Linux ● ~ 50K objects ● ~ 500 Schedules ● ~ 100+ Universes ● Lumira / SAC using LDC 360 Suites v2023.1 ● 360 Bind/Cast/Plus/Live/View ● 360 Eyes SAP BusinessObjects at SAP Ariba BODS: DS 4.3 / IPS 4.3 SP2 Patch 1 ● Production install: 3 ● Backend DB: SQL Server 2019 ● OS: Windows ● ~ Repositories: 7 ● ~ Jobs: 30+ running 24/7 ● ~ Projects: 20 ~Workflows: 600 ~Dataflows: 500 ● ~ Monthly processed rows: 15 billion 360 eyes for DS v2023.1
  34. 34. www.wiiisdom.com 1. Multiple BODS Installations across different platforms makes it difficult to centralize metadata into single location 2. Monitoring Job executions status periodically 3. Documenting everchanging Workflow/Dataflow is a nightmare SAP Ariba - Challenges with Data Services
  35. 35. www.wiiisdom.com BEFORE Cons ● Time Consuming ● Special Skills / Knowledge ● Not real time ● Error prone SAP Ariba Challenges - Centralization AFTER Pros ● Daily extraction of metadata ● Consolidated into one centralized Database ● No Special Skills / Knowledge ● Almost real time ● Reliable metrics ● Fully automated process
  36. 36. www.wiiisdom.com ● Provide on demand KPI to Business of Data Services job details ● Monitor Job execution statu ● Monitor Running time ● Monitor Data volume ● Track and provide insights on Performance issues Before ● Manual time consuming work to provide KPI ● No insights on performance bottlenecks ● Passive monitoring After ● Check if jobs have picked-up ● Self-Service and on Demand KPI ● Proactive monitoring SAP Ariba Challenges - Monitoring
  37. 37. www.wiiisdom.com Documentation ● Data catalog: projects, jobs, workflows, dataflows, transforms, datastores, database tables, files ● Historical information Before ● No documentation capabilities ● Limited search capabilities After ● Impact analysis very useful in case of DB changes, name changes, etc? ● Document what is used or not used ● Ability to leverage 360Eyes DS universe and pre-canned and custom Webi reports to document DS ● Ability to compare snapshots over time and/or across repositories: ○ Track what has been added, modified & deleted ○ Regression ● Self-service capabilities to get insights from the metadata SAP Challenges
  38. 38. www.wiiisdom.com SAP Ariba use case
  39. 39. www.wiiisdom.com ✅ Ability to do BI on ETL ✅ Reduce Cost of ownership ✅ Increase visibility & availability ✅ Document and compare Metadata overtime Pro tip: Leverage BO and EyesDS to get timely and comprehensive information about your Data Services environment (e.g.: schedule job execution report to be distributed on failures) Key Takeaways

×