Your team is always under pressure to accelerate the adoption of the most modern and powerful technologies. Simultaneously, your existing investments, such as IBM i, your organization’s most critical data asset, remain in a silo. The only practical path forward is to connect the new and existing with a streaming technology like Apache Kafka to feed real-time applications that power use cases ranging from marketing and order replenishment to fraud detection.
Join this Precisely webinar to learn how to unlock the potential of your IBM i data by creating data pipelines that integrate, transform, and deliver it to users when and where they need it. Additionally, hear how Stark Denmark, uses Precisely Connect CDC to provide data to their organization in real-time.
Join this webinar to:
- Understand the benefits and challenges of building data pipelines that access and integrate data from IBM i systems to modern data platforms
- Learn how Precisely can help you build real-time data pipelines
- Hear from Stark Denmark on how they are using Connect CDC from Precisely and the benefits they are getting
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Streaming IBM i to Kafka for Next-Gen Use Cases
1. Streaming IBM i to
Kafka for Next-Gen
Use Cases
Aisan Baird - Senior Director, Sales Engineering, Precisely
Angelo Agatino Nicolosi - Information Technology
Consultant, YanchWare
2. Agenda
• Introduction to Precisely
• Integrating with Next Gen Platforms
• Connect Overview
• Connect Capabilities
• Building a Data Pipeline
• Stark Customer Story
3. So what do you want to do with your data?
Centralized BI and
analytics
Data discovery Lower costs
associated with
legacy systems
Next-gen projects
– AI and ML
5. The global leader in data integrity
Trust your data. Build your possibilities.
Our data integrity software and data enrichment products
deliver accuracy and consistency to power confident
business decisions.
Brands you trust, trust us
Data leaders partner with us
of the Fortune 100
90
Customers in more than
100
2,000
employees
customers
12,000
countries
“Precisely is able to understand and
engage with enterprise customers where
they are, and assist them in their journey
to where they want to be, which sets this
company apart from its competition.”
Stewart Bond & Carl Olofson
IDC
6. Connect today’s
infrastructure with
tomorrow’s technology
to unlock the potential of
all your enterprise data
Integrate
Understand your data and
ensure it is accurate,
consistent and complete
for confident
business decisions
Verify
Analyze location data for
enhanced and
actionable business
insights that drive
superior outcomes
Locate
Power enhanced decision
making with expertly
curated, up-to-date
business, location, and
consumer data
Enrich
Precisely: four elements of data integrity
D A T A I N T E G R I T Y
7. What does
next-gen look
like for
integration?
Real-time data
streaming across
the business
Containerization
for hybrid and
multi-cloud
deployments
The requirements
Rapid adoption
of new targets
into DI
Expanding data
reach with cloud
data warehousing
8. Moving into next-gen
targets presents data
integration challenges
Identifying and integrating the
right data
Capturing changes in real-time
Lack of skills for integrating data
sources
Scaling with next-generation
initiatives
10. Connecting today’s infrastructure with tomorrow’s technology to
unlock the potential of all your enterprise data.
Extract, Transform, Load Data Replication via CDC
High-performance ETL for Apache
Spark, Cloud, Windows, Linux, Unix and
Hadoop MapReduce
Real-time database replication to
streaming platforms, Cloud, databases
and data warehouses
Connect
11. Connect is the best
solution for accessing
and integrating
mainframe and IBM i
data with cloud
frameworks in real time.
Quickly and efficiently integrate
ALL enterprise data – including
mainframe and IBM i
Design-once, deploy anywhere
approach to sources and targets
in real time
Reduce costs and development
time – from weeks to days
Secure and governed +
unrivaled scalability and
performance
13. Top Use Cases
DB to DB Replication
Reporting
BI/ETL Integration
Much more!
Migration
Geographical, OS Vendor, DB
Vendor, Product Version
Modernization
Streaming Platforms (Kafka,
Kinesis), Cloud DWs, DBs,
Application Vendor
14. Change Data Capture (CDC), At a glance,
Keep data in sync in real-time
• Without overloading networks.
• Without affecting source database
performance.
• Without coding or tuning.
Reliable transfer of data you can trust even if
connectivity fails on either side.
• Auto restart.
• No data loss.
Broad Source and Target Support
• Mainframe, IBM i – Db2, VSAM, …
• Streams – Kafka, Amazon Kinesis, …
• Relational databases – Oracle, SQL Server, …
• Cloud – MS Azure SQL, S3, …
• OLAP databases – Teradata, …
• Hadoop / Big Data – Hive, HDFS, Impala, …
15. Business Benefits with Connect CDC
Build Streaming Data Pipelines
• Powers business decision-making with real-time
data
Get a Consistent View
• Keep your business in sync and consistent
across the enterprise
Migrate Data
• Zero downtime for database/application
upgrades and system re-platforming
Keep Data Lakes fresh
• Ensure real-time updates on transactional systems,
including IBM i, are captured & replicate
Enable Timely Reporting
• Confidently satisfy every demanding SLAs
.
Resilient Data Delivery
• Support data governance and security requirements
16. Flexible Replication Options
One Way Two Way
Cascade
Bi-Directional
Distribute
Consolidate
Choose a topology
or combine them
to meet your data
sharing needs
17. RDBMS
EDWs
Data Streams
Sources
Sybase
Strategic Projects:
Real-time analytics, AI
and machine learning
Targets
Connect CDC is
cloud platform
enabled for
Ingest and Stream
RDBMS
Mainframe
Connect CDC
IMS
IBM i
Oracle Informix SQL Server
Other
Db2 (IBM i,
z, LUW)
SybaseOracle Informix PostgreSQL
MySQL
MS SQL Server
Flat Files
(delimited)
Db2 LUW
Db2 for IBM i
Db2 for z/OS
VSAM
Precisely Connect
18. Building a Modern Data Pipeline
Angelo Agatino Nicolosi | YanchWare
Streaming IBM i Data to Kafka
@
36. YanchWare
E : aan@yanchware.com
W: https://yanchware.com
Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Proof of Concept
Vendors Selection
Architecture
Internal Sales Portal - Pilot