SlideShare una empresa de Scribd logo
1 de 43
Descargar para leer sin conexión
© 2019 IDERA, Inc. All rights reserved.
MANAGING COMPLEX DATA ENVIRONMENTS
Lisa Waugh, Senior Product Manager, Aqua Data Studio
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 2
COMPANIES ARE STRIVING TO STORE AND MANAGE
MORE AND MORE DATA
▪ It is rare to have a company that uses a single platform anymore, so
companies and IT teams must adapt
▪ The days of different disciplines for different roles are gone
▪ Multiple disciplines must work together
▪ The lack of the appropriate skill sets can slow the process down
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 3
CLOUD EXAMPLE OF INFRASTRUCTURE
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 44
HYBRID INFRASTRUCTURE EXAMPLE
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 5
CONSIDERATIONS FOR THE DATABASE
▪ Scalability
• SQL
• Users have to scale a relational database on powerful servers.
• The data has to be distributed, handling tables across different servers.
• NoSQL
• Automatically spreads your data onto multiple servers.
• Servers can be added or removed from the data layer.
▪ Complexity
• SQL
• The design of the data needs to fit into tables.
• The database structure can be complex and again, difficult to handle in large
volumes.
• NoSQL
• Automatically spreads your data onto multiple servers without requiring a defined
structure.
• Can cache data in system memory, therefore making it faster to retrieve. This is in
contrast to SQL databases where this has to be done using a separate
infrastructure.
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 6
RELATIONAL VS NOSQL PLATFORMS
▪ Relational databases like MySQL, PostgreSQL, and SQLite represent
and store data in tables and rows. They're based on a branch of algebraic
set theory known as relational algebra.
▪ Meanwhile, non-relational (NoSQL) databases like MongoDB represent
data in collections of JSON documents.
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 7
DISTRIBUTIONS - THAT INTEGRATE WITH HADOOP
▪ Apache Hive is a data warehouse software project build on top of Apache
Hadoop for providing data query and analysis.
▪ Hive gives a SQL like interface to query data stored in a various databases and
file systems that integrate with Hadoop with different distributions to add to the
complexity.
▪ Aqua Data Studio includes Hive, Impala, Spark connectors within these
distributions:
• Amazon EMR
• Apache
• Cloudera
• Hortonworks
• MapR
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 8
COMPLEXITY OF NOSQL AND DISTRIBUTIONS
Clients Hive Services Hive Storage and Compute
Impala JDBC
Spark JDBC
Hive JDBC
Impala Server
Spark Server
Hive Server
Meta Store
File System
Job Client
Hive
Meta Data
Store
Base
Hadoop
Cluster
Apache Hive Architecture
Driver
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 9
THERE ARE 8 BUSINESS PROCESSES
1. Determine how a hybrid strategy fits the requirements of the business.
2. Consider the implications of data governance
3. Enhance business continuity.
4. Don’t outsource security.
5. Ensure the flexibility of data movement.
6. Embrace the range of tools.
7. Expand the scope of service-level agreements.
8. Prepare for new skill sets.
Download the PDF: 8 Rules for Managing Hybrid Cloud Environments by Database Trends
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 10
IN SOME OF THESE COMPLEX ENVIRONMENTS
THERE ARE NO MORE WELL-DEFINED ROLES
Interesting article on role of DBAs changing but NOT going away:
http://www.dbta.com/Editorial/Trends-and-Applications/How-DBAs-Can-Survive-and-Thrive-in-a-World-of-Agile-Development-129894.aspx
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 11
AQUA DATA STUDIO OVERVIEW
▪ Aqua Data Studio is a universal database IDE and visual analytics tool for
IT Professionals working with data and databases
▪ Aqua Data Studio allows you to develop and manage your databases, and
access, import, export, and visually analyze data
▪ Aqua Data Studio supports over 30 database platforms, and works on all
major operating systems (Windows, macOS, Linux)
▪ Aqua Data Studio supports Relational, NoSQL, and Cloud databases,
making your data easily and quickly accessible
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 12
30+ DATABASE PLATFORMS SUPPORTED
▪ Amazon Redshift
▪ Apache Cassandra
▪ Apache Derby
▪ Db2 iSeries
▪ Db2 LUW
▪ Db2 z/OS
▪ Excel
▪ Generic JDBC
▪ Generic ODBC
▪ Google BigQuery
▪ Greenplum
▪ Hive, Impala, and Spark connectors
within these distributions
• Amazon EMR, Cloudera,
HortonWorks, Impala, MapR
▪ Informix
▪ InterBase
▪ MariaDB
▪ Microsoft Azure SQL Database
▪ Microsoft SQL Server
▪ MongoDB
▪ MySQL
• Amazon Aurora MySQL
• Google SQL Cloud MySQL
▪ Netezza
▪ Oracle
▪ ParAccel
▪ PostgreSQL
• Amazon Aurora PostgreSQL
• Google SQL Cloud PostgreSQL
▪ SAP HANA
▪ Snowflake
▪ SQLite
▪ Sybase Anywhere
▪ Sybase ASE
▪ Sybase IQ
▪ Teradata Aster
▪ Teradata
▪ Vertica
▪ VoltDB
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 13
QUERIES, QUERIES, AND MORE QUERIES
▪ Different Kinds of Queries: There are a few differences between the two
dialects, including syntax, functions, data types
• Legacy i.e. Google BigQuery
- COUNT(DISTINCT x) returns an approximate count
• Standard
- It returns an exact count
▪ Single Query
▪ Multi-Database Instance Query
▪ Scripts – Multiple queries to be saved, scheduled, etc.
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 14
RELATIONAL VS NOSQL PLATFORMS
SQL Term/Concepts
database
table
row
column
index
table joins
primary key
NoSQL/MongoDB Terms/Concepts
database
collection
document of BSON (binary JSON) document
field
index
$lookup, embedded documents
primary key
Note: Specify a unique column or column combination as a primary
Key.
The primary key is automatically set to the _id field.
SQL to Aggregation Mapping Chart
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 15
LANGUAGES OF SQL EXAMPLES
▪ PL/SQL is a proprietary procedural language used by Oracle.
▪ TSQL is a proprietary procedural language used by Microsoft in SQL Server.
▪ PL/PGSQL is a procedural language used by PostgreSQL.
Again, syntax is different; see example PL/SQL,TSQL and PL/PGSQL typical syntax:
Create table in PL/SQL
▪ CREATE TABLE table_name ( column1 datatype [ NULL | NOT NULL ], column2 datatype [
NULL | NOT NULL ], ... column_n datatype [ NULL | NOT NULL ] );
Create table in TSQL
▪ CREATE TABLE [ database_name . [ schema_name ] . | schema_name . ] table_name ( {
<column_definition> } [ ,...n ] ) [ ; ]
Create table in PL/PGSQL
▪ CREATE TABLE table_name (
column_name TYPE column_constraint,
table_constraint table_constraint
) INHERITS existing_table_name;
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 16
AQUA DATA STUDIO PRIMARY FEATURES
▪ Register Servers/Databases
▪ Database Navigator/Explorer
▪ Query Analyzer (SQL/JSON Editor)
▪ Query Builder
▪ Table Data Editor
▪ Visual Analytics
▪ Import/Export Data and DDL
▪ Schema/Data/File Compare
▪ ER Modeler
▪ Database Administration
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 17
GET TO ALL THESE SERVERS WITH ONE INTERFACE
17
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 1818
AQUA DATA STUDIO SERVER REGISTRATION/PROPERTIES
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 1919
AQUA DATA STUDIO SERVER REGISTRATION/PROPERTIES CONT.
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 20
MY WORKSPACE - SERVERS, WORK AREA, FILES
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 21
OPTIONS ALLOWS FOR DIFFERENT SYNTAX CHANGES
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 22
OPTIONS ALLOW FOR DIFFERENT SYNTAX CHANGES
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 23
HOW DO WE QUERY THE DATA?
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 24
AUTOMATE COMMANDS IN THE QUERY ANALYZER
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 25
QUERY THE DATA WITH AQUA DATA STUDIO
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 26
RESULTS SET CLIENT STATS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 27
QUERY MONGODB WITH MONGOJS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 28
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 29
MULTI-SERVER QUERY – MEANING SAME VENDOR QUERY
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 30
SCRIPTS AND MORE SCRIPTS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 31
ENTITY RELATIONSHIP DIAGRAM
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 32
USING THE PROJECTS TAB IN AQUA DATA STUDIO
▪ Projects are comprised of AquaScripts, Server Connections, and User Files.
▪ They provide a self-contained programming unit that allows users to create a set of
AquaScripts that work on a specific set of database servers that you identify with the
ability to store and access configuration files.
▪ Once a project is completed, it may be exported and shared with other users.
See blog: Using Projects for Multi-Environments Scripting
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 33
WHAT APPEARS IN THE QUERY ANALYZER - TEMPLATE
▪ //*************************************************
******************
// Create and Email Excel File
//
// Creates an Excel file from a user-specified
SQL query and
// emails the Excel file to the specified
recipients.
//
// For more information about Aqua Open
API visit link:
http://docs.aquafold.com/ads/19.5/openapi/
//*************************************************
******************
//*************************************************
******************
// Input parameters.
//*************************************************
******************
var server ="Lisa SQL Server 2016";
var database = "Healthcare";
var schema = "dbo";
var sqlQuery = "select * from dbo.doctors";
var filePathtoStore = "C:/Users/Lisa
Waugh/build/create_and_email_excel_file.xl
s";
var toRecipient =
"Lisa_Waugh@company.net";
var from = "Lisa.Waugh@company.com";
var subject = "Test Excel email";
var message = "This is a test of the create
email Excel file in project";
▪ try {
var conn =
aqua.project.getServerConnection(server
);
conn.connect();
conn.changeDatabase(database);
if (schema !== null || schema != "") {
conn.changeSchema(schema);
}
var resultset =
conn.executeQuery(sqlQuery);
var sheet =
aqua.data.excelSpreadsheet(filePathtoSt
ore);
sheet.clear();
sheet.insert(resultset.columnStructure);
while (resultset.next()) {
sheet.insert(resultset.getRow())
}
sheet.save();
sendEmail();
conn.disconnect();
aqua.console.println("E-mail sent!");
}
catch(err) {
aqua.console.println(err.lineNumber +
": " + err);
}
▪ //*******************************************
************************
// This function is used to send the
email.
//*******************************************
************************
function sendEmail() {
/**
Use the default SMTP information
configured in Aqua Data Studio.
In Aqua Data Studio, go to File--
>Options-->Email to configure email
settings.
**/
var smtpServer =
aqua.mail.getDefaultSmtpServer();
var msg = aqua.mail.newMessage();
msg.addToRecipient(toRecipient);
msg.setFrom(from);
msg.setSubject(subject);
msg.setText(message);
msg.addFileAttachment(filePathtoStor
e);
smtpServer.sendMail(msg);
}
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 34
DIRECTORY STRUCTURE/PROJECT CREATED
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 35
SOURCE CONTROL: SVN, CVS, GIT, AND PERFORCE
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 36
TOOLS TO HELP MANAGE ALL THESE ENVIRONMENTS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 37
SYNCHRONIZE SCHEMA
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 38
THE BUSINESS ANALYTICS CHALLENGES SOLUTION
Support the citizen analyst’s data storytelling and intelligent
decisioning with a tool that addresses the key challenges:
Aqua Data Studio
▪ Broaden access to a wide variety of data sources
▪ Simplify query and analysis tasks
▪ Provide a robust palette of graphs and charts for effective visualizations
▪ Provide an environment for development, collaboration, and integration
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 39
BUSINESS INTELLIGENCE VS ANALYTICS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 40
BUSINESS ANALYTICS: HOW DO YOU TELL A STORY?
▪ Provide the datasheet as a package with the data and the worksheet, therefore, linking parameters
across different data sources
▪ Export as an image
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 41
VISUAL ANALYTICS
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 4242
SUMMARY
▪ Today’s database environments are often more complicated
• Not just a single type of data store
• Relational, NoSQL, cloud
▪ Database professionals must perform multiple tasks across them all
• Managing different platforms
• Running queries
• Creating data analytics
▪ Aqua Data Studio makes it easier
• 14-day free trial
• Learn more at aquafold.com
© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 43
THANKS!
Any questions?

Más contenido relacionado

La actualidad más candente

Information & Data Architecture
Information & Data ArchitectureInformation & Data Architecture
Information & Data ArchitectureSammer Qader
 
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...DATAVERSITY
 
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data ArchitectureADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data ArchitectureDATAVERSITY
 
Slides: Why You Need End-to-End Data Quality to Build Trust in Kafka
Slides: Why You Need End-to-End Data Quality to Build Trust in KafkaSlides: Why You Need End-to-End Data Quality to Build Trust in Kafka
Slides: Why You Need End-to-End Data Quality to Build Trust in KafkaDATAVERSITY
 
The Key to Big Data Modeling: Collaboration
The Key to Big Data Modeling: CollaborationThe Key to Big Data Modeling: Collaboration
The Key to Big Data Modeling: CollaborationEmbarcadero Technologies
 
Emerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big ThingEmerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big ThingDATAVERSITY
 
Data-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data ModelingData-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data ModelingDATAVERSITY
 
DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...DATAVERSITY
 
DAS Slides: Data Virtualization – Separating Myth from Reality
DAS Slides: Data Virtualization – Separating Myth from RealityDAS Slides: Data Virtualization – Separating Myth from Reality
DAS Slides: Data Virtualization – Separating Myth from RealityDATAVERSITY
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureDATAVERSITY
 
DataEd Slides: Leveraging Data Management Technologies
DataEd Slides: Leveraging Data Management TechnologiesDataEd Slides: Leveraging Data Management Technologies
DataEd Slides: Leveraging Data Management TechnologiesDATAVERSITY
 
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...DATAVERSITY
 
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesDATAVERSITY
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data GovernanceVladimiro Borsi
 
Five Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data GovernanceFive Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data GovernanceDATAVERSITY
 
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...DATAVERSITY
 
Building an Effective Data & Analytics Operating Model A Data Modernization G...
Building an Effective Data & Analytics Operating Model A Data Modernization G...Building an Effective Data & Analytics Operating Model A Data Modernization G...
Building an Effective Data & Analytics Operating Model A Data Modernization G...Mark Hewitt
 
Using Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-PurposeUsing Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-PurposeDATAVERSITY
 
DataEd Slides: Data Modeling is Fundamental
DataEd Slides:  Data Modeling is FundamentalDataEd Slides:  Data Modeling is Fundamental
DataEd Slides: Data Modeling is FundamentalDATAVERSITY
 

La actualidad más candente (20)

Information & Data Architecture
Information & Data ArchitectureInformation & Data Architecture
Information & Data Architecture
 
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
ADV Slides: The Data Needed to Evolve an Enterprise Artificial Intelligence S...
 
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data ArchitectureADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
 
Slides: Why You Need End-to-End Data Quality to Build Trust in Kafka
Slides: Why You Need End-to-End Data Quality to Build Trust in KafkaSlides: Why You Need End-to-End Data Quality to Build Trust in Kafka
Slides: Why You Need End-to-End Data Quality to Build Trust in Kafka
 
The Key to Big Data Modeling: Collaboration
The Key to Big Data Modeling: CollaborationThe Key to Big Data Modeling: Collaboration
The Key to Big Data Modeling: Collaboration
 
Emerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big ThingEmerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big Thing
 
Data-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data ModelingData-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data Modeling
 
DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...
 
DAS Slides: Data Virtualization – Separating Myth from Reality
DAS Slides: Data Virtualization – Separating Myth from RealityDAS Slides: Data Virtualization – Separating Myth from Reality
DAS Slides: Data Virtualization – Separating Myth from Reality
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
DataEd Slides: Leveraging Data Management Technologies
DataEd Slides: Leveraging Data Management TechnologiesDataEd Slides: Leveraging Data Management Technologies
DataEd Slides: Leveraging Data Management Technologies
 
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
 
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?
DAS Slides: Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & Approaches
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data Governance
 
Five Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data GovernanceFive Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data Governance
 
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
 
Building an Effective Data & Analytics Operating Model A Data Modernization G...
Building an Effective Data & Analytics Operating Model A Data Modernization G...Building an Effective Data & Analytics Operating Model A Data Modernization G...
Building an Effective Data & Analytics Operating Model A Data Modernization G...
 
Using Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-PurposeUsing Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-Purpose
 
DataEd Slides: Data Modeling is Fundamental
DataEd Slides:  Data Modeling is FundamentalDataEd Slides:  Data Modeling is Fundamental
DataEd Slides: Data Modeling is Fundamental
 

Similar a IDERA Slides: Managing Complex Data Environments

IDERA Live | Working with Complex Data Environments
IDERA Live | Working with Complex Data EnvironmentsIDERA Live | Working with Complex Data Environments
IDERA Live | Working with Complex Data EnvironmentsIDERA Software
 
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...IDERA Software
 
Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"EDB
 
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the Cloud
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the CloudIDERA Live | Monitor the Performance of Multiple-Platform Databases in the Cloud
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the CloudIDERA Software
 
Move InterBase Management to the Next Level with Aqua Data Studio
Move InterBase Management to the Next Level with Aqua Data StudioMove InterBase Management to the Next Level with Aqua Data Studio
Move InterBase Management to the Next Level with Aqua Data StudioIDERA Software
 
IDERA Live | Leverage the Query Store for Better SQL Server Performance
IDERA Live | Leverage the Query Store for Better SQL Server PerformanceIDERA Live | Leverage the Query Store for Better SQL Server Performance
IDERA Live | Leverage the Query Store for Better SQL Server PerformanceIDERA Software
 
Do you know where your databases are?
Do you know where your databases are?Do you know where your databases are?
Do you know where your databases are?DATAVERSITY
 
Unlocking Big Data Insights with MySQL
Unlocking Big Data Insights with MySQLUnlocking Big Data Insights with MySQL
Unlocking Big Data Insights with MySQLMatt Lord
 
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...Trivadis
 
IDERA Live | Decode your Organization's Data DNA
IDERA Live | Decode your Organization's Data DNAIDERA Live | Decode your Organization's Data DNA
IDERA Live | Decode your Organization's Data DNAIDERA Software
 
Demystifying Data Warehousing as a Service (GLOC 2019)
Demystifying Data Warehousing as a Service (GLOC 2019)Demystifying Data Warehousing as a Service (GLOC 2019)
Demystifying Data Warehousing as a Service (GLOC 2019)Kent Graziano
 
Chug building a data lake in azure with spark and databricks
Chug   building a data lake in azure with spark and databricksChug   building a data lake in azure with spark and databricks
Chug building a data lake in azure with spark and databricksBrandon Berlinrut
 
Webinar: DataStax Managed Cloud: focus on innovation, not administration
Webinar:  DataStax Managed Cloud: focus on innovation, not administrationWebinar:  DataStax Managed Cloud: focus on innovation, not administration
Webinar: DataStax Managed Cloud: focus on innovation, not administrationDataStax
 
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18Cloudera, Inc.
 
Demystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWDemystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWKent Graziano
 
#PCMVision: Oracle Hybrid Cloud Solutions
#PCMVision: Oracle Hybrid Cloud Solutions#PCMVision: Oracle Hybrid Cloud Solutions
#PCMVision: Oracle Hybrid Cloud SolutionsPCM
 
Data Architecture - The Foundation for Enterprise Architecture and Governance
Data Architecture - The Foundation for Enterprise Architecture and GovernanceData Architecture - The Foundation for Enterprise Architecture and Governance
Data Architecture - The Foundation for Enterprise Architecture and GovernanceDATAVERSITY
 
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...DataWorks Summit
 
New Enterprise Cloud Database Options for 2019
New Enterprise Cloud Database Options for 2019New Enterprise Cloud Database Options for 2019
New Enterprise Cloud Database Options for 2019EDB
 

Similar a IDERA Slides: Managing Complex Data Environments (20)

IDERA Live | Working with Complex Data Environments
IDERA Live | Working with Complex Data EnvironmentsIDERA Live | Working with Complex Data Environments
IDERA Live | Working with Complex Data Environments
 
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...
IDERA Live | Doing More with Less: Managing Multiple Database Roles and Platf...
 
Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"Postgres Integrates Effectively in the "Enterprise Sandbox"
Postgres Integrates Effectively in the "Enterprise Sandbox"
 
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the Cloud
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the CloudIDERA Live | Monitor the Performance of Multiple-Platform Databases in the Cloud
IDERA Live | Monitor the Performance of Multiple-Platform Databases in the Cloud
 
Move InterBase Management to the Next Level with Aqua Data Studio
Move InterBase Management to the Next Level with Aqua Data StudioMove InterBase Management to the Next Level with Aqua Data Studio
Move InterBase Management to the Next Level with Aqua Data Studio
 
IDERA Live | Leverage the Query Store for Better SQL Server Performance
IDERA Live | Leverage the Query Store for Better SQL Server PerformanceIDERA Live | Leverage the Query Store for Better SQL Server Performance
IDERA Live | Leverage the Query Store for Better SQL Server Performance
 
Do you know where your databases are?
Do you know where your databases are?Do you know where your databases are?
Do you know where your databases are?
 
Unlocking Big Data Insights with MySQL
Unlocking Big Data Insights with MySQLUnlocking Big Data Insights with MySQL
Unlocking Big Data Insights with MySQL
 
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...
TechEvent 2019: Create a Private Database Cloud in the Public Cloud using the...
 
IDERA Live | Decode your Organization's Data DNA
IDERA Live | Decode your Organization's Data DNAIDERA Live | Decode your Organization's Data DNA
IDERA Live | Decode your Organization's Data DNA
 
Demystifying Data Warehousing as a Service (GLOC 2019)
Demystifying Data Warehousing as a Service (GLOC 2019)Demystifying Data Warehousing as a Service (GLOC 2019)
Demystifying Data Warehousing as a Service (GLOC 2019)
 
Chug building a data lake in azure with spark and databricks
Chug   building a data lake in azure with spark and databricksChug   building a data lake in azure with spark and databricks
Chug building a data lake in azure with spark and databricks
 
Webinar: DataStax Managed Cloud: focus on innovation, not administration
Webinar:  DataStax Managed Cloud: focus on innovation, not administrationWebinar:  DataStax Managed Cloud: focus on innovation, not administration
Webinar: DataStax Managed Cloud: focus on innovation, not administration
 
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18
What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18
 
Demystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWDemystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFW
 
#PCMVision: Oracle Hybrid Cloud Solutions
#PCMVision: Oracle Hybrid Cloud Solutions#PCMVision: Oracle Hybrid Cloud Solutions
#PCMVision: Oracle Hybrid Cloud Solutions
 
Oracle NoSQL
Oracle NoSQLOracle NoSQL
Oracle NoSQL
 
Data Architecture - The Foundation for Enterprise Architecture and Governance
Data Architecture - The Foundation for Enterprise Architecture and GovernanceData Architecture - The Foundation for Enterprise Architecture and Governance
Data Architecture - The Foundation for Enterprise Architecture and Governance
 
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
 
New Enterprise Cloud Database Options for 2019
New Enterprise Cloud Database Options for 2019New Enterprise Cloud Database Options for 2019
New Enterprise Cloud Database Options for 2019
 

Más de DATAVERSITY

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...DATAVERSITY
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceDATAVERSITY
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data LiteracyDATAVERSITY
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for YouDATAVERSITY
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?DATAVERSITY
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?DATAVERSITY
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling FundamentalsDATAVERSITY
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectDATAVERSITY
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?DATAVERSITY
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...DATAVERSITY
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsDATAVERSITY
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayDATAVERSITY
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise AnalyticsDATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best PracticesDATAVERSITY
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?DATAVERSITY
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best PracticesDATAVERSITY
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageDATAVERSITY
 

Más de DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 

Último

How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 

Último (17)

How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 

IDERA Slides: Managing Complex Data Environments

  • 1. © 2019 IDERA, Inc. All rights reserved. MANAGING COMPLEX DATA ENVIRONMENTS Lisa Waugh, Senior Product Manager, Aqua Data Studio
  • 2. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 2 COMPANIES ARE STRIVING TO STORE AND MANAGE MORE AND MORE DATA ▪ It is rare to have a company that uses a single platform anymore, so companies and IT teams must adapt ▪ The days of different disciplines for different roles are gone ▪ Multiple disciplines must work together ▪ The lack of the appropriate skill sets can slow the process down
  • 3. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 3 CLOUD EXAMPLE OF INFRASTRUCTURE
  • 4. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 44 HYBRID INFRASTRUCTURE EXAMPLE
  • 5. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 5 CONSIDERATIONS FOR THE DATABASE ▪ Scalability • SQL • Users have to scale a relational database on powerful servers. • The data has to be distributed, handling tables across different servers. • NoSQL • Automatically spreads your data onto multiple servers. • Servers can be added or removed from the data layer. ▪ Complexity • SQL • The design of the data needs to fit into tables. • The database structure can be complex and again, difficult to handle in large volumes. • NoSQL • Automatically spreads your data onto multiple servers without requiring a defined structure. • Can cache data in system memory, therefore making it faster to retrieve. This is in contrast to SQL databases where this has to be done using a separate infrastructure.
  • 6. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 6 RELATIONAL VS NOSQL PLATFORMS ▪ Relational databases like MySQL, PostgreSQL, and SQLite represent and store data in tables and rows. They're based on a branch of algebraic set theory known as relational algebra. ▪ Meanwhile, non-relational (NoSQL) databases like MongoDB represent data in collections of JSON documents.
  • 7. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 7 DISTRIBUTIONS - THAT INTEGRATE WITH HADOOP ▪ Apache Hive is a data warehouse software project build on top of Apache Hadoop for providing data query and analysis. ▪ Hive gives a SQL like interface to query data stored in a various databases and file systems that integrate with Hadoop with different distributions to add to the complexity. ▪ Aqua Data Studio includes Hive, Impala, Spark connectors within these distributions: • Amazon EMR • Apache • Cloudera • Hortonworks • MapR
  • 8. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 8 COMPLEXITY OF NOSQL AND DISTRIBUTIONS Clients Hive Services Hive Storage and Compute Impala JDBC Spark JDBC Hive JDBC Impala Server Spark Server Hive Server Meta Store File System Job Client Hive Meta Data Store Base Hadoop Cluster Apache Hive Architecture Driver
  • 9. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 9 THERE ARE 8 BUSINESS PROCESSES 1. Determine how a hybrid strategy fits the requirements of the business. 2. Consider the implications of data governance 3. Enhance business continuity. 4. Don’t outsource security. 5. Ensure the flexibility of data movement. 6. Embrace the range of tools. 7. Expand the scope of service-level agreements. 8. Prepare for new skill sets. Download the PDF: 8 Rules for Managing Hybrid Cloud Environments by Database Trends
  • 10. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 10 IN SOME OF THESE COMPLEX ENVIRONMENTS THERE ARE NO MORE WELL-DEFINED ROLES Interesting article on role of DBAs changing but NOT going away: http://www.dbta.com/Editorial/Trends-and-Applications/How-DBAs-Can-Survive-and-Thrive-in-a-World-of-Agile-Development-129894.aspx
  • 11. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 11 AQUA DATA STUDIO OVERVIEW ▪ Aqua Data Studio is a universal database IDE and visual analytics tool for IT Professionals working with data and databases ▪ Aqua Data Studio allows you to develop and manage your databases, and access, import, export, and visually analyze data ▪ Aqua Data Studio supports over 30 database platforms, and works on all major operating systems (Windows, macOS, Linux) ▪ Aqua Data Studio supports Relational, NoSQL, and Cloud databases, making your data easily and quickly accessible
  • 12. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 12 30+ DATABASE PLATFORMS SUPPORTED ▪ Amazon Redshift ▪ Apache Cassandra ▪ Apache Derby ▪ Db2 iSeries ▪ Db2 LUW ▪ Db2 z/OS ▪ Excel ▪ Generic JDBC ▪ Generic ODBC ▪ Google BigQuery ▪ Greenplum ▪ Hive, Impala, and Spark connectors within these distributions • Amazon EMR, Cloudera, HortonWorks, Impala, MapR ▪ Informix ▪ InterBase ▪ MariaDB ▪ Microsoft Azure SQL Database ▪ Microsoft SQL Server ▪ MongoDB ▪ MySQL • Amazon Aurora MySQL • Google SQL Cloud MySQL ▪ Netezza ▪ Oracle ▪ ParAccel ▪ PostgreSQL • Amazon Aurora PostgreSQL • Google SQL Cloud PostgreSQL ▪ SAP HANA ▪ Snowflake ▪ SQLite ▪ Sybase Anywhere ▪ Sybase ASE ▪ Sybase IQ ▪ Teradata Aster ▪ Teradata ▪ Vertica ▪ VoltDB
  • 13. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 13 QUERIES, QUERIES, AND MORE QUERIES ▪ Different Kinds of Queries: There are a few differences between the two dialects, including syntax, functions, data types • Legacy i.e. Google BigQuery - COUNT(DISTINCT x) returns an approximate count • Standard - It returns an exact count ▪ Single Query ▪ Multi-Database Instance Query ▪ Scripts – Multiple queries to be saved, scheduled, etc.
  • 14. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 14 RELATIONAL VS NOSQL PLATFORMS SQL Term/Concepts database table row column index table joins primary key NoSQL/MongoDB Terms/Concepts database collection document of BSON (binary JSON) document field index $lookup, embedded documents primary key Note: Specify a unique column or column combination as a primary Key. The primary key is automatically set to the _id field. SQL to Aggregation Mapping Chart
  • 15. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 15 LANGUAGES OF SQL EXAMPLES ▪ PL/SQL is a proprietary procedural language used by Oracle. ▪ TSQL is a proprietary procedural language used by Microsoft in SQL Server. ▪ PL/PGSQL is a procedural language used by PostgreSQL. Again, syntax is different; see example PL/SQL,TSQL and PL/PGSQL typical syntax: Create table in PL/SQL ▪ CREATE TABLE table_name ( column1 datatype [ NULL | NOT NULL ], column2 datatype [ NULL | NOT NULL ], ... column_n datatype [ NULL | NOT NULL ] ); Create table in TSQL ▪ CREATE TABLE [ database_name . [ schema_name ] . | schema_name . ] table_name ( { <column_definition> } [ ,...n ] ) [ ; ] Create table in PL/PGSQL ▪ CREATE TABLE table_name ( column_name TYPE column_constraint, table_constraint table_constraint ) INHERITS existing_table_name;
  • 16. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 16 AQUA DATA STUDIO PRIMARY FEATURES ▪ Register Servers/Databases ▪ Database Navigator/Explorer ▪ Query Analyzer (SQL/JSON Editor) ▪ Query Builder ▪ Table Data Editor ▪ Visual Analytics ▪ Import/Export Data and DDL ▪ Schema/Data/File Compare ▪ ER Modeler ▪ Database Administration
  • 17. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 17 GET TO ALL THESE SERVERS WITH ONE INTERFACE 17
  • 18. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 1818 AQUA DATA STUDIO SERVER REGISTRATION/PROPERTIES
  • 19. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 1919 AQUA DATA STUDIO SERVER REGISTRATION/PROPERTIES CONT.
  • 20. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 20 MY WORKSPACE - SERVERS, WORK AREA, FILES
  • 21. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 21 OPTIONS ALLOWS FOR DIFFERENT SYNTAX CHANGES
  • 22. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 22 OPTIONS ALLOW FOR DIFFERENT SYNTAX CHANGES
  • 23. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 23 HOW DO WE QUERY THE DATA?
  • 24. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 24 AUTOMATE COMMANDS IN THE QUERY ANALYZER
  • 25. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 25 QUERY THE DATA WITH AQUA DATA STUDIO
  • 26. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 26 RESULTS SET CLIENT STATS
  • 27. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 27 QUERY MONGODB WITH MONGOJS
  • 28. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 28
  • 29. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 29 MULTI-SERVER QUERY – MEANING SAME VENDOR QUERY
  • 30. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 30 SCRIPTS AND MORE SCRIPTS
  • 31. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 31 ENTITY RELATIONSHIP DIAGRAM
  • 32. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 32 USING THE PROJECTS TAB IN AQUA DATA STUDIO ▪ Projects are comprised of AquaScripts, Server Connections, and User Files. ▪ They provide a self-contained programming unit that allows users to create a set of AquaScripts that work on a specific set of database servers that you identify with the ability to store and access configuration files. ▪ Once a project is completed, it may be exported and shared with other users. See blog: Using Projects for Multi-Environments Scripting
  • 33. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 33 WHAT APPEARS IN THE QUERY ANALYZER - TEMPLATE ▪ //************************************************* ****************** // Create and Email Excel File // // Creates an Excel file from a user-specified SQL query and // emails the Excel file to the specified recipients. // // For more information about Aqua Open API visit link: http://docs.aquafold.com/ads/19.5/openapi/ //************************************************* ****************** //************************************************* ****************** // Input parameters. //************************************************* ****************** var server ="Lisa SQL Server 2016"; var database = "Healthcare"; var schema = "dbo"; var sqlQuery = "select * from dbo.doctors"; var filePathtoStore = "C:/Users/Lisa Waugh/build/create_and_email_excel_file.xl s"; var toRecipient = "Lisa_Waugh@company.net"; var from = "Lisa.Waugh@company.com"; var subject = "Test Excel email"; var message = "This is a test of the create email Excel file in project"; ▪ try { var conn = aqua.project.getServerConnection(server ); conn.connect(); conn.changeDatabase(database); if (schema !== null || schema != "") { conn.changeSchema(schema); } var resultset = conn.executeQuery(sqlQuery); var sheet = aqua.data.excelSpreadsheet(filePathtoSt ore); sheet.clear(); sheet.insert(resultset.columnStructure); while (resultset.next()) { sheet.insert(resultset.getRow()) } sheet.save(); sendEmail(); conn.disconnect(); aqua.console.println("E-mail sent!"); } catch(err) { aqua.console.println(err.lineNumber + ": " + err); } ▪ //******************************************* ************************ // This function is used to send the email. //******************************************* ************************ function sendEmail() { /** Use the default SMTP information configured in Aqua Data Studio. In Aqua Data Studio, go to File-- >Options-->Email to configure email settings. **/ var smtpServer = aqua.mail.getDefaultSmtpServer(); var msg = aqua.mail.newMessage(); msg.addToRecipient(toRecipient); msg.setFrom(from); msg.setSubject(subject); msg.setText(message); msg.addFileAttachment(filePathtoStor e); smtpServer.sendMail(msg); }
  • 34. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 34 DIRECTORY STRUCTURE/PROJECT CREATED
  • 35. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 35 SOURCE CONTROL: SVN, CVS, GIT, AND PERFORCE
  • 36. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 36 TOOLS TO HELP MANAGE ALL THESE ENVIRONMENTS
  • 37. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 37 SYNCHRONIZE SCHEMA
  • 38. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 38 THE BUSINESS ANALYTICS CHALLENGES SOLUTION Support the citizen analyst’s data storytelling and intelligent decisioning with a tool that addresses the key challenges: Aqua Data Studio ▪ Broaden access to a wide variety of data sources ▪ Simplify query and analysis tasks ▪ Provide a robust palette of graphs and charts for effective visualizations ▪ Provide an environment for development, collaboration, and integration
  • 39. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 39 BUSINESS INTELLIGENCE VS ANALYTICS
  • 40. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 40 BUSINESS ANALYTICS: HOW DO YOU TELL A STORY? ▪ Provide the datasheet as a package with the data and the worksheet, therefore, linking parameters across different data sources ▪ Export as an image
  • 41. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 41 VISUAL ANALYTICS
  • 42. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 4242 SUMMARY ▪ Today’s database environments are often more complicated • Not just a single type of data store • Relational, NoSQL, cloud ▪ Database professionals must perform multiple tasks across them all • Managing different platforms • Running queries • Creating data analytics ▪ Aqua Data Studio makes it easier • 14-day free trial • Learn more at aquafold.com
  • 43. © 2016 IDERA, Inc. All rights reserved. Proprietary and confidential.© 2019 IDERA, Inc. All rights reserved. 43 THANKS! Any questions?