2. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Who am I?
http://dbakevlar.com
3. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What is Virtualization?
Virtualization is the creation of a virtual (rather than actual) version
of something, such as an operating system, a server, a storage
device, database, files or network resources.
4. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Virtualization Adoption Trend
.
Source: Gartner Forecasts
10. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What Comprises the Virtualization Space?
• Network Virtualization
• Storage/Server Virtualization
• Backup Snapshots
11. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Network Virtualization
• Splits up available network bandwidth
• Distributes according to needs
• Similar to partitioning is to DBAs
12. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Storage/Server Virtualization
• Storage
• Pools physical storage from multiple storage devices
• Appears as one device
• Single console manages all
• Common in SAN environments
• Server
• Masks server resources
• Allows for resource sharing
13. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What is a Snapshot?
14. April 2-6, 2017 in Las Vegas, NV USA #C17LV
How Snapshots Work
16. April 2-6, 2017 in Las Vegas, NV USA #C17LV
From the source
blocks to each
snapshot
17. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Each Database Is
Independent of the
Source
18. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Types of Snapshots
• Hardware
• VM level, not application or software “aware”.
• Older VM technology required the virtual image to be in a static or closed state
before creating a snapshot.
• Some hardware VM technology is software “aware” or compliant.
• Software Consistent
• Creates a static or consistent snapshot of software or applications.
• Similar to RMAN putting tablespaces in backup mode, tracks changes and block
level for both physical and logical consistency.
• Is required for complex code and interactive products.
19. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Storage Vendors Examples
• Oracle ZFS
• NetApp
• EMC XtremIO
Many require additional software investment to
be application or database “aware”.
21. April 2-6, 2017 in Las Vegas, NV USA #C17LV
The DBA, The Developer and The Tester Need
to…
• Manage Databases and Applications
• Need an interface to environments, but may not care about anything at the
storage or network level.
• Need a user friendly interface.
24. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Copy Data Management, (CDM)
• Confusion- New Term
• Creates physical copies of images with clones
• Tracks copies of physical clones
• Manages clones/thin clones
• Virtualizes non-production clones
• Hybrid management mixed in for coolness
• Types
• Enterprise
• Integrated
• DevOps
• Agile
25. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What CDM IS NOT…
• Simply copying databases/applications/files on-premise or in the cloud.
• Transportable tablespace, datapump and other archaic processes to migrate
data.
• A non-repeatable process, (i.e. only works once or in a vendor’s lab.)
• Cloning or copying, but leaving data unusable, (i.e. snapshot technology that
isn’t application or database aware.)
26. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What is Copy Data Management?
27. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Could be Simple, FULL Copies…
28. April 2-6, 2017 in Las Vegas, NV USA #C17LV
What if they’re in the Cloud?
29. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Why Hybrid Management with Virtualization
Compressed and
de-duped
30. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Which Would You Rather Manage/Pay For?
31. April 2-6, 2017 in Las Vegas, NV USA #C17LV
For Entire Environment
32. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Test Data Management
• Ability to deliver development and test environments in short cycles.
• Capability to provide virtualized or synthesized datasets
• Data masking of sensitive data for test and development
• Self-Service to allow developers and testers to recover or refresh environments when
destructive tests occur.
• Ability to deliver branched data/code to development when testing discovers issues.
• Automate code delivery and result comparisons
• *Many times, this list is completed with more than one product.
33. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Ability to Deliver and Mask Data for Testing-
FAST
DB
APP
DB
APP
DB
APP
DB
APP
DB
APP
DB
Mask PCI/PII and
then virtualize
Develop Test Deploy
Production
35. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Do I Have to Mask Data? Nah….
• As of April, 2014, Yes- at least in Europe.
• ARTICLE 29 DATA PROTECTION for EU
• HIPAA
• The Health Insurance Portability and Accountability Act of 1996 (HIPAA)
• PCI
• Payment Card Industry Standards, 2016, Updated
• PII
• Personably Identifiable Information, GSA Rules
• SOX
• Sarbanes-Oxley Act of 2002
36. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Masking in the Picture
As 80% of data in a company are copies, then 80% of data won’t be subject to security like
a production environment. Securing this data is not just a priority, but in many cases,
subject to legal ramifications, (i.e. PCI/PII)
• Masking shouldn’t be reversible
• The masked data should be representative of the original data type to ensure
performance is consistent.
• Referential Integrity should be maintained as part of the masking process.
• Masking should be a simple, repeatable process with a user interface that
ensures it is simple.
37. April 2-6, 2017 in Las Vegas, NV USA #C17LV
The Quickest Task is One You Never Have to
Do.
38. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Summary
• Virtualization is a large landscape.
• Cloud is an required part of the equation.
• Products cover many areas- hardware, database, network and application.
• Some focus on solutions for specific challenges in IT.
• Terms like Copy Data Management can be confusing.
• Virtualization is a very important part of the product offering.
• Automation and User Interface is almost as important.
• Virtualization can mean big saving when discussing the cloud.
• No matter what, you should be looking at virtualizing.
39. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Ops Manager
Developer/Tester
Database Administrator
IT Architect
https://www.delphix.com/products/free-trial-request
40. April 2-6, 2017 in Las Vegas, NV USA #C17LV
Connect With Me
@DBAKevlar
https://dbakevlar.com http://delphix.com
kellyn@delphix.com
https://linkedin.com/in/kellynpotvin
You may be saying- I thought virtualization was going away with cloud adoption??
The opposite- what most will find as the monthly bills come in, is that virtualizing what is out on the cloud or even better, what is migrating to the cloud before a lift and shift is the
key to success and incredible savings.
Mark Hurd is quoted as stating by 2025, 80% of businesses will no longer have a data center.
That would result in 100% cloud adoption for those companies.
With cloud adoption, just as cross platform, we will have cross-cloud. Hybrid has a new meaning, too.
Hybrid is now multiple cloud vendors vs. on-premise/cloud.
52% growth in the next two years.
This will replace physical machines in data centers and most lump virtualized hosts, but don’t realize the power that virtualization brings to cloud migrations.
With half their capacity residing in the cloud in two years, what does this mean for physical cloning of all that data to the cloud?
Even if ½ that is retained to private clouds, the companies are still charged for data in flight, as well as data stored in the cloud.
Amazon and Azure own this race, but a price war could shake up the future of which cloud our data resides.
Almost 70% of the market is owned by Amazon and Microsoft
An overall trend in companies that includes autonomic computing, where the IT environment will be able to manage itself based on perceived activity, and resource shared computing, in which computer processing power is utilized and/or paid for only as needed.
The usual goal of virtualization is to centralize administrative tasks while improving scalability and work loads.
Understanding the power of virtualization when it comes to cloud adoption is key to lowering costs, including hidden ones.
Network virtualization is a method of combining the available resources in a network by splitting up the available bandwidth into channels, each of which is independent from the others, and each of which can be assigned (or reassigned) to a particular server or device in real time. The idea is that virtualization disguises the true complexity of the network by separating it into manageable parts, much like your partitioned hard drive makes it easier to manage your files.
Storage virtualization is the pooling of physical storage from multiple network storage devices into what appears to be a single storage device that is managed from a central console. Storage virtualization is commonly used in storage area networks (SANs).
Server virtualization is the masking of server resources (including the number and identity of individual physical servers, processors, and operating systems) from server users. The intention is to spare the user from having to understand and manage complicated details of server resources while increasing resource sharing and utilization and maintaining the capacity to expand later.
A snapshot is a virtualized copy that offers the capability to preserve the state of the virtual machine so you can return to the same state repeatedly.
Snapshots provide a change log for the virtual disk and are used to restore a VM to a particular point in time when a failure or system error occurs.
There is a source copy, (aka gold copy, source copy, dsource, etc.) that are unchanged blocks between all virtual clones.
Only changed blocks are written to disk.
The source is a source and can be refreshed daily, multiple times per day or more.
Along with the hardware!
This interface is for a storage or server admin, but not a dba or developer/tester.
Go through how copies can be made, but not virtualized
Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which
Is what cloud loves.
Go through how copies can be made, but not virtualized
Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which
Is what cloud loves.
Go through how copies can be made, but not virtualized
Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which
Is what cloud loves.
Go through how copies can be made, but not virtualized
Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which
Is what cloud loves.
The ability to identify data anomalies and inconsistencies during testing is essential in measuring the overall quality of the application. The most efficient way to achieve this goal is by employing an automated capability for comparing the baseline test data against results from successive test runs—speed and accuracy are essential. Automating these comparisons helps save time and identify problems that might otherwise go undetected.
Article 29 makes it unlawful in EMEA to not just encrypt, but to mask data in non production systems and when handling data outside of secure environments.
HIPAA protects medical information
PCI protects payment information, via the internet, inside companies and in the public eye.
PII protects personably identify information between systems, (big brother) for demographics and information collections
SOX protects investor information
If the ssn is the reference key, then the numbers should be masked identically across the objects to ensure integrity is maintained.
What does this have to do with virtualization?
The ability to patch or upgrade once and then refresh or clone with the environment already complete- not having to patch and upgrade, allowing for a single step to refresh and complete these tasks offers incredible time savings.
No more complex cloning with scripts, manual steps requiring human intervention.
An ability to migrate from one cloud to another without significant challenges or downtime.