Azure, Microsoft Cloud offers to store DATA. SQL\ NoSQL \Hadoop ect

1. Believe it or not !!
Database on cloud !!
Pini Krisher DBA TL at etoro (www.etoro.com)
@krisherpi
pinik@naya-tech.co.il

2. Agenda:
What is the Cloud Computing?
DATA on the cloud - Pros and cons
What DATA can we put on the cloud?
What forms of DATA Services Azure can offer?
What DATA can we take from Azure?
Other Cloud Solutions
I will work a lot on the portal during the presentation….

3. What is the Cloud Computing?
Cloud is not 1 huge machine

4. • Types
• SAAS – Software as a service
• PAAS – Platform as a service
• IAAS – Infrastructure as a service

5. • Vendors
•
•
•
•
•
•
•
•
AWS-Amazon Web Services
Rackspace
Google
HP Cloud
VM Cloud
Microsoft Azure
Etc….

6. Azure DATA Centers
6 Data Centers
Nice movie at:
http://www.youtube.com/wa
tch?v=JJ44hEr5DFE

7. • DATA on the cloud - Pros and cons (in short)
•
PROS
•
•
•
•
•
•
•
•
•
•
CONS
•
•
•
Unlimited resources (unlimited!!!!), Data is biggest storage /IO Consumer
Easy to manage
Pay as you go
Scale – UP/DOWN - OUT/IN
Backups
Auto Upgrades
Access from any where
SLA
No Bottlenecks at IT, Finance etc.
Compliance
Performance – next slide
Not pros, not cons :Security, Costs

8. From PASS Summit 2012 – Main Problems in DB on Cloud

9. What DATA can we put on the cloud?
All data or storage you want!!!
DB’s
Files
BI systems
Problems:
Compliance
Security – is the most important issue – but…
Manage Costs – about costs we will show at the
end…

10. • Security on Cloud-security is the primary concern
•
•
•
•
•
•
SSL
IP protection
Isolation of Customer Access
Multi-factor Authentication
Regular Authentication in DB
Internal VPN
FROM AWS Security manager
“Security is not just one thing. It’s both an art and a science.” The art he refers to
is being able to balance the needs of customers to access information to get
business done…with the desire to make sure you protect that which is really
important.”
You Can Be More Secure In The Cloud Than You Can Be On Premise.

11. • What forms of DATA Services
Azure can offer?
Windows Azure SQL Databases
SQL Server on VM – RDS in AWS
Windows Azure Storage
Reporting - misleading
Hadoop on Azure
Recovery

13. •DATABASES on AZURE
•Windows Azure SQL Databases – PAAS
•SQL Server on VM – IAAS
•Windows Azure Storage - NoSQL

14. • SO… When should we use DB’s on Cloud ?
• Hybrid – some on private cloud and some on
public.
• The high point after IPO
• Elections
• Shared Data/storage costs/IT costs
• No MSFT agreements

15. SQL Azure (PAAS)
SQL Azure (PAAS) :
Windows Azure SQL Databases
WASD

16. SQL Azure (PAAS)
What is PAAS in DB world?
You can not connect to the server
You can not manage hardware
You can not control hardware
No clusters etc.…
So… what DBA’s can do?
Nothing in infrastructure - there are 3 replicas…
Applicative work: adding Indexes, short
transaction etc.…
Performance tuning
High queries by CPU ,IO etc.…

17. SQL Azure (PAAS)
Some Usages with SQL Azure
Logs
Regular DB –has PCI
Lots of small DB’s
Scale up – increase DB size
Scale out – federation
Devops

18. SQL Azure (PAAS)
Logical structure of SQL Azure
Subscription servers  DataBases
They can not talk with each other!!!!!!
(Not Serverinstanses DataBases)
Creation of New DB
Security
Connect via SSMS
SSMS differences
Limitations

19. SQL Azure (PAAS)
SO – we have DB what's next?
Start working – build tables, insert data, create SP’s
Copy DB
Modify size
BACKUPS only to blobs!
Migrate existing data – how?
WAMW – tool from MSFT – free tool
Scripts in SSMS
Deploy from SSMS
BCP’s
MW
Bacpac – Data Tier Application – to storage and to
azure
Tools like red gate etc.
Sync
Queries from SSMS about tuning
SSMS
Portal

20. SQL Azure (PAAS)
Access to SQL Azure - Azure Portal
Create Server
Create DB – 3 ways (from portal, ssms, vs2012)
Location
Size – 1-150 GB
Security
Basic monitoring (monitoring in other tools like Quest)
Connection strings from the portal
Backups to BLOB

21. SQL Azure (PAAS)
Access to SQL Azure - Web Portal
Connect – silver light – to 1 DB or to server
Run T-sql
Basic monitoring
Query plans
Add indexes
See DATA
Change schema

22. SQL Azure (PAAS)
Features that Supported/not Supported in SQL
Azure
Supported:
New syntax
Auto Updates
Copy DB
Linked server from local DB’s
Not Supported:
Service broker
Jobs
profiler
CLR
Replication
Connections between DB’s in server
SSMS

23. SQL Azure (PAAS)
• Monitoring – SQL AZURE
• Tools
• Portals

24. DEMO

25. SQL Server on VM (IAAS)
SQL Server on VM (IAAS)
Create
Attach Disk
Connect via RDP
Can control the server
Can monitor the server
Monitoring
Reduce costs

26. SQL Server on VM (IAAS)

27. SQL Server on VM (IAAS)

28. SQL Server on VM (IAAS)
• Monitoring in VM
• Via portal

29. SQL Server on VM (IAAS)
• Inside machine in RDP

30. DEMO

31. Azure Storage
Blob – can store any type of file:
Backups
Images
VHD
Any Files you want – can be
secured
Monitoring
Geo-Replication
Main portal
Azure storage
explorer
VS2012

32. Azure Storage
Q – messaging
Monitoring
Main portal
Azure storage
explorer
VS2012

33. Azure Storage
Tables Nosql– tools and manage
(Azure Storage explorer, VS2012)
Store NON relational DATA – no
Group by – no JOINS
Monitoring
Geo-Replication
Main portal
Azure storage
explorer
VS2012

34. DEMO

35. HDINSIGHT – Hadoop on Azure
Any files sitting on Clusters
Can be query by PowerShell
Map Reduce
Hive
Main portal

36. HDINSIGHT – Hadoop on Azure

37. Recovery Services
• Backup Vault
• Hyper-V Recovery manager Vault

38. Reduce costs

39. Price ???
Start working
Migrate existing data

40. DEMO

41. MarketPlace DATAMarket
Getting a lot of raw data
Getting application to manage data
Use application to see data
Has a lot of API’s
https://datamarket.azure.com/
SOME ARE FREE!!!!

43. DEMO