1. Scaling Big while Sleeping Well Josh Holmes @joshholmes josh.holmes@microsoft.com www.joshholmes.com

2. Agenda Testing the Waters What is cloud computing? What are the advantages of cloud computing? How’s Azure fit in? Diving Deep Digging into PHP/Ruby on Azure Leveraging FastCGI Leveraging Azure Storage Leveraging SQL Azure

3. We are all excited about the cloud

4. Cloud-Addressable Challenges 1 1 5 Maintaining security while increasing access and transparency—within and outside the organization Infrastructure costs are fixed and ongoing, and distract from the mission of reducing business process friction 2 6 Leveraging past investments to provide future value Security, access, and transparency across the value chain: suppliers, partners, etc. 3 Many data centers at limit—real estate, capacity, cooling and power 7 Lack of a common platform 4 Matching capacity to demand

5. In House or Hosted Servers Allocated IT-capacities Load Forecast “Under-supply“ of capacities “Waste“ of capacities Fixed cost of IT-capacities IT CAPACITY Barrier for innovations ActualLoad TIME

6. Cloud Computing Load Forecast Allocated IT capacities No “under-supply“ IT CAPACITY Reduction of “over-supply“ Possible reduction of IT-capacities in case of reduced load Reduction of initial investments ActualLoad Time

7. Types of Clouds Platform (as a Service) Private (On-Premise) Infrastructure (as a Service) You manage Applications Applications Applications You manage Runtimes Runtimes Runtimes Security & Integration Security & Integration Security & Integration Managed by vendor Databases Databases Databases You manage Servers Servers Servers Managed by vendor Virtualization Virtualization Virtualization Server HW Server HW Server HW Storage Storage Storage Networking Networking Networking

8. The Microsoft Cloud ~100 Globally Distributed Data Centers Quincy, WA Chicago, IL San Antonio, TX Dublin, Ireland Generation 4 DCs

10. Categories of Services Application Services Software Services Platform Services The Microsoft Cloud Infrastructure Services

11. The trick is knowing what your systems need, and how the cloud can help.

12. Not everything has to or can live in the cloud

13. Only move to the cloud that which can benefit

14. The core strategy is ‘hybrid’

15. Take an À la carteapproach

16. We call this Software + Services

17. An Example…

18. “Packaged” Application Big Pharmaceutical Example Hosted “Packaged” “Packaged” using cloud “Software as a Service” Buy ERP “Too costly to run this myself, but I’ve made too many customizations” CRM Email Build vs. Buy “Home Built” Application Hosted “Home Built” “Home Built” using cloud “Platform as a Service” HR System Molecule Research Build Clinical Trial Hoster Vendor On Premise Cloud

19. “Packaged” Application Big Pharmaceutical Example Hosted “Packaged” “Packaged” using cloud “Software as a Service” Buy ERP CRM “CRM and Email are commodity services – They have no customizations, and it’s cheaper for someone else to run these” Email Build vs. Buy “Home Built” Application Hosted “Home Built” “Home Built” using cloud “Platform as a Service” HR System Molecule Research Build Clinical Trial Hoster Vendor On Premise Cloud

20. Big Pharmaceutical Example “Packaged” Application Hosted “Packaged” “Packaged” using cloud “Software as a Service” Buy ERP CRM Email Build vs. Buy “Home Built” Application Hosted “Home Built” “Home Built” using cloud “Platform as a Service” “I can’t afford to maintain this old HR application written in VB4 – it’s driving me mad!” HR System “…but due to regulatory issues, I cannot store my HR data off-premise” Molecule Research Build Clinical Trial Hoster Vendor On Premise Cloud

21. “Packaged” Application Big Pharmaceutical Example Hosted “Packaged” “Packaged” using cloud “Software as a Service” Buy ERP CRM Email HR System Build vs. Buy “Home Built” Application Hosted “Home Built” “Home Built” using cloud “Platform as a Service” “I wish I had access to cheaper compute and storage when I need it” Molecule Research Build Clinical Trial Hoster Vendor On Premise Cloud

22. “Packaged” Application Big Pharmaceutical Example Hosted “Packaged” “Packaged” using cloud “Software as a Service” Buy ERP CRM Email HR System Build vs. Buy “Home Built” Application Hosted “Home Built” “Home Built” using cloud “Platform as a Service” Molecule Research Build “THIS is where I want to spend my IT resources – I’m going to double down on this application!” Clinical Trial Hoster Vendor On Premise Cloud

23. Where the Cloud is Compelling

24. Only 2 reasons to use the cloud

25. Windows Azure VMs Small Medium Large X Large $0.12 $0.24 $0.48 $0.96 Per service hour Per service hour Per service hour Per service hour 1 x 1.6Ghz 2 x 1.6Ghz 4 x 1.6Ghz 8 x 1.6Ghz (moderate IO) (high IO) (high IO) (high IO) 1.75 GB memory 3.5 GB memory 7.0 GB memory 14 GB memory

26. Windows Azure, In One Picture Business Portal Developer Portal Service Management Service REST User Code … … Runtime API Storage Cluster VS Tools Compute Cluster … WA SDK VM Setup REST MSFT Datacenters Desktop Cloud VM

28. Current staff costs

29. Cooling/power/space

30. Migration costs

31. LicensingAzureROI.CloudApp.net

33. ZENDFRAMEWORK

34. Digging into Azure with PHP/Ruby

35. Windows Azure, In One Picture Business Portal Developer Portal Service Management Service REST User Code … … Runtime API Storage Cluster VS Tools Compute Cluster … WA SDK VM Setup REST MSFT Datacenters Desktop Cloud VM

37. TCP/HTTP Endpoint

38. Long running processes

40. HTTP/HTTPS Endpoint

41. Short lived calls

43. Windows Azure 4 Eclipse Does a lot of the heavy lifting for you Creates the Web.config, Web.roleConfig, PHP implementation and debugs in the dev fabric http://windowsazure4e.org

44. Running EXEs in the Worker Process Start with a Worker Role Process to Copy the exes to the worker role’s app directory Execute the process Monitor the health of the process Other auxiliary tasks…

45. Running Ruby in the Worker Process http://code.msdn.microsoft.com/railsonazure Download and extract the solution Copy the Ruby bin and lib folders to the Ruby folder in the RR project Copy your rails application to the RailsApp folder in the RR project Open the solution in Visual Studio Run in the Dev Fabric Navigate to http://127.0.0.1:5100

46. Data Storage

47. Storage options Windows Azure Data Sql Azure

48. Windows Azure Data Storage Queue Blob Account Tables Drives

50. Blobs

51. Unstructured data storage

52. Tables

53. Semi-structured or tabular data storage

54. Queues

55. Buffered delivery data storage

56. Drives

58. Windows Azure Data Storage

59. PHP with Windows Azure Storage Windows Azure SDK for PHP @ http://phpazure.codeplex.com PHP programming model for Windows Azure Storage Features PHP classes for Blobs, Tables & Queues Store PHP sessions in Table Storage

60. Windows Azure Data Storage - Blobs Unstructured data storage Partitioned by container Unlimited containers

61. Blobs Sample $blobStorage= new Microsoft_WindowsAzure_Storage_Blob(); // Create if (!$blobStorage->containerExists($containerName)) { $blobStorage->createContainer($containerName); $blobStorage->setContainerAcl($containerName, Microsoft_WindowsAzure_Storage_Blob::ACL_PUBLIC); } // Store $blob = $blobStorage->putBlob($containerName, $blobName, $localFilename, $metadata); /* @var $blob Microsoft_WindowsAzure_Storage_BlobInstance */

62. Blobs Sample Cont… // Copy $result = $blobStorage->copyBlob( $containerName, $blobName, $containerName, $blob2Name); // Retrieve $tempStore= azure_getlocalresourcepath('tempstore'); $tempPath= $tempStore. '' . $imageId; $blobStorage->getBlob($containerName, $blobName, $tempPath); // Delete $result = $blobStorage->deleteBlob($containerName, $blobName); $result = $blobStorage->deleteContainer($containerName);

63. Blob Stream Wrapper $blobStorage= new Microsoft_WindowsAzure_Storage_Blob(); // Register: $blobStorage->registerStreamWrapper(); // registers azure:// // or $blobStorage->registerStreamWrapper('blob://'); // use blob:// // Use $fp= fopen('azure://mycontainer/myfile.txt', 'r'); // ... fclose($fp);

64. Storage: XDrive NTFS drive in the cloud: X:br />Fixed size between 16MB and 1TB Max 8 drives on your VM Implemented as a page blob Single instance write Multiple instance read

65. Queue Workflow Concepts Windows Azure Queue Provides Guarantee delivery (two-step consumption) Worker Dequeues Message and mark it as Invisible Worker Deletes Message when finished processing it If Worker role crashes, message becomes visible for another Worker to process Doesn’t guarantee “only once” delivery Doesn’t guarantee ordering Best effort FIFO Worker Role Web Role Input Queue (Work Items) Worker Role Azure Queue Web Role Worker Role Web Role Worker Role

66. Azure Queues RemoveMessage GetMessage (Timeout) Worker Role PutMessage Queue Msg 1 Msg 2 Msg 2 Msg 1 Web Role Worker Role Worker Role Msg 3 Msg 4 Msg 2

67. Loosely Coupled Work with Queues Worker-Queue Model Load work in a queue Many workers consume the queue Input Queue (Work Items) Azure Queue Worker Role Web Role Worker Role Web Role Worker Role Web Role Worker Role

68. Queues $queueClient= new Microsoft_WindowsAzure_Storage_Queue(); // Create $result = $queueClient->createQueue('imageQueue'); // Delete $queueClient->deleteQueue('imageQueue'); // Add message $queueClient->putMessage('imageQueue', $message, $ttl); // Retrieve Messages $messages = $queueClient->getMessages('imageQueue', 10); foreach($messages as $message) { // Do work here... $queueClient->deleteMessage('imageQueue', $message); }

69. Windows Azure Data Storage - Tables Semi-Structured data Tables contain entities Entities contain properties May be partitioned across thousands of servers. Support ACID transactions over single entities Queries over entire table .NET and REST interfaces

70. Windows Azure Data Storage – Tables (Terms Part 1) Table Contains a set of entities. Entity (Row) Basic data items stored in a table. Property (Column) Single value in an entity. RowKey Unique ID of the entity within a partition Timestamp Time it was created

71. Windows Azure Data Storage – Tables (Terms Part 2) Partition Entities in a table with the same partition key PartitionKey Segments entities in to partitions to automatically distribute the table’s entities over many storage nodes. Sort Order There is a single index provided for the CTP, where all entities in a table are sorted by PartitionKey and then RowKey

72. Key Example – Blog Posts Partition 1 Partition 2 Getting all of dunnry’s blog posts is fast Single partition Getting all posts after 2008-03-27 is slow Traverse all partitions

73. Table Sample $tableStorage= new Microsoft_WindowsAzure_Storage_Table( 'table.core.windows.net', 'myaccount', 'myauthkey'); // Create $result = $tableStorage->createTable($tableName); // List $result = $tableStorage->listTables(); foreach($result as $table) { echo 'Table name is: ' . $table->Name . ""; } // Delete $tableStorage->deleteTable($tableName);

74. Tables with Entities // Structured entity class ImageEntityextends Microsoft_WindowsAzure_Storage_TableEntity { /** * @azure filename */ public $filename; /** * @azure size Edm.Int64 */ public $size; } // Unstructured entity // Microsoft_WindowsAzure_Storage_DynamicTableEntity

75. Tables with Entities Cont… // Insert $image = new ImageEntity($partitionKey, $rowKey); $image->filename = $_FILES['imageUpload']['name']; $image->size = $_FILES['imageUpload']['size']; $image = $tableStorageClient->insertEntity($tableName, $image); // Retrieve $image = $tableStorage->retrieveEntityById($tableName, $partitionKey, $rowKey, 'ImageEntity'); // Update $image->filename = 'newname.jpg'; $result = $tableStorage->updateEntity($tableName, $image); // Delete $result = $tableStorage->deleteEntity($tableName, $image);

76. Table Queries // Filter condition $select = "filesizegt 1024 and PartitionKeyeq '$partitionKey'"; // Or fluent interface $select = $tableStorage->select()->from($tableName) ->where('filesizegt 1024') ->andWhere('PartitionKeyeq ?', $partitionKey); // Run query $images = $tableStorage->storageClient->retrieveEntities( 'testtable', $select, 'ImageEntity' ); foreach($images as $image) { echo 'Name: ' . $image->filename . ""; }

77. Batching Operations // Start batch $batch = $tableStorage->startBatch(); // Insert multiple $images = generateEntities(); foreach($images as $image) { $tableStorage->insertEntity($tableName, $image); } // Commit $batch->commit();

78. Table session handler $sessionHandler = new Microsoft_WindowsAzure_SessionHandler($tableStorage); $sessionHandler->register(); session_start(); if (!isset($_SESSION['start'])) { $_SESSION['start'] = time(); }

79. SQL Azure and Windows Azure Table Comparison Windows Azure Tables SQL Azure Tables Semi-structured Loosely typed Non-Relational (Not RDMS) Massively scalable Fully structured Strongly typed Relational (RDMS) Highly scalable

80. MySQL: Simple Configuration VIP Load Balancer Web Role MySQL Worker Role

81. MySQL in a Windows Azure Application Running MySQL in a worker role Copy MySQL to the worker role sub-directory Copy to read-write local storage Configure MySQL to listen on the right port Monitor MySQL health Consuming MySQL Discover IP address and port Normal access from then on Handle topology changes

82. Simple Configuration VIP Load Balancer MySQL

83. Replication VIP Load Balancer M S S MySQL MySQL MySQL

84. Windows Azure Drive with Hot Spare VIP Load Balancer MySQL MySQL

85. Windows Azure Drive with Hot Spare VIP Load Balancer MySQL MySQL

86. SQL Azure

87. SQL Azure Features Supported Tables, Indexes, Views Stored Procedures Triggers Constraints Table Variables Temp Tables (#Name) Not Supported Physical Server Access Catalog DDL Common Language Runtime Service Broker Reporting Services Analysis Services Distributed Transactions and Queries

88. SQL AzureDeployment Web Portal (API) DB Script SQL Azure TDS

89. SQL AzureAccessing databases Web Portal (API) Your App SQL Azure TDS Change Connection String

90. Database Replicas Single Database Multiple Replicas Replica 1 Single Primary Replica 2 DB Replica 3

91. SQL AzureDatabase Monitoring & Recovery Web Portal (API) ! Your App SQL Azure TDS

92. SQL Azure Server Creation

95. Database Migrations Scripts Transfer Schema BCP Transfer Data SSIS (SQL Server Integration Service) Transfer Schema and Data

96. Database Migrations (Cont.) The SQL Azure Migration Wizard helps you migrate your local SQL Server 2005 / 2008 databases into SQL Azure. The wizard walks you through the selection of your SQL objects, creates SQL scripts suitable for SQL Azure, and allows you to migrate your data.” http://sqlazuremw.codeplex.com/

97. Database Management using SQL Management Studio

98. PHP with SQL Azure SQL Server Driver for PHP @ http://sqlsrvphp.codeplex.com/ Supports PHP access to SQL Azure Features Choose between SQL Server and SQL Azure by changing connection string Use from on-premises or in Windows Azure

100. More resources Microsoft Windows Azure Interop http://www.microsoft.com/windowsazure/interop/ Interop Bridges http://www.interoperabilitybridges.com/

101. More resources PHP http://www.windowsazure4e.org http://phpazure.codeplex.com/ MySQL Windows Azure MySQL PHP Solution Accelerator http://code.msdn.microsoft.com/winazuremysqlphp

102. More resources Python Sriram Krishnan http://www.sriramkrishnan.com/blog/2008/11/python-wrapper-for-windows-azure.html Ruby Simon Davies http://blogs.msdn.com/simondavies http://code.msdn.microsoft.com/railsonazure Johnny Halife http://github.com/johnnyhalife/waz-storage http://waz-storage.heroku.com/rdoc/index.html

103. And of course Josh Holmes http://www.joshholmes.com

104. Scaling Big while Sleeping Well Josh Holmes @joshholmes josh.holmes@microsoft.com www.joshholmes.com