AWS Summit Intro to Government Cloud Computing

2013 AWS WWPS Summit
Canberra, Australia
Introduction to Government and Education
Cloud Computing
Steve Halliwell
GM, WW Public Sector

2013 AWS WWPS Summit,
Canberra – May 23
What is Amazon Web Services?
AWS Global Infrastructure
Application Services
Networking
Deployment & Administration
DatabaseStorageCompute

Canberra – May 23
AWS Cloud Adoption in the Public Sector
500+Government Agencies
2,000+Education Institutions

Over 14,000 AWS customers in Australia & New Zealand …

Canberra – May 23
Gartner Magic Quadrant for Cloud IaaS
Gartner “Magic Quadrant for Cloud Infrastructure a Service,” Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Hayn, October 18, 2012. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context
of the entire report.. The Gartner report is available upon request from Steven Armstrong (asteven@amazon.com). Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors
with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of

Canberra – May 23
• $5.2B e-commerce company
• 7,800 employees
• A whole lot of servers!
Every day (on average), AWS
adds server capacity equivalent
to that entire $5.2B enterprise
Perspectives on Scaling: Compute

Canberra – May 23
Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 Nov 2012 Apr 2013
Time Sequence of Total Number of Objects Stored in
Amazon Simple Storage Service (S3)
2.9 Billion 14 Billion 40 Billion
102 Billion
262 Billion
762 Billion
Current Peak Rate:
1.1 Million Requests per Second
1.3 Trillion
Perspectives on Scaling: Storage
2 Trillion

Canberra – May 23
1. Pay for Infrastructure When You Need It, Not Upfront
On-Premises
$0 to get started
Pay as you go

Canberra – May 23
2. Lower Total Cost of IT
Scale allows us to constantly
reduce our costs
We are comfortable running a high
volume, low margin business
We pass the savings along to
our customers in the form of
low prices

Canberra – May 23
More Reliable and ¼ the Cost of On-Premise Solutions

Canberra – May 23
3. Don’t Guess Capacity
Self
Hosting
Waste
Customer
Dissatisfaction
Actual demand
Predicted Demand
Rigid Elastic
Actual demand
AWS

Canberra – May 23
4. Increase Innovation: Experiment Fast, Low Costs & Risk
On-Premises
Experiment Infrequently
Failure is expensive
Less Innovation
Experiment Often
Fail quickly at a low cost
More Innovation
$ Millions Nearly $0

Canberra – May 23
5. End Undifferentiated Heavy Lifting
Buy and install new hardware
Setup and configure new software
build or upgrade data centers
We take care of it… So you don’t have to …
Data Centers
Power
Cooling
Cabling
Networking
Racks
Servers
Storage
Labor

Canberra – May 23
6. Go Global in Minutes

Canberra – May 23
Security and Compliance is a Shared Responsibility
Facilities
Physical security
Compute infrastructure
Storage infrastructure
Network infrastructure
Virtualization layer (EC2)
Hardened service endpoints
Rich IAM capabilities
Network configuration
Security groups
OS firewalls
Operating systems
Applications
Proper service configuration
Account management
Authorization policies
+ =
Customer
Working together, we can achieve
systems validated and certified at
the highest levels

Canberra – May 23
9 AWS regions
39 AWS edge Locations Sydney
Global Infrastructure

Canberra – May 23
The Full Benefits in the AWS Cloud

Canberra, Australia
Network Powered Business
Mikkel Hippe Brun
Tradeshift,
Co-founder / VP of Global Strategy

Canberra – May 23
E-invoicing in Danish Government built on
AWS
• EasyTrade (since 2007)
• 15m invoices, 30,000 institutions,150,000 suppliers
• Central E-invoicing registry on AWS

Canberra – May 23
Pan European Public Procurement Online
(PEPPOL)
• €30m roaming infrastructure 4 service providers
• Supports the full “procure to pay” cycle
• Central registry on AWS

Canberra – May 23
What if you could connect all the
companies in the world and enable
business interactions to occur in
real-time, friction-free?

Canberra – May 23
Today’s AP Organizations
AP overloaded & business
penalized for delays in
processing
Consolidation of ERP
systems and increase use
of electronic documents
Supplier networks cost
money to join.
Status quo costs nothing.

Canberra – May 23
The disruptive Tradeshift model
Free transactions for
suppliers
Which increase
supplier adoption
And increase the customer
business case
Creating better supply
chain relations
Which reduce cost and
increase value for both
suppliers and customer

Canberra – May 23
Tradeshift Breaks The Cycle
Free
Supplier
Connectivity
Eliminate
Paper-related
processes
Global
Compliance
coverage
Platform
Expand your
business
processes

Canberra – May 23
Tradeshift Enterprise Platform

Canberra – May 23

Canberra – May 23
Tradeshift: Born in the cloud
• We want to connect all the
companies in the world on one
platform
• We believe in solving hard
problems using technology
• We believe the future of supply
chains is open and cloud based
• Build on Amazon Web Services
The numbers
• 500.000 buyers and sellers are
connected directly on the Tradeshift
platform
• 5 million companies are connected
through our platform partners
• We are the fastest growing b2b platform
in the world today with more than 1000
suppliers joining every week
• Largest global footprint, with active users
in 190 countries.
• More than 1 million business
transactions completed every month

Canberra – May 23
From garage to global in 3 years

Canberra – May 23
Public Sector Adoption of AWS

Canberra – May 23
Forrester Foresights Survey data , Q3 2012
Self-service Portals Resource Automation Resource Tracking Cost Chargeback
Have you implemented
these cloud Features? 24% 27% 29% 14%
Not Achieving Objectives with the Private Cloud

Canberra – May 23
Private Connections
Workload Migrations
Access Control Integration
Work with Existing
Management Tools
On-Premises Apps
Your Data Centers
Cloud Apps
Our “Hybrid” Focus: Tools to Support Hybrid IT Architectures

Canberra – May 23
Active Directory
VMware Images
Network Configuration
Your Data
Your On-Premises Apps
Users & Access Rules
VM Import/Export
Your Private Network
Our Storage
Your Cloud Apps
Direct Connect
VPC
IAM
Storage Gateway
Our “Hybrid” Focus: Tools to Support Hybrid IT Architectures
Your Data Centers

Canberra – May 23
Typical Workloads First Moved to the Cloud
• Development and test infrastructure
• Web sites, web apps, cross-organization collaboration apps
• Big data analytics, high performance computing workloads
• Backup, archive, third tier storage
• Disaster recovery/continuity of operations (DR/COOP)
• Eventually: migration of LOB applications
• Quickly: SaaS vendors are already in AWS (e.g., TradeWorx, ESRI, TradeShift)

Canberra – May 23
Public Sector Adoption of AWS
Web sites and web apps; dev
& test; collaboration sites; big
data; new apps & missions
Migrate existing apps & data;
augment on-prem resources
(“bursting”); DR/CooP
Training, knowledge transfer;
architecture; security and
compliance; first workloads…

Canberra, Australia
ICRAR, SKA and AWS
Kevin Vinsen
Research Associate Professor, (ICRAR, UWA)

One Observatory - Two sites
SKA Phase 1
~10% full SKA
2016-2020
In Mid West WA
Survey Facility at
Low and Mid Frequency
MWA x 100
36 dish ASKAP +
60 more dishes
with PAFs
In Karoo RSA
Detailed deep field facility
at High Frequency
64 dish
MeerKAT +
190 more
dishes
Good low frequency site Good high frequency site

ICRAR
What’s next
• 2012 - 2015 Pre-construction design
– ANZ lead involvement in 3 areas
– Industry Opportunities in design
– SKA project + construction staff build up
• 2016 - 2020 Phase 1 Construction 10%
– ANZ contracts (institutions + industry)
– SKA construction + operations staff build up
• 2020 - 2024 Phase 2 Construction 100%
– SKA 1 operations + SKA 2 construction

ICRAR
Spectral Line Datacube
• Aperture Arrays
– Assume 40,000 channels
– 28,000 x 28,000 x 40,000 x 4
– ≈125TB
• Stokes parameters and Weighting Map
– Multiple by 5
– ≈ 625TB

ICRAR
Surveys
• ∼1000 Cubes to survey the whole sky - taken
throughout the year.
• Ultra deep surveys look at
the same point again,
and again, and again.
• The images are then
stacked to produce a
single cube.

ICRAR
Data sizes after a year
Science Case Raw data Line Cube Continuum Polarization
Neutral IGM in EOR 86EB 22TB 1.2TB
Galaxy evolution over cosmic time 11EB 7.7PB
Galaxy evolution in the nearby universe 8EB 1.3PB
Wide area HI emission 35EB 78PB
Deep extragalactic HI emission stacking 86EB 290TB
Wide field continuum observations 425EB 23.9PB
Wide field polarization observations 425EB 300PB

ICRAR
Projected Performance
1 TFlop
10 TFlops
100 TFlops
1 PFlop
10 PFlops
100 PFlops
1 EFlop
10 EFlops
Source: Top500.org
ASKAP
SKA Phase 1

ICRAR
theSkyNet Pan-STARRS1 Optical
Galaxy Survey (POGS)
• Pixel-by-pixel spectral energy distribution fitting
– UV, Optical, IR, and Radio
– Local stellar mass surface density
– Star formation history
– Age
– Extinction
– Dust attenuation
• Start with ~100 million pixel SEDs
– Each pixel SED takes between 5 and 10 minutes
– It would take between 950 and 1,900 years on a single core

ICRAR
theSkyNet Pan-STARRS1 Optical
Galaxy Survey (POGS)

ICRAR
Fabric and Boto
# Setup NAGIOS
sudo('chkconfig nrpe on')
sudo('service nrpe start')
# Setup the HDF5
with cd('/usr/local/src'):
sudo('wget http://www.hdfgroup.org/ftp/lib-external/szip/2.1/src/szip-2.1.tar.gz')
sudo('tar -xvzf szip-2.1.tar.gz')
sudo('wget http://www.hdfgroup.org/ftp/HDF5/current/src/hdf5-1.8.10.tar.gz')
sudo('tar -xvzf hdf5-1.8.10.tar.gz')
sudo('rm *.gz')

ICRAR
Puppet
Does all the yum updates you need and creates
directories and users
package { 'httpd':
ensure => installed,
}
package { 'httpd-devel':
ensure => installed,
}
user { 'apache':
ensure => present,
groups => ['ec2-user'],
}
service { 'httpd':
ensure => running,
enable => true,
require => Package['httpd'],

ICRAR
Scaling BOINC - AWS to the rescue

ICRAR
Scaling BOINC - AWS to the rescue
• You MUST think about scalability from the beginning
• Zooniverse - crashed due to load in the first 4 hours
• theSkyNet - crashed due to load in the first 6 hours
• theSkyNet POGS crashed due to load from a BOINC
challenge (after 6 months) - was up and running again
in 3 hours

Canberra – May 23
Example: CDC BioSense 2.0
Tracks public health problems to better prepare for and coordinate
responses to safeguard the wellbeing of the American people.
Watch the video:
http://youtube.com/watch?
v=AGgm2j5axPY

Canberra – May 23
Big Data & High Performance Computing
Runs genome
sequencing project
on AWS
Runs parallel
computations and
image processing on
AWS
• Build a 30,000 core super-computer for $1279/hour
• Build a 12 teraflop cluster for $35/hour
• Eliminate queuing for HPC resources and accelerate time to science
• Latest Intel processors, GP-GPUs, 10gb network and placement groups
Develop, test, and
explore cutting
edge technology at
realistic scale.

Canberra – May 23
Cloud Storage and Backup
“The adoption of elastic storage with Amazon S3 at
Stanford is a strategic development in achieving and
maintaining a significantly improved data and
security environment which highly leverages current
state-of-the-art cost-effective technologies in an
easily accessible and manageable framework.”
— Horace Greeley, Systems Group, Stanford
University

Canberra – May 23
Obama for America’s Mission Critical Apps on AWS
Donor Collection
System
Volunteer
Management
System
Voter File
“The AWS Cloud let
us build solutions
for an environment that
moves so rapidly
that you can’t plan
for it.
It made a big difference to the
success of the campaign.”
- Mike Slaby, Chief Integration and
Innovation Officer, Obama for America
Millions of Users
Served
Call Tool
Micro-targeting
Dashboard
Over 200
applications built
on the platform
Scaled up, and
scaled down
See http://awsofa.info

Canberra – May 23
LOB Applications
• Small public school district in Fish Creek, Wisconsin
• Needed to upgrade servers running everything from student
databases to library management system
• IT department estimated that new equipment and 4 years of upkeep would
have cost close to $50,000—a lot for a cash-strapped institution
• After moving LOB infra to AWS, on track to save 25% over the
typical 5 year lifespan of on-premises infrastructure
• IT department had initial AWS workloads running within 20 minutes, and
fully operational within 6 hours

Canberra – May 23
SAFRA – Singapore’s NS45 Portal
• Honoring Those Who Have Served
– Celebrating the 45th anniversary of Singapore’s National Service
– MINDEF providing $100 million of benefits to more than 900,000
current and past National Servicemen
• One-stop NS45 Portal Powered by AWS
– One month initial implementation
– Subsequent deployments in a matter of hours
– Reduced number of physical servers by about 50% per project
– High availability despite dramatic growth in number of active users

Canberra, Australia
data.gov.au
Pia Waugh
Director Coordination and Gov 2.0

Canberra – May 23
Operating Systems Languages & Libraries Certified
Applications
Open and Interoperable

Canberra – May 23
Supporting a Very Wide Range of Technologies

Canberra – May 23
Partners Ready to Help

Canberra, Australia

AWS Summit Intro to Government Cloud Computing

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a AWS Summit Intro to Government Cloud Computing

Similar a AWS Summit Intro to Government Cloud Computing (20)

Más de Amazon Web Services

Más de Amazon Web Services (20)

Último

Último (20)

AWS Summit Intro to Government Cloud Computing