1. Industry specific cover image
Hadoop in the Public Sector
Tom Plunkett
June 13, 2012

2. Tom Plunkett
• Big Data Technical Lead for Oracle Public Sector
• Led a Team that won a MapReduce Research
Project from the Office of the Secretary of Defense
in 2009
• Designed and taught a graduate level course on
MapReduce for Virginia Tech’s Computer Science
Department in 2010
• Author of a book on Oracle’s Big Data Products
(publication date in 2013)
Copyright © 2012 Oracle. All rights reserved.
2

3. Hadoop in the Public Sector
• Obama Administration Big Data Initiative
• U.S. Intelligence Agencies
• U.S. Department of Defense
• U.S. Civilian Departments and Agencies
• Other governmental entities
Copyright © 2012 Oracle. All rights reserved.
3

4. Obama Administration’s Big Data Initiative
• Office of Science and
Technology Policy
announced on March
29th, 2012 an additional
$200 million per year in
funding for Big Data
Research
• Department of Defense
currently spending over
$250 million a year on
Big Data Research
Copyright © 2012 Oracle. All rights reserved.
4

5. Several Projects Received $25 Million a
Year from the Obama Big Data Initiative
• DARPA XDATA
• NSF and NIH Core Techniques for Advancing Big
Data Science and Engineering
• NIH Thousand Genomes Project
• Department of Energy Scalable Data Management,
Analysis and Visualization Institute
• US Geological Survey Big Data for Earth Science
Copyright © 2012 Oracle. All rights reserved.
5

6. DARPA XDATA
• $25 million per year for four years for data
processing and visualization research
• Developed Software Code will be licensed
under Apache or similar license
• Proposals under the Broad Agency
Announcement were due May 30
• http://www.darpa.mil/NewsEvents/Releases/
2012/03/29.aspx
Copyright © 2012 Oracle. All rights reserved.
6

7. NSF and NIH: Core Techniques
for Advancing Big Data
• $25 million available for funding research
• Up to $1 million per year for five years for
data processing or visualization research;
proposals are due June 13 at 5pm
• Up to $250k per year for three years for data
processing or visualization research;
proposals are due July 11 at 5pm
• http://www.nsf.gov/news/news_summ.jsp?c
ntn_id=123607
Copyright © 2012 Oracle. All rights reserved.
7

8. NIH 1000 Genomes Project
• 200 TB public
dataset hosted on
Amazon S3 for free
• Dataset access is
free, Researchers
pay for AWS
computational
resources
• http://www.nih.gov/n
ews/health/mar2012/
nhgri-29.htm
Copyright © 2012 Oracle. All rights reserved.
8

9. Department of Energy Scalable Data
Management, Analysis and Visualization
Institute
• Received $25 million in funding for this year
• The SciDAC (Scientific Discovery through
Advanced Computing) Institute of Scalable Data
Management, Analysis and Visualization is funded
by the DOE Office of Science through the Office of
Advanced Scientific Computing Research.
• Research in Data Management, Data Analysis,
Visualization, and Scientific Software Tools
• http://sdav-scidac.org/
Copyright © 2012 Oracle. All rights reserved.
9

10. US Geological Survey
• The Powell Center of the US Geological Survey funds Big
Data research for Earth System Science
• The Powell Center provides annual research awards in the
area of Earth System Science
• Proposals for FY13 were due on April 30
• http://powellcenter.usgs.gov/
Copyright © 2012 Oracle. All rights reserved.
10

11. U.S. Intelligence Agencies
• NSA publicly
announced it
was using
Hadoop at a
NDU
conference
on July 15,
2009
• NSA donated
Accumulo
code in 2011
Copyright © 2012 Oracle. All rights reserved.
11

12. U.S. Army Distributed Common
Ground System (DCGS-A)
• Can predict
likely IED sites
based on
logistic routes
and past
attacks.
• http://ctovision.
com/2011/04/th
e-cloud-and-
physical-
security/
Copyright © 2012 Oracle. All rights reserved.
12

13. U.S. Naval Air V-22 Osprey
• US Naval Air Condition Based Maintenance (CBM+) for the
V-22 Osprey
• http://www.acq.osd.mil/log/mpp/cbm+/Briefings/CBM+_and
_CAMEO_Overview06Jul2011.pdf
• Photo source: wikipedia
Copyright © 2012 Oracle. All rights reserved.
13

14. U.S. Civilian Departments and Agencies
• Department of Homeland Security (DHS)
• Department of Energy(DOE)
• Department of Veteran Affairs
• Health and Human Services (HHS)
• Food and Drug Administration (FDA)
• National Archives and Records Admin
• NASA
• National Institute of Health (NIH)
• National Science Foundation (NSF)
• http://www.whitehouse.gov/sites/default/files/microsi
tes/ostp/big_data_fact_sheet_final.pdf
Copyright © 2012 Oracle. All rights reserved.
14

15. Other Governmental entities
• State and Local governments are looking at
Hadoop to solve problems involving Health,
Public Safety, and Traffic
• Foreign Governmental agencies are using
Hadoop in similar ways to their U.S.
counterparts (intelligence agencies, etc.)
• Tennessee Valley Authority uses HDFS to
store power utility information
• Many additional examples
Copyright © 2012 Oracle. All rights reserved.
15

16. Questions?
• Obama Administration’s Big Data Initiative
• U.S. Intelligence Agencies
• U.S. Department of Defense
• U.S. Civilian Departments and Agencies
• Other governmental entities
Copyright © 2012 Oracle. All rights reserved.
16

17. Oracle’s Big Data Platform
Big Data Database / Business
Data Warehouse Intelligence
InfiniBand InfiniBand
Real-Time
Decisions
Acquire Organize & Discover Analyze Decide
Copyright © 2012 Oracle. All rights reserved.