SlideShare una empresa de Scribd logo
1 de 32
Descargar para leer sin conexión
OpenStack
for Beginners
●
Electrical engineering student
●
Software engineering intern at
Red Hat
●
GNOME's Outreach Program for
Women participant
●
K-12 robotics and engineering mentor
●
Interested in free software, education,
●
python, and robots
Let's imagine...
 Research organization
 Large flow of data (20 TB a day)
 Analyze this data
 Data processing needs continued
increasing
 Require different computing needs
 Employees all over the world
 How do you handle that much data
and make it available to your
employees/collaborators world wide?
What is OpenStack?
 Set of software tools for building and
managing clouds.
 Manages compute, storage, and
networking resources from a single
point.
 Separated into projects which
communicate through public APIs
 Scalable
 Founded by NASA and Rackspace in
2010
Components (aka architecture):
CC BY-SA 3.0 Red Hat, Inc.
Nova (Compute)
➔
Manages and automates pools of computer resources
➔
Used for deploying and managing large numbers of virtual machines
and other instances to handle computing tasks
➔
Supports multiple hypervisors (software that creates virtual machines)
Cinder (Block Storage)
 Block storage (files are broken into little
pieces of data blocks so the disk can
store them) to guest virtual machines.
● The block storage system manages the
creation, attaching and detaching of
the block devices to servers.
 Data access speed is the most
important consideration.
 Create/delete/list volumes and
snapshots.
Glance (Image service)
➔
Manages "images" (virtual copies) of hard
disks and uses them as templates when
deploying new virtual machine instances.
➔
Configure, create, delete, and control
access to images
➔
Store and catalog an unlimited number of
backups
Swift (Object Storage)
● Distributed storage to prevent
any single point of failure
● API-accessible
● Containers
● Store VM images, backups, and archives
as well as smaller files, such as photos
and email messages
● Objects are referred by unique identifier
instead of location
Neutron (Networking)

System for managing networks and IP addresses

Provides networking models for different applications or
user groups

Relieve the stress on the network in cloud environments

Floating IP addresses allow traffic to be dynamically
rerouted to any of your compute resources

Extension framework that allows intrusion detection
systems (IDS), load balancing, firewalls and virtual private
networks (VPN)
Keystone (Identity)
➔ Central list of all of the users of the
OpenStack cloud, mapped against all of
the services provided by the cloud which
they have permission to use.
➔ Authentication & means of access
➔ Users, tenants, and roles
Admin powerz!
Other projects
➔
Ceiliometer (Telemetry)
– Provide efficient collection of metering
data, in terms of CPU and network costs
– Monitoring notifications sent from
existing services or by polling the
infrastructure
– Single Point Of Contact for billing
systems
➔
Trove (Database Service)
– Trove is a database-as-a-
service provisioning relational
and non-relational database
engines
Other projects
➔
Sahara (Data processing)
– Simple means to provision a
Hadoop cluster on OpenStack
– Analyze big data
➔
Heat (Orchestration)
– Heat is a service to orchestrate
multiple composite cloud
applications using templates
Other projects
Incubated:
➔
Marconi (Messaging)
➔
Ironic (Bare Metal)
➔
Barbican (Key management)
How do we access all these projects?
Horizon (Dashboard)
graphical Web-based dashboard
How is Openstack used?
● Web
● Ecommerce
● Research
● IT
● Healthcare
● Cloud hosting
● Film / Media / Gaming
● Yahoo
● Wikimedia
● US Department of
Energy
● Universities
● RackSpace
So..
 Research organization
 Large flow of data (20 TB a day)
 Analyze this data
 Data processing needs continued
increasing
 Require different computing needs
 Employees all over the world
 How do you handle that much data
and make it available to your
employees world wide?
CERN
● Home of the Large
Hydron Collider (27 km
circumference & 100
meters under the
ground)
● 10,000+ scientists
● Create particle
collisions (10 millions
of collisions every
second)
● Multistorey-high
digital cameras
records thousands of
images per second of
debris from the LHC
particle collision
● 35PB/year
● Physics all around the
world analyze data
CERN
● 10,000 servers, 75,000 disks, and 100
petabytes of data stored in mass-
storage systems
● 200 Gbp/s network
● Reached its power and cooling capacity
CERN
Data is saved to tape storage and
then distributed to the more than
150 sites worldwide that comprise
the Worldwide LHC (Large Hadron
Collider) Computing Grid (WLCG)
for analysis
CERN
● The CERN Worldwide LHC Computing Grid
(WLCG) is massive!
● Data is sent to its 12 Tier 1 sites around the
world
● 140+ Tier 2 sites used for creation of
simulated data and analysis. In all, CERN
mass-storage systems store more than 100
PB of data.
(1 petabyte = 1,000 terrabytes)
CERN
● Private cloud
● 65,000 cores across
multiple data
centers, supporting
multiple users
● ~1300 compute
nodes
● Configured with
Puppet
● Runs on nova,
glance, keystone,
neutron, ceilometer,
and horizon
● Ceph as storage for
glance, volumes,
and other physics
storage (3PB)
● Scientific Linux
CERN
● Dynamic allocation of network addresses
and register those with with network
management system.
● Implemented extensions for creating
DNS entries, Kerberos, and X.509
certificates
● Self-service
Paypal
● Processed $26,000+ in mobile payments
every minute in 2012.
● OpenStack runs virtual machines to support
self-service for developers
● OpenStack APIs have accelerated the
company’s development process by making
applications easier to implement and having
one consistent standard across their
environment.
Contributing!
Different ways to
contribute
– File bugs
– Translations
– Security
– Documentation
– UX
– Web maintenance
● Contributing Code
– Reviewing
– Bug fixes
– Housekeeping
● comments in code,
reducing pylint
violations, increasing
code coverage
– Development
● Blueprints
Contributing!
● Launchpad account
– Add an SSH key
● Join the OpenStack Foundation
– Vote in elections
– Run for elected positions
● Sign Contributor License Agreement
– Individual
– Government
– Corporate
Contributing!
● Code is hosted on github
● Git review
● Gerrit workflow
– Commit msgs
– Jenkin tests
– Reviews
Where can I learn more?
➔ OpenStack Community Newsletter
➔ opensource.com (/tags/openstack)
➔ OpenStack Summit videos
➔ Mailing lists, IRC, ask.openstack.org
➔ openstack.org/user-stories/
➔ User groups
More at cpallar.es/openstack101
Questions?

Más contenido relacionado

La actualidad más candente

Distributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudDistributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudIJERA Editor
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesKamesh Pemmaraju
 
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...DataStax
 
Try Cloud Spanner
Try Cloud SpannerTry Cloud Spanner
Try Cloud SpannerSimon Su
 
Big Data and its emergence
Big Data and its emergenceBig Data and its emergence
Big Data and its emergencekoolkalpz
 
A Travel Through Mesos
A Travel Through MesosA Travel Through Mesos
A Travel Through MesosDatio Big Data
 
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumann
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumannDSD-INT 2015 - Datacubes understanding big eo data better - Peter baumann
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumannDeltares
 
Traffic Matrices and its measurement
Traffic Matrices and its measurementTraffic Matrices and its measurement
Traffic Matrices and its measurementeetacupc
 
An Overview of Spanner: Google's Globally Distributed Database
An Overview of Spanner: Google's Globally Distributed DatabaseAn Overview of Spanner: Google's Globally Distributed Database
An Overview of Spanner: Google's Globally Distributed DatabaseBenjamin Bengfort
 
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...DataStax
 
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and AnalyticsDataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and AnalyticsDataStax Academy
 
ElasticSearch as (only) datastore
ElasticSearch as (only) datastoreElasticSearch as (only) datastore
ElasticSearch as (only) datastoreTomas Sirny
 
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...DataStax
 
Spark 计算模型
Spark 计算模型Spark 计算模型
Spark 计算模型wang xing
 
Apache spark - Spark's distributed programming model
Apache spark - Spark's distributed programming modelApache spark - Spark's distributed programming model
Apache spark - Spark's distributed programming modelMartin Zapletal
 
Big data distributed processing: Spark introduction
Big data distributed processing: Spark introductionBig data distributed processing: Spark introduction
Big data distributed processing: Spark introductionHektor Jacynycz García
 
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...Maciek Jozwiak
 
Hadoop: A distributed framework for Big Data
Hadoop: A distributed framework for Big DataHadoop: A distributed framework for Big Data
Hadoop: A distributed framework for Big DataDhanashri Yadav
 

La actualidad más candente (20)

Distributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudDistributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private Cloud
 
Apache cassandra
Apache cassandraApache cassandra
Apache cassandra
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference Architectures
 
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...
Cassandra Tools and Distributed Administration (Jeffrey Berger, Knewton) | C*...
 
Try Cloud Spanner
Try Cloud SpannerTry Cloud Spanner
Try Cloud Spanner
 
Big Data and its emergence
Big Data and its emergenceBig Data and its emergence
Big Data and its emergence
 
A Travel Through Mesos
A Travel Through MesosA Travel Through Mesos
A Travel Through Mesos
 
Matlab netcdf guide
Matlab netcdf guideMatlab netcdf guide
Matlab netcdf guide
 
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumann
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumannDSD-INT 2015 - Datacubes understanding big eo data better - Peter baumann
DSD-INT 2015 - Datacubes understanding big eo data better - Peter baumann
 
Traffic Matrices and its measurement
Traffic Matrices and its measurementTraffic Matrices and its measurement
Traffic Matrices and its measurement
 
An Overview of Spanner: Google's Globally Distributed Database
An Overview of Spanner: Google's Globally Distributed DatabaseAn Overview of Spanner: Google's Globally Distributed Database
An Overview of Spanner: Google's Globally Distributed Database
 
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...
SASI: Cassandra on the Full Text Search Ride (DuyHai DOAN, DataStax) | C* Sum...
 
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and AnalyticsDataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and Analytics
 
ElasticSearch as (only) datastore
ElasticSearch as (only) datastoreElasticSearch as (only) datastore
ElasticSearch as (only) datastore
 
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...
C* Keys: Partitioning, Clustering, & CrossFit (Adam Hutson, DataScale) | Cass...
 
Spark 计算模型
Spark 计算模型Spark 计算模型
Spark 计算模型
 
Apache spark - Spark's distributed programming model
Apache spark - Spark's distributed programming modelApache spark - Spark's distributed programming model
Apache spark - Spark's distributed programming model
 
Big data distributed processing: Spark introduction
Big data distributed processing: Spark introductionBig data distributed processing: Spark introduction
Big data distributed processing: Spark introduction
 
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...
Google Spanner - Synchronously-Replicated, Globally-Distributed, Multi-Versio...
 
Hadoop: A distributed framework for Big Data
Hadoop: A distributed framework for Big DataHadoop: A distributed framework for Big Data
Hadoop: A distributed framework for Big Data
 

Destacado

01 Welcome & Introductions - FCF 15th July 2014
01   Welcome & Introductions - FCF 15th July 201401   Welcome & Introductions - FCF 15th July 2014
01 Welcome & Introductions - FCF 15th July 2014#TheFraudTube
 
FCF June 2014 - 04 evolving our forum
  FCF June 2014 - 04   evolving our forum  FCF June 2014 - 04   evolving our forum
FCF June 2014 - 04 evolving our forum#TheFraudTube
 
FCF 5th Feb 2015 01 - Welcome & Introductions
FCF 5th Feb 2015 01 - Welcome & IntroductionsFCF 5th Feb 2015 01 - Welcome & Introductions
FCF 5th Feb 2015 01 - Welcome & Introductions#TheFraudTube
 
บริการต่างๆบนอินเตอร์เน็ต
บริการต่างๆบนอินเตอร์เน็ตบริการต่างๆบนอินเตอร์เน็ต
บริการต่างๆบนอินเตอร์เน็ตkanyanun
 
FCF 5th Feb 2015 03 - Local Authority Fraud
FCF 5th Feb 2015 03 - Local Authority FraudFCF 5th Feb 2015 03 - Local Authority Fraud
FCF 5th Feb 2015 03 - Local Authority Fraud#TheFraudTube
 
Belajar membuat data base
Belajar membuat data baseBelajar membuat data base
Belajar membuat data baseandre_2
 
FCF June 2014 - 01 news & updates
 FCF June 2014 -  01   news & updates FCF June 2014 -  01   news & updates
FCF June 2014 - 01 news & updates#TheFraudTube
 
06 Minutes - FCF May 2014
06   Minutes - FCF May 201406   Minutes - FCF May 2014
06 Minutes - FCF May 2014#TheFraudTube
 
Protocolo latinoamericanodeinvestigacion
Protocolo latinoamericanodeinvestigacionProtocolo latinoamericanodeinvestigacion
Protocolo latinoamericanodeinvestigacionAlejandra Godoy
 
05 Identity Theft (C6)
05   Identity Theft (C6)05   Identity Theft (C6)
05 Identity Theft (C6)#TheFraudTube
 
Bridges new
Bridges newBridges new
Bridges newagtom02
 
Poison ivy and probability
Poison ivy and probabilityPoison ivy and probability
Poison ivy and probabilityprperkins78
 
04 A-Z of Fraud & Cybercrime (Workshop)
04   A-Z of Fraud & Cybercrime (Workshop)04   A-Z of Fraud & Cybercrime (Workshop)
04 A-Z of Fraud & Cybercrime (Workshop)#TheFraudTube
 

Destacado (18)

01 Welcome & Introductions - FCF 15th July 2014
01   Welcome & Introductions - FCF 15th July 201401   Welcome & Introductions - FCF 15th July 2014
01 Welcome & Introductions - FCF 15th July 2014
 
FCF June 2014 - 04 evolving our forum
  FCF June 2014 - 04   evolving our forum  FCF June 2014 - 04   evolving our forum
FCF June 2014 - 04 evolving our forum
 
FCF 5th Feb 2015 01 - Welcome & Introductions
FCF 5th Feb 2015 01 - Welcome & IntroductionsFCF 5th Feb 2015 01 - Welcome & Introductions
FCF 5th Feb 2015 01 - Welcome & Introductions
 
บริการต่างๆบนอินเตอร์เน็ต
บริการต่างๆบนอินเตอร์เน็ตบริการต่างๆบนอินเตอร์เน็ต
บริการต่างๆบนอินเตอร์เน็ต
 
FCF 5th Feb 2015 03 - Local Authority Fraud
FCF 5th Feb 2015 03 - Local Authority FraudFCF 5th Feb 2015 03 - Local Authority Fraud
FCF 5th Feb 2015 03 - Local Authority Fraud
 
Belajar membuat data base
Belajar membuat data baseBelajar membuat data base
Belajar membuat data base
 
Valyrion 4
Valyrion 4Valyrion 4
Valyrion 4
 
FCF June 2014 - 01 news & updates
 FCF June 2014 -  01   news & updates FCF June 2014 -  01   news & updates
FCF June 2014 - 01 news & updates
 
Mis sueños restrepo
Mis sueños restrepoMis sueños restrepo
Mis sueños restrepo
 
06 Minutes - FCF May 2014
06   Minutes - FCF May 201406   Minutes - FCF May 2014
06 Minutes - FCF May 2014
 
Ejercicios matematica
Ejercicios matematicaEjercicios matematica
Ejercicios matematica
 
09 pdf show-240
09   pdf show-24009   pdf show-240
09 pdf show-240
 
Protocolo latinoamericanodeinvestigacion
Protocolo latinoamericanodeinvestigacionProtocolo latinoamericanodeinvestigacion
Protocolo latinoamericanodeinvestigacion
 
05 Identity Theft (C6)
05   Identity Theft (C6)05   Identity Theft (C6)
05 Identity Theft (C6)
 
Sopladores ventiladores
Sopladores ventiladoresSopladores ventiladores
Sopladores ventiladores
 
Bridges new
Bridges newBridges new
Bridges new
 
Poison ivy and probability
Poison ivy and probabilityPoison ivy and probability
Poison ivy and probability
 
04 A-Z of Fraud & Cybercrime (Workshop)
04   A-Z of Fraud & Cybercrime (Workshop)04   A-Z of Fraud & Cybercrime (Workshop)
04 A-Z of Fraud & Cybercrime (Workshop)
 

Similar a Openstack For Beginners

Using the Open Science Data Cloud for Data Science Research
Using the Open Science Data Cloud for Data Science ResearchUsing the Open Science Data Cloud for Data Science Research
Using the Open Science Data Cloud for Data Science ResearchRobert Grossman
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyPeter Clapham
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningDataWorks Summit
 
Hadoop and OpenStack - Hadoop Summit San Jose 2014
Hadoop and OpenStack - Hadoop Summit San Jose 2014Hadoop and OpenStack - Hadoop Summit San Jose 2014
Hadoop and OpenStack - Hadoop Summit San Jose 2014spinningmatt
 
Cisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackCisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy
 
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...inside-BigData.com
 
Walk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCWalk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCCeph Community
 
What is OpenStack and the added value of IBM solutions
What is OpenStack and the added value of IBM solutionsWhat is OpenStack and the added value of IBM solutions
What is OpenStack and the added value of IBM solutionsSasha Lazarevic
 
What Are Science Clouds?
What Are Science Clouds?What Are Science Clouds?
What Are Science Clouds?Robert Grossman
 
Open stack
Open stackOpen stack
Open stacksvm
 
Scientific
Scientific Scientific
Scientific marpierc
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCObject Automation
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systemsinside-BigData.com
 
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...OpenStack
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceObject Automation
 
Big Data_Architecture.pptx
Big Data_Architecture.pptxBig Data_Architecture.pptx
Big Data_Architecture.pptxbetalab
 
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...NETWAYS
 
Big data and hadoop
Big data and hadoopBig data and hadoop
Big data and hadoopMohit Tare
 
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageWebinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc
 

Similar a Openstack For Beginners (20)

Using the Open Science Data Cloud for Data Science Research
Using the Open Science Data Cloud for Data Science ResearchUsing the Open Science Data Cloud for Data Science Research
Using the Open Science Data Cloud for Data Science Research
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journey
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learning
 
Hadoop and OpenStack
Hadoop and OpenStackHadoop and OpenStack
Hadoop and OpenStack
 
Hadoop and OpenStack - Hadoop Summit San Jose 2014
Hadoop and OpenStack - Hadoop Summit San Jose 2014Hadoop and OpenStack - Hadoop Summit San Jose 2014
Hadoop and OpenStack - Hadoop Summit San Jose 2014
 
Cisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStackCisco: Cassandra adoption on Cisco UCS & OpenStack
Cisco: Cassandra adoption on Cisco UCS & OpenStack
 
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
 
Walk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoCWalk Through a Software Defined Everything PoC
Walk Through a Software Defined Everything PoC
 
What is OpenStack and the added value of IBM solutions
What is OpenStack and the added value of IBM solutionsWhat is OpenStack and the added value of IBM solutions
What is OpenStack and the added value of IBM solutions
 
What Are Science Clouds?
What Are Science Clouds?What Are Science Clouds?
What Are Science Clouds?
 
Open stack
Open stackOpen stack
Open stack
 
Scientific
Scientific Scientific
Scientific
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPC
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systems
 
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...
Building a GPU-enabled OpenStack Cloud for HPC - Blair Bethwaite, Monash Univ...
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
 
Big Data_Architecture.pptx
Big Data_Architecture.pptxBig Data_Architecture.pptx
Big Data_Architecture.pptx
 
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...
 
Big data and hadoop
Big data and hadoopBig data and hadoop
Big data and hadoop
 
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageWebinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
 

Último

Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 

Último (20)

Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

Openstack For Beginners

  • 2. ● Electrical engineering student ● Software engineering intern at Red Hat ● GNOME's Outreach Program for Women participant ● K-12 robotics and engineering mentor ● Interested in free software, education, ● python, and robots
  • 3. Let's imagine...  Research organization  Large flow of data (20 TB a day)  Analyze this data  Data processing needs continued increasing  Require different computing needs  Employees all over the world  How do you handle that much data and make it available to your employees/collaborators world wide?
  • 4. What is OpenStack?  Set of software tools for building and managing clouds.  Manages compute, storage, and networking resources from a single point.  Separated into projects which communicate through public APIs  Scalable  Founded by NASA and Rackspace in 2010
  • 5. Components (aka architecture): CC BY-SA 3.0 Red Hat, Inc.
  • 6. Nova (Compute) ➔ Manages and automates pools of computer resources ➔ Used for deploying and managing large numbers of virtual machines and other instances to handle computing tasks ➔ Supports multiple hypervisors (software that creates virtual machines)
  • 7. Cinder (Block Storage)  Block storage (files are broken into little pieces of data blocks so the disk can store them) to guest virtual machines. ● The block storage system manages the creation, attaching and detaching of the block devices to servers.  Data access speed is the most important consideration.  Create/delete/list volumes and snapshots.
  • 8. Glance (Image service) ➔ Manages "images" (virtual copies) of hard disks and uses them as templates when deploying new virtual machine instances. ➔ Configure, create, delete, and control access to images ➔ Store and catalog an unlimited number of backups
  • 9. Swift (Object Storage) ● Distributed storage to prevent any single point of failure ● API-accessible ● Containers ● Store VM images, backups, and archives as well as smaller files, such as photos and email messages ● Objects are referred by unique identifier instead of location
  • 10. Neutron (Networking)  System for managing networks and IP addresses  Provides networking models for different applications or user groups  Relieve the stress on the network in cloud environments  Floating IP addresses allow traffic to be dynamically rerouted to any of your compute resources  Extension framework that allows intrusion detection systems (IDS), load balancing, firewalls and virtual private networks (VPN)
  • 11. Keystone (Identity) ➔ Central list of all of the users of the OpenStack cloud, mapped against all of the services provided by the cloud which they have permission to use. ➔ Authentication & means of access ➔ Users, tenants, and roles Admin powerz!
  • 12. Other projects ➔ Ceiliometer (Telemetry) – Provide efficient collection of metering data, in terms of CPU and network costs – Monitoring notifications sent from existing services or by polling the infrastructure – Single Point Of Contact for billing systems ➔ Trove (Database Service) – Trove is a database-as-a- service provisioning relational and non-relational database engines
  • 13. Other projects ➔ Sahara (Data processing) – Simple means to provision a Hadoop cluster on OpenStack – Analyze big data ➔ Heat (Orchestration) – Heat is a service to orchestrate multiple composite cloud applications using templates
  • 14. Other projects Incubated: ➔ Marconi (Messaging) ➔ Ironic (Bare Metal) ➔ Barbican (Key management) How do we access all these projects?
  • 16.
  • 17. How is Openstack used? ● Web ● Ecommerce ● Research ● IT ● Healthcare ● Cloud hosting ● Film / Media / Gaming ● Yahoo ● Wikimedia ● US Department of Energy ● Universities ● RackSpace
  • 18. So..  Research organization  Large flow of data (20 TB a day)  Analyze this data  Data processing needs continued increasing  Require different computing needs  Employees all over the world  How do you handle that much data and make it available to your employees world wide?
  • 19. CERN ● Home of the Large Hydron Collider (27 km circumference & 100 meters under the ground) ● 10,000+ scientists ● Create particle collisions (10 millions of collisions every second) ● Multistorey-high digital cameras records thousands of images per second of debris from the LHC particle collision ● 35PB/year ● Physics all around the world analyze data
  • 20. CERN ● 10,000 servers, 75,000 disks, and 100 petabytes of data stored in mass- storage systems ● 200 Gbp/s network ● Reached its power and cooling capacity
  • 21. CERN Data is saved to tape storage and then distributed to the more than 150 sites worldwide that comprise the Worldwide LHC (Large Hadron Collider) Computing Grid (WLCG) for analysis
  • 22. CERN ● The CERN Worldwide LHC Computing Grid (WLCG) is massive! ● Data is sent to its 12 Tier 1 sites around the world ● 140+ Tier 2 sites used for creation of simulated data and analysis. In all, CERN mass-storage systems store more than 100 PB of data. (1 petabyte = 1,000 terrabytes)
  • 23. CERN ● Private cloud ● 65,000 cores across multiple data centers, supporting multiple users ● ~1300 compute nodes ● Configured with Puppet ● Runs on nova, glance, keystone, neutron, ceilometer, and horizon ● Ceph as storage for glance, volumes, and other physics storage (3PB) ● Scientific Linux
  • 24. CERN ● Dynamic allocation of network addresses and register those with with network management system. ● Implemented extensions for creating DNS entries, Kerberos, and X.509 certificates ● Self-service
  • 25. Paypal ● Processed $26,000+ in mobile payments every minute in 2012. ● OpenStack runs virtual machines to support self-service for developers ● OpenStack APIs have accelerated the company’s development process by making applications easier to implement and having one consistent standard across their environment.
  • 26. Contributing! Different ways to contribute – File bugs – Translations – Security – Documentation – UX – Web maintenance ● Contributing Code – Reviewing – Bug fixes – Housekeeping ● comments in code, reducing pylint violations, increasing code coverage – Development ● Blueprints
  • 27. Contributing! ● Launchpad account – Add an SSH key ● Join the OpenStack Foundation – Vote in elections – Run for elected positions ● Sign Contributor License Agreement – Individual – Government – Corporate
  • 28. Contributing! ● Code is hosted on github ● Git review ● Gerrit workflow – Commit msgs – Jenkin tests – Reviews
  • 29.
  • 30.
  • 31. Where can I learn more? ➔ OpenStack Community Newsletter ➔ opensource.com (/tags/openstack) ➔ OpenStack Summit videos ➔ Mailing lists, IRC, ask.openstack.org ➔ openstack.org/user-stories/ ➔ User groups More at cpallar.es/openstack101