SlideShare a Scribd company logo
1 of 24
Download to read offline
June 2021
Russ Savage | Director of Product Management
Virtual Training:
Intro to InfluxDB
© 2021 InfluxData. All rights reserved.
2
Agenda
1. What is InfluxDB
2. Basic Concepts
3. Demo
© 2021 InfluxData. All rights reserved.
3
What is InfluxDB?
© 2021 InfluxData. All rights reserved.
4
A massive community of open source & cloud developers
• Self-starters
• Production teams
• Expect OSS & usage-based
models
• Industrial IoT
• End-user & consumer IoT
• Real-time analytics
• Networks & transactions
by cloud
by
language
& tool
Builders of Apps From Technical Ecosystems Use Case Focused
© 2021 InfluxData. All rights reserved.
5
Get started quickly
with more tools
• Rest API
• OSS integrations
• Cloud delivery
and less code.
A POWERFUL API & TOOL SET FOR BUILDING REAL-TIME APPS
Collect
using hundreds of
integrations &
OSS tools
Write/Query
in multiple
languages built for
real-time data
Abstract
using client
libraries for your
preferred language
Manage
applications &
account via the
developer console
INFLUXDATA API & TOOLS
DEVELOPER APPLICATIONS
Io
T
Transactions Analytics
© 2021 InfluxData. All rights reserved.
6
Run apps in
production with
absolute confidence
on the only
purpose-built time
series engine.
High Speed Ingest
via both batch &
streaming
Flexible Schema
learns & adapts
as it goes
High & Low
Fidelity
retention &
storage
Managed Functions
hosted in
the cloud
A HIGH-PERFORMANCE ENGINE TO HANDLE REAL-TIME
DATA WORKLOADS
INFLUXDATA API & TOOLS
INFLUXDATA REAL-TIME ENGINE
TIME SERIES
DATABASE
© 2021 InfluxData. All rights reserved.
7
INFLUXDB ENTERPRISE
Self Managed, High
Availability & Secure
priced per node
INFLUXDB
Open source
time series database.
High performing,
Schemaless, Smart
extraction of data (raw,
sliding, aggregates)
INFLUXDB EDGE
Extend your applications to
the IoT edge for real-time
insights in connected,
disconnected, or hybrid
environments.
INFLUXDB CLOUD
Elastic Serverless
Time Series as a Service
pay per use
INFLUXDB PLATFORM
PRODUCT OFFERINGS
© 2021 InfluxData. All rights reserved.
8
InfluxDB
Time Series
Platform
EMPOWERS DEVELOPERS
TO BUILD IOT,
ANALYTICS, &
MONITORING SOFTWARE.
– Designed for time series analysis
– Easy to share, easy to extend
– Multi data source
– Open Source (MIT license)
– Easy to get started, powerful to
scale
© 2021 InfluxData. All rights reserved.
9
Powerful APIs, Tools, & Ecosystem
Developers using the InfluxDB platform build their applications
with less effort, less code, and less configuration.
Unrestricted developer
productivity
Client and server
libraries in everything
from React, JavaScript,
Go, Python and more.
Get a head-start with
templates
Inspiring templates for
every use case. Easy to
create and share — find
what’s right for you.
Vibrant open source
community
A diverse and highly
motivated community,
making contributions in
code, & documentation.
Powerful & active
ecosystem
200+ Telegraf plugins,
integrations with
Grafana or data sources
like Google Bigtable.
© 2021 InfluxData. All rights reserved.
10
Current Data Acquisition - All Methods
Agent-based Push (aka Telegraf)
Agentless Pull (aka Scrapers)
Client Libraries
Native/Ecosystem
● 200+ Telegraf plugins
● Regular cadence of releases
● Why use it?
○ No code
○ Large community
○ Lightweight but powerful
○ Customizable
● Prometheus scraper (OSS only)
● Flux prometheus.from
● Flux csv.from(url)
● Why use them?
○ Get data in quickly
○ Doesn’t require agent downloads on
monitoring device
● 11 Libraries: Python, C#, Java, GO,
Javascript/Node.js, Ruby, PHP, Scala, Swift,
Kotlin, Arduino
● Handles batching, chunking, setting right
headers, etc.
● Why use them?
○ Easy way to get started
○ Need libraries when building custom
applications
● Source system speaks line protocol
● Examples: JMeter, NiFi, Vector, FluentD
● Influx CLI CSV Import
● Why use them?
○ Know what you want to monitor,
quick and easy integration
© 2021 InfluxData. All rights reserved.
11
InfluxData Platform Architecture
© 2021 InfluxData. All rights reserved.
12
Get InfluxDB
InfluxDB Cloud
https:/
/cloud2.influxdata.com/signup
Download OSS
https:/
/portal.influxdata.com/downloads/
© 2021 InfluxData. All rights reserved.
13
Using InfluxDB
© 2021 InfluxData. All rights reserved.
14
Concepts: Data Model
● Measurement
○ A name to a group of data at a high level
● Tag set
○ A set of key-value pairs to group data at a low level (values are strings)
● Field set
○ A set of key-value pairs to represent data (values are numerical & strings)
● Timestamp
○ Time of the data with nanosecond precision
● Series
○ A unique combination of measure+tags
© 2021 InfluxData. All rights reserved.
15
Data model vs ingestion & storage
Measurement
Tag set
Field set
Timestamp
Ingestion Storage
Series
Buckets
(set of series)
© 2021 InfluxData. All rights reserved.
16
Concepts: Time Series Database Schema
Data Ingestion Format
• Points are written to InfluxDB using the Line Protocol, which
follows the following format:
<measurement>[,<tag-key>=<tag-value>] [<field-key>=<field-value>]
[unix-nano-timestamp]
Reference: https://docs.influxdata.com/influxdb/v2.0/reference/syntax/line-protocol/
Tag Set
hostname=server02, us_west=az
Measurement
cpu_load
Field Set
temp=24.5, volts=7
Timestamp
1234567890000000
© 2021 InfluxData. All rights reserved.
17
Bucket physical view
● Columnar Data Stores
● Best for column selection and aggregation thanks to
- Disk and memory locality
- Cache locality
_time
1492...1
1492...0
_m
obs
obs
host
ovenB
ovenA
num
1
1
line
west
west
temp
301
125
humidity
23
75
_m=_measurment tags fields
© 2021 InfluxData. All rights reserved.
18
Schema Considerations
• Tags are indexed. Fields are not.
• Field Types are immutable
• Store data in tags if you plan to use them with GROUP BY()
• Store data in fields if you plan to use them with Flux function
• Store data in fields if you need them to be something other than a string
• The best schema depends primarily on what queries you want to run. At a high level: 
– You can't GROUP BY fields, only tags 
– You can't do math on tags or across measurements
– Queries that filter by tags are fast 
– Queries that filter by fields are slower 
– Be aware of series cardinality . . . It matters
Concepts: InfluxDB Schema Best Practices
© 2021 InfluxData. All rights reserved.
19
Series Cardinality
• The number of unique database, measurement, and tag set combinations in an InfluxDB
instance.
• For example, assume that an InfluxDB instance has a single database and one
measurement.
– The single measurement has two tag keys: email and status.
– If there are three different emails, and each email address is associated with two different statuses then the
series cardinality for the measurement is 6: (3 * 2 = 6)
Concepts: InfluxDB Schema Best Practices
email status
lorr@influxdata.com start
lorr@influxdata.com finish
marv@influxdata.com start
marv@influxdata.com finish
cliff@influxdata.com start
cliff@influxdata.com finish
Reference:
https://docs.influxdata.com/influxdb/v2.0/write-data/best-practices/resolve-high-cardinality/
© 2021 InfluxData. All rights reserved.
20
Series Cardinality Example
• Now imagine that a measurement has two tag keys: 
– containerId  and processId
– Each tag has 10,000 possibilities
– In this series cardinality for the measurement is 100,000,000 (10,000 x 10,000)
– Further let’s assume that each series takes up 1k in memory, that equates to 102.4GB of
RAM. . . you begin to see the problem
• We call this “Run-away series cardinality”
• Read more about this
– https://www.influxdata.com/blog/tldr-influxdb-tech-tips-monitoring-tasks-and-finding-th
e-source-of-runaway-cardinality/
– Index and Time-Structured Merge Tree (TSM) Overview in InfluxDB 1.5
Concepts: InfluxDB Schema Best Practices
© 2021 InfluxData. All rights reserved.
21
Introducing Flux
A functional data scripting language designed for querying, analyzing, and
acting on data. It is intended to be usable, readable, flexible, composable,
testable, contributable, and shareable.
“
I don't want to have to write query
code in one language and processing
code in another language.
– Paul Dix, CTO InfluxData
© 2021 InfluxData. All rights reserved.
22
Demo
© 2021 InfluxData. All rights reserved.
23
What’s Next
– Build an IoT application workshop | August 5, 2020
○ https://www.influxdata.com/resources/iot-center-workshop/
– Get your cloud account
○ And try InfluxDB Templates
– Check out
○ https://www.influxdata.com/products/influxdb-templates/gallery/
– Performance Tips
– Index and Time-Structured Merge Tree (TSM) Overview
– Integrations
○ https://docs.influxdata.com/telegraf/v1.18/
○ https://www.influxdata.com/products/integrations/
Thank You

More Related Content

What's hot

What's hot (20)

Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...
Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...
Timothy Spann [StreamNative] | Using FLaNK with InfluxDB for EdgeAI IoT at Sc...
 
Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA ...
Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA ...Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA ...
Tim Hall [InfluxData] | InfluxDays Keynote: InfluxDB Roadmap | InfluxDays NA ...
 
Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...
Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...
Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...
 
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...
 
InfluxDB Cloud Product Update
InfluxDB Cloud Product Update InfluxDB Cloud Product Update
InfluxDB Cloud Product Update
 
Getting Started: Intro to Telegraf - July 2021
Getting Started: Intro to Telegraf - July 2021Getting Started: Intro to Telegraf - July 2021
Getting Started: Intro to Telegraf - July 2021
 
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
 
Monitor Kubernetes in Rancher using InfluxData
Monitor Kubernetes in Rancher using InfluxDataMonitor Kubernetes in Rancher using InfluxData
Monitor Kubernetes in Rancher using InfluxData
 
Time Series Tech Stack for the IoT Edge
Time Series Tech Stack for the IoT EdgeTime Series Tech Stack for the IoT Edge
Time Series Tech Stack for the IoT Edge
 
Hari-Prasad Sudharshan [Fujitsu Network Communications] | ML-Based Data-Drive...
Hari-Prasad Sudharshan [Fujitsu Network Communications] | ML-Based Data-Drive...Hari-Prasad Sudharshan [Fujitsu Network Communications] | ML-Based Data-Drive...
Hari-Prasad Sudharshan [Fujitsu Network Communications] | ML-Based Data-Drive...
 
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
 
How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...
How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...
How to Deliver a Critical and Actionable Customer-Facing Metrics Product with...
 
Sensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxData
Sensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxDataSensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxData
Sensor Data in InfluxDB by David Simmons, IoT Developer Evangelist | InfluxData
 
Webinar Registration Getting Started with Building Your First IoT App
Webinar Registration Getting Started with Building Your First IoT AppWebinar Registration Getting Started with Building Your First IoT App
Webinar Registration Getting Started with Building Your First IoT App
 
InfluxDB + Telegraf Operator: Easy Kubernetes Monitoring
InfluxDB + Telegraf Operator: Easy Kubernetes MonitoringInfluxDB + Telegraf Operator: Easy Kubernetes Monitoring
InfluxDB + Telegraf Operator: Easy Kubernetes Monitoring
 
Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...
Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...
Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...
 
Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays...
Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays...Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays...
Tobias Braun [Herrenknecht AG] | Going Underground with InfluxDB | InfluxDays...
 
Evan Kaplan [InfluxData] | InfluxDays Opening Remarks | InfluxDays EMEA 2021
Evan Kaplan [InfluxData] | InfluxDays Opening Remarks | InfluxDays EMEA 2021Evan Kaplan [InfluxData] | InfluxDays Opening Remarks | InfluxDays EMEA 2021
Evan Kaplan [InfluxData] | InfluxDays Opening Remarks | InfluxDays EMEA 2021
 
How to Streamline Incident Response with InfluxDB, PagerDuty and Rundeck
How to Streamline Incident Response with InfluxDB, PagerDuty and RundeckHow to Streamline Incident Response with InfluxDB, PagerDuty and Rundeck
How to Streamline Incident Response with InfluxDB, PagerDuty and Rundeck
 
Ana-Maria Calin [InfluxData] | Migrating from OSS to InfluxDB Cloud | InfluxD...
Ana-Maria Calin [InfluxData] | Migrating from OSS to InfluxDB Cloud | InfluxD...Ana-Maria Calin [InfluxData] | Migrating from OSS to InfluxDB Cloud | InfluxD...
Ana-Maria Calin [InfluxData] | Migrating from OSS to InfluxDB Cloud | InfluxD...
 

Similar to Virtual training intro to InfluxDB - June 2021

Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
QAware GmbH
 

Similar to Virtual training intro to InfluxDB - June 2021 (20)

Intro to InfluxDB
Intro to InfluxDBIntro to InfluxDB
Intro to InfluxDB
 
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience NA 2020
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience NA 2020Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience NA 2020
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience NA 2020
 
Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...
Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...
Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...
 
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaIntro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
Intro to InfluxDB 2.0 and Your First Flux Query by Sonia Gupta
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product Training
 
RTI Connext 5.2.0
RTI Connext 5.2.0RTI Connext 5.2.0
RTI Connext 5.2.0
 
Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB: A Compre...
Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB: A Compre...Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB: A Compre...
Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB: A Compre...
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product Training
 
Data Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixData Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFix
 
TechTalk: Connext DDS 5.2.
TechTalk: Connext DDS 5.2.TechTalk: Connext DDS 5.2.
TechTalk: Connext DDS 5.2.
 
Jess Ingrassellino [InfluxData] | How to Get Data Into InfluxDB | InfluxDays ...
Jess Ingrassellino [InfluxData] | How to Get Data Into InfluxDB | InfluxDays ...Jess Ingrassellino [InfluxData] | How to Get Data Into InfluxDB | InfluxDays ...
Jess Ingrassellino [InfluxData] | How to Get Data Into InfluxDB | InfluxDays ...
 
OCCIware presentation at EclipseDay in Lyon, November 2017, by Marc Dutoo, Smile
OCCIware presentation at EclipseDay in Lyon, November 2017, by Marc Dutoo, SmileOCCIware presentation at EclipseDay in Lyon, November 2017, by Marc Dutoo, Smile
OCCIware presentation at EclipseDay in Lyon, November 2017, by Marc Dutoo, Smile
 
Model and pilot all cloud layers with OCCIware - Eclipse Day Lyon 2017
Model and pilot all cloud layers with OCCIware - Eclipse Day Lyon 2017Model and pilot all cloud layers with OCCIware - Eclipse Day Lyon 2017
Model and pilot all cloud layers with OCCIware - Eclipse Day Lyon 2017
 
Intro to Time Series
Intro to Time Series Intro to Time Series
Intro to Time Series
 
Docker Application to Scientific Computing
Docker Application to Scientific ComputingDocker Application to Scientific Computing
Docker Application to Scientific Computing
 
Kubernetes basics and hands on exercise
Kubernetes basics and hands on exerciseKubernetes basics and hands on exercise
Kubernetes basics and hands on exercise
 
OCCIware@CloudExpoLondon2017 - an extensible, standard XaaS Cloud consumer pl...
OCCIware@CloudExpoLondon2017 - an extensible, standard XaaS Cloud consumer pl...OCCIware@CloudExpoLondon2017 - an extensible, standard XaaS Cloud consumer pl...
OCCIware@CloudExpoLondon2017 - an extensible, standard XaaS Cloud consumer pl...
 
Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...
Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...
Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...
 
Samantha Wang [InfluxData] | Data Collection Overview | InfluxDays 2022
Samantha Wang [InfluxData] | Data Collection Overview | InfluxDays 2022Samantha Wang [InfluxData] | Data Collection Overview | InfluxDays 2022
Samantha Wang [InfluxData] | Data Collection Overview | InfluxDays 2022
 
Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)
 

More from InfluxData

How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
InfluxData
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
InfluxData
 

More from InfluxData (20)

Announcing InfluxDB Clustered
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB Clustered
 
Best Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow Ecosystem
 
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
 
Power Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDB
 
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
 
Build an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING Stack
 
Meet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using Rust
 
Introducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud DedicatedIntroducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud Dedicated
 
Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB
 
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
 
Introducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage EngineIntroducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage Engine
 
Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena
 
Understanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage EngineUnderstanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage Engine
 
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBStreamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
 
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
 
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
 

Recently uploaded

Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
Chandigarh Call girls 9053900678 Call girls in Chandigarh
 
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
dharasingh5698
 
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
@Chandigarh #call #Girls 9053900678 @Call #Girls in @Punjab 9053900678
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
Diya Sharma
 
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
nilamkumrai
 
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Recently uploaded (20)

Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl ServiceRussian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
 
VVVIP Call Girls In Connaught Place ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Connaught Place ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...VVVIP Call Girls In Connaught Place ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Connaught Place ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
 
Trump Diapers Over Dems t shirts Sweatshirt
Trump Diapers Over Dems t shirts SweatshirtTrump Diapers Over Dems t shirts Sweatshirt
Trump Diapers Over Dems t shirts Sweatshirt
 
Russian Call Girls Pune (Adult Only) 8005736733 Escort Service 24x7 Cash Pay...
Russian Call Girls Pune  (Adult Only) 8005736733 Escort Service 24x7 Cash Pay...Russian Call Girls Pune  (Adult Only) 8005736733 Escort Service 24x7 Cash Pay...
Russian Call Girls Pune (Adult Only) 8005736733 Escort Service 24x7 Cash Pay...
 
Katraj ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
Katraj ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...Katraj ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...
Katraj ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
 
Dubai Call Girls Milky O525547819 Call Girls Dubai Soft Dating
Dubai Call Girls Milky O525547819 Call Girls Dubai Soft DatingDubai Call Girls Milky O525547819 Call Girls Dubai Soft Dating
Dubai Call Girls Milky O525547819 Call Girls Dubai Soft Dating
 
Real Escorts in Al Nahda +971524965298 Dubai Escorts Service
Real Escorts in Al Nahda +971524965298 Dubai Escorts ServiceReal Escorts in Al Nahda +971524965298 Dubai Escorts Service
Real Escorts in Al Nahda +971524965298 Dubai Escorts Service
 
Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
Low Sexy Call Girls In Mohali 9053900678 🥵Have Save And Good Place 🥵
 
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Himatnagar 7001035870 Whatsapp Number, 24/07 Booking
 
WhatsApp 📞 8448380779 ✅Call Girls In Mamura Sector 66 ( Noida)
WhatsApp 📞 8448380779 ✅Call Girls In Mamura Sector 66 ( Noida)WhatsApp 📞 8448380779 ✅Call Girls In Mamura Sector 66 ( Noida)
WhatsApp 📞 8448380779 ✅Call Girls In Mamura Sector 66 ( Noida)
 
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
6.High Profile Call Girls In Punjab +919053900678 Punjab Call GirlHigh Profil...
 
VIP Model Call Girls NIBM ( Pune ) Call ON 8005736733 Starting From 5K to 25K...
VIP Model Call Girls NIBM ( Pune ) Call ON 8005736733 Starting From 5K to 25K...VIP Model Call Girls NIBM ( Pune ) Call ON 8005736733 Starting From 5K to 25K...
VIP Model Call Girls NIBM ( Pune ) Call ON 8005736733 Starting From 5K to 25K...
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
 
Moving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providersMoving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providers
 
(+971568250507 ))# Young Call Girls in Ajman By Pakistani Call Girls in ...
(+971568250507  ))#  Young Call Girls  in Ajman  By Pakistani Call Girls  in ...(+971568250507  ))#  Young Call Girls  in Ajman  By Pakistani Call Girls  in ...
(+971568250507 ))# Young Call Girls in Ajman By Pakistani Call Girls in ...
 
All Time Service Available Call Girls Mg Road 👌 ⏭️ 6378878445
All Time Service Available Call Girls Mg Road 👌 ⏭️ 6378878445All Time Service Available Call Girls Mg Road 👌 ⏭️ 6378878445
All Time Service Available Call Girls Mg Road 👌 ⏭️ 6378878445
 
Call Now ☎ 8264348440 !! Call Girls in Sarai Rohilla Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Sarai Rohilla Escort Service Delhi N.C.R.Call Now ☎ 8264348440 !! Call Girls in Sarai Rohilla Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Sarai Rohilla Escort Service Delhi N.C.R.
 
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
( Pune ) VIP Baner Call Girls 🎗️ 9352988975 Sizzling | Escorts | Girls Are Re...
 
Pune Airport ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready...
Pune Airport ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready...Pune Airport ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready...
Pune Airport ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready...
 
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Prashant Vihar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 

Virtual training intro to InfluxDB - June 2021

  • 1. June 2021 Russ Savage | Director of Product Management Virtual Training: Intro to InfluxDB
  • 2. © 2021 InfluxData. All rights reserved. 2 Agenda 1. What is InfluxDB 2. Basic Concepts 3. Demo
  • 3. © 2021 InfluxData. All rights reserved. 3 What is InfluxDB?
  • 4. © 2021 InfluxData. All rights reserved. 4 A massive community of open source & cloud developers • Self-starters • Production teams • Expect OSS & usage-based models • Industrial IoT • End-user & consumer IoT • Real-time analytics • Networks & transactions by cloud by language & tool Builders of Apps From Technical Ecosystems Use Case Focused
  • 5. © 2021 InfluxData. All rights reserved. 5 Get started quickly with more tools • Rest API • OSS integrations • Cloud delivery and less code. A POWERFUL API & TOOL SET FOR BUILDING REAL-TIME APPS Collect using hundreds of integrations & OSS tools Write/Query in multiple languages built for real-time data Abstract using client libraries for your preferred language Manage applications & account via the developer console INFLUXDATA API & TOOLS DEVELOPER APPLICATIONS Io T Transactions Analytics
  • 6. © 2021 InfluxData. All rights reserved. 6 Run apps in production with absolute confidence on the only purpose-built time series engine. High Speed Ingest via both batch & streaming Flexible Schema learns & adapts as it goes High & Low Fidelity retention & storage Managed Functions hosted in the cloud A HIGH-PERFORMANCE ENGINE TO HANDLE REAL-TIME DATA WORKLOADS INFLUXDATA API & TOOLS INFLUXDATA REAL-TIME ENGINE TIME SERIES DATABASE
  • 7. © 2021 InfluxData. All rights reserved. 7 INFLUXDB ENTERPRISE Self Managed, High Availability & Secure priced per node INFLUXDB Open source time series database. High performing, Schemaless, Smart extraction of data (raw, sliding, aggregates) INFLUXDB EDGE Extend your applications to the IoT edge for real-time insights in connected, disconnected, or hybrid environments. INFLUXDB CLOUD Elastic Serverless Time Series as a Service pay per use INFLUXDB PLATFORM PRODUCT OFFERINGS
  • 8. © 2021 InfluxData. All rights reserved. 8 InfluxDB Time Series Platform EMPOWERS DEVELOPERS TO BUILD IOT, ANALYTICS, & MONITORING SOFTWARE. – Designed for time series analysis – Easy to share, easy to extend – Multi data source – Open Source (MIT license) – Easy to get started, powerful to scale
  • 9. © 2021 InfluxData. All rights reserved. 9 Powerful APIs, Tools, & Ecosystem Developers using the InfluxDB platform build their applications with less effort, less code, and less configuration. Unrestricted developer productivity Client and server libraries in everything from React, JavaScript, Go, Python and more. Get a head-start with templates Inspiring templates for every use case. Easy to create and share — find what’s right for you. Vibrant open source community A diverse and highly motivated community, making contributions in code, & documentation. Powerful & active ecosystem 200+ Telegraf plugins, integrations with Grafana or data sources like Google Bigtable.
  • 10. © 2021 InfluxData. All rights reserved. 10 Current Data Acquisition - All Methods Agent-based Push (aka Telegraf) Agentless Pull (aka Scrapers) Client Libraries Native/Ecosystem ● 200+ Telegraf plugins ● Regular cadence of releases ● Why use it? ○ No code ○ Large community ○ Lightweight but powerful ○ Customizable ● Prometheus scraper (OSS only) ● Flux prometheus.from ● Flux csv.from(url) ● Why use them? ○ Get data in quickly ○ Doesn’t require agent downloads on monitoring device ● 11 Libraries: Python, C#, Java, GO, Javascript/Node.js, Ruby, PHP, Scala, Swift, Kotlin, Arduino ● Handles batching, chunking, setting right headers, etc. ● Why use them? ○ Easy way to get started ○ Need libraries when building custom applications ● Source system speaks line protocol ● Examples: JMeter, NiFi, Vector, FluentD ● Influx CLI CSV Import ● Why use them? ○ Know what you want to monitor, quick and easy integration
  • 11. © 2021 InfluxData. All rights reserved. 11 InfluxData Platform Architecture
  • 12. © 2021 InfluxData. All rights reserved. 12 Get InfluxDB InfluxDB Cloud https:/ /cloud2.influxdata.com/signup Download OSS https:/ /portal.influxdata.com/downloads/
  • 13. © 2021 InfluxData. All rights reserved. 13 Using InfluxDB
  • 14. © 2021 InfluxData. All rights reserved. 14 Concepts: Data Model ● Measurement ○ A name to a group of data at a high level ● Tag set ○ A set of key-value pairs to group data at a low level (values are strings) ● Field set ○ A set of key-value pairs to represent data (values are numerical & strings) ● Timestamp ○ Time of the data with nanosecond precision ● Series ○ A unique combination of measure+tags
  • 15. © 2021 InfluxData. All rights reserved. 15 Data model vs ingestion & storage Measurement Tag set Field set Timestamp Ingestion Storage Series Buckets (set of series)
  • 16. © 2021 InfluxData. All rights reserved. 16 Concepts: Time Series Database Schema Data Ingestion Format • Points are written to InfluxDB using the Line Protocol, which follows the following format: <measurement>[,<tag-key>=<tag-value>] [<field-key>=<field-value>] [unix-nano-timestamp] Reference: https://docs.influxdata.com/influxdb/v2.0/reference/syntax/line-protocol/ Tag Set hostname=server02, us_west=az Measurement cpu_load Field Set temp=24.5, volts=7 Timestamp 1234567890000000
  • 17. © 2021 InfluxData. All rights reserved. 17 Bucket physical view ● Columnar Data Stores ● Best for column selection and aggregation thanks to - Disk and memory locality - Cache locality _time 1492...1 1492...0 _m obs obs host ovenB ovenA num 1 1 line west west temp 301 125 humidity 23 75 _m=_measurment tags fields
  • 18. © 2021 InfluxData. All rights reserved. 18 Schema Considerations • Tags are indexed. Fields are not. • Field Types are immutable • Store data in tags if you plan to use them with GROUP BY() • Store data in fields if you plan to use them with Flux function • Store data in fields if you need them to be something other than a string • The best schema depends primarily on what queries you want to run. At a high level:  – You can't GROUP BY fields, only tags  – You can't do math on tags or across measurements – Queries that filter by tags are fast  – Queries that filter by fields are slower  – Be aware of series cardinality . . . It matters Concepts: InfluxDB Schema Best Practices
  • 19. © 2021 InfluxData. All rights reserved. 19 Series Cardinality • The number of unique database, measurement, and tag set combinations in an InfluxDB instance. • For example, assume that an InfluxDB instance has a single database and one measurement. – The single measurement has two tag keys: email and status. – If there are three different emails, and each email address is associated with two different statuses then the series cardinality for the measurement is 6: (3 * 2 = 6) Concepts: InfluxDB Schema Best Practices email status lorr@influxdata.com start lorr@influxdata.com finish marv@influxdata.com start marv@influxdata.com finish cliff@influxdata.com start cliff@influxdata.com finish Reference: https://docs.influxdata.com/influxdb/v2.0/write-data/best-practices/resolve-high-cardinality/
  • 20. © 2021 InfluxData. All rights reserved. 20 Series Cardinality Example • Now imagine that a measurement has two tag keys:  – containerId  and processId – Each tag has 10,000 possibilities – In this series cardinality for the measurement is 100,000,000 (10,000 x 10,000) – Further let’s assume that each series takes up 1k in memory, that equates to 102.4GB of RAM. . . you begin to see the problem • We call this “Run-away series cardinality” • Read more about this – https://www.influxdata.com/blog/tldr-influxdb-tech-tips-monitoring-tasks-and-finding-th e-source-of-runaway-cardinality/ – Index and Time-Structured Merge Tree (TSM) Overview in InfluxDB 1.5 Concepts: InfluxDB Schema Best Practices
  • 21. © 2021 InfluxData. All rights reserved. 21 Introducing Flux A functional data scripting language designed for querying, analyzing, and acting on data. It is intended to be usable, readable, flexible, composable, testable, contributable, and shareable. “ I don't want to have to write query code in one language and processing code in another language. – Paul Dix, CTO InfluxData
  • 22. © 2021 InfluxData. All rights reserved. 22 Demo
  • 23. © 2021 InfluxData. All rights reserved. 23 What’s Next – Build an IoT application workshop | August 5, 2020 ○ https://www.influxdata.com/resources/iot-center-workshop/ – Get your cloud account ○ And try InfluxDB Templates – Check out ○ https://www.influxdata.com/products/influxdb-templates/gallery/ – Performance Tips – Index and Time-Structured Merge Tree (TSM) Overview – Integrations ○ https://docs.influxdata.com/telegraf/v1.18/ ○ https://www.influxdata.com/products/integrations/