InfluxDB Roadmap: What’s New and What’s Coming

| © Copyright 2022, InfluxData
InfluxDB Roadmap:
What’s New &
What’s Coming?
Balaji Palani
Sr. Director, Product

Goal: Share
• What’s recently shipped in InfluxDB
• What’s coming soon in InfluxDB
2

InfluxDB 2.0: Brief History
3
WHEN
2019
Announced in May 2019, first production availability September 2019
WHAT
Open source software (OSS) and Cloud
One platform; One API; Secure, Durable, Highly available Multi-tenant Cloud
DIFFERENCE
Integrated UI; Integrated Task System; Flux; Official client libraries
Platform for developers of real time applications e.g. IoT, Analytics, Cloud services
BUSINESS MODEL
Usage and Subscription Model
Pay for what you use; Pay how you want. Credit card, annual contract
SINCE THEN
3 Cloud providers; 14 regions; Marketplace billing
Daily deploys; Robust pipeline of features delivered

Continual Steady Improvement
4
Development
Staging
Internal Production
External Production
GCP
AWS Azure
GCP
AWS GCP Azure
CI
Main
Code
Config
Tools
AWS
AWS GCP Azure
Azure
Argo

Who and What are we focused on?
5
Teams of Developers & Builders
Real time applications requiring time series data store
1. Developer Happiness
○ Make it easier for developers to build on
the platform
2.Time to Awesome
○ Enable developers to get their jobs done
faster
3.Scale, Reliability & Availability
○ Help developers scale, grow and bring more
workloads

Developer Happiness
6

Flux: Scripting + Query Language
7
A functional
scripting language
designed for
querying,
analyzing, and
acting on data.
Available Now

Query Analyze Act
Query (Timeseries, SQL, CSV) Math across measurements Conditional logic
Filtering Anomaly detection Checks
Aggregation Correlation Alerts / Notifications
Joins Downsampling Data output (HTTP, MQTT)
Pivot Custom Functions
Flux: What can you do?
8
Available Now

9
VSCode Flux Extension
Download this extension
from VScode Marketplace
(https://marketplace.visualstudio.com/items
?itemName=influxdata.flux)
Available Now

Templates, Secrets, Help
10
Available Now

Time to Awesome
11

/scripts/<transform>
/scripts/<downsample>
/scripts/<query>
Invokable Scripts
12
App /
Platform
Benefits:
1. Decoupling
a. Endpoints are decoupled from custom
Flux scripts.
b. App developers do not need to change
or recompile code
2. Democratization of data
a. Users don’t need to learn Flux to be
able to get personalized insights from
their data
b. Organizations can adopt InfluxDB more
widely within their organization
3. Security & Interoperability
a. Rapidly connect with other services
such as Node-Red, AWS Lambda, etc.
b. Block direct query execution by
exposing only the critical InfluxDB
endpoints you need.
Available Now

Invokable Scripts: Example
13
curl -X 'POST'
'base-url/api/v2/functions/<functionID>/invoke'
-H 'accept: application/json'
-H 'Content-Type: application/json'
-d '{ "params": {"mybucket":"telegraf"}}
params = { "mybucket": "airsensor" }
from(bucket:params.mybucket)
|> range(start: -1y)
|> limit(n:2)
Available Now

Create and Store Telegraf Config in
InfluxDB Cloud
14
Available Now

Telegraf Starlark Support
15
[[processors.starlark]]
source = '''
def apply(metric):
v = metric.fields.get('status')
if v == None:
return metric
if 1 < v and v < 6:
metric.fields['status'] = 0
return metric
Available Now

Scale, Reliability & Availability
16

17
Steady Improvements to Cloud Query Performance
since Formal Measuring Began November 2021
Available Now

Flux Debugging
18
Available Now

InfluxDB OSS at Edge
Edge Edge
Sensors
Gateway
19

InfluxDB Edge Data Replication
20
• Strategic orchestration of datasets across edge and cloud
• Unified, single source of truth for everyone in your org
• You decide where precision and fidelity is required
• Enables better visibility, alerting, analytics and data science
• Empowers optimized operations and collaboration
• Build new apps - for customers or the business
• Drive cost savings and revenue from new lines of business
Enables New Time Series Solutions
Hybrid Edge/Cloud Applications and Operations
Local/Remote Operations Global Visibility
Edge Edge
Cloud
Available Now

How Edge Data Replication Works?
21
API CLI
/api/v2/remotes influx remote [create,delete,list,update]
/api/v2/replications influx replication [create,delete,list,update]
Cloud (InfluxDB Cloud) Database(s)
Enables:
• Raw data replication
• Downsampling
• Eventual consistency
Build:
• Distributed databses
• Hybrid apps
• ML pipelines
Bucket Queue
Bucket Queue
Flux
Edge (InfluxDB OSS) Databases
Disk
Available Now

InfluxDB Enterprise 1.x Enhancements
22
InfluxDB 2.0 API compatibility endpoints
Regular updates to Flux library
Improvements to Backup and Restore
Migration tooling to help migrating workloads to Cloud (Support assisted)
Performance and Security Updates
Available Now

InfluxDB: What’s Coming
• Time to Awesome
• IOx: Next generation storage engine
23

Time to Awesome
24

Query Experience
Current pain:
• Limited ability to see schema or shape of
data in a bucket
• Lack of affordances in tool to show the best
ways to run queries against large datasets
• Lack of ability to save queries as scripts and
reuse them when needed
Solution:
• Query experience that starts with ability to
easily browse schema of buckets
• Built with performance and developer
productivity in mind
25
Roadmap: Next

Cloud Native Ingest (MQTT)
Current pain:
• Requires setting up Telegraf to send
and forward data from a cloud service
• Adds friction and complexity to the
evaluation and ramp-up process
Solution:
• Cloud - to - Cloud integration negating
the need for another agent to be
installed and configured.
• Common framework to support multiple
Cloud based services including MQTT,
Kafka etc.
26
Roadmap: Next

Multi-org
27
A single account can contain multiple organizations, in one or more regions. A single user
can switch between organizations within the account and/or switch accounts.
Roadmap: Next
ACCOUNT 1
ORG 2 A single IDPE region
One bill for all orgs

User Roles
• Currently, InfluxDB is designed for High Trust teams
• Many teams have requested a read only user role that allows
using the UI to query and view dashboards, but not risk
corrupting data or misconfiguration the application
• This feature will extend the existing multi-user functionality
28
Roadmap: Next

Developer Happiness
29

InfluxDB Triggers
30
Current pain:
• Need ability to fire off a notification as
soon as a condition (simple threshold
breach) is detected in the incoming data
stream
• Need to process data arriving late
(sometimes even days or weeks late)
Solution:
• Use events (Trigger) to send notifications
based on preset rules
• Events can be “write to a bucket”
Concept Illustration:
InfluxD
B Cloud
ACT
Triggers
WRITE
WRITE
TRIGGER
Roadmap: Next

IOx (Massive Scale)
Next Generation Storage Engine

Built on Modern Open Source Formats
32
Roadmap: Next

IOx Supports Multiple Languages
• Already supports SQL
• Already supports Flux, and Flux will be extended to take
advantage of IOx
• Already supports InfluxQL
33
Roadmap: Next

IOx Bulk Import/Export
• Single measurement at the file level
• The Parquet file format will make it easy to move time series
data between instances, including between OSS instances and
Cloud instances.
• Offline backups will be much easier.
34
Roadmap: Next

Unlock More Time Series Use Cases
• Metrics
• Events
• Tracing
• Logs
• Other high cardinality data
35
Roadmap: Next

36
THANK YOU
Balaji Palani
balaji@influxdata.com
www.influxdata.com

Get started on InfluxDB
37
Sign up
Influxdata.com
Via cloud marketplace
Learn
Self-service content
Documentation
InfluxDB University
Get InfluxDB

www.influxdata.com

InfluxDB Roadmap: What’s New and What’s Coming

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a InfluxDB Roadmap: What’s New and What’s Coming

Similar a InfluxDB Roadmap: What’s New and What’s Coming (20)

Más de InfluxData

Más de InfluxData (20)

Último

Último (20)

InfluxDB Roadmap: What’s New and What’s Coming