SlideShare una empresa de Scribd logo
1 de 48
Descargar para leer sin conexión
Has serverless
adoption hit a
roadblock?
Veselin Pizurica
Founder & CTO
14 April 2021
Serverless promise.
What is Low Code?
Low-code development is a promise that developers can use a platform to code at
a very fast pace, with minimal setup effort and quick deployment.
It reduces the complexity of the application development process.
The basic building block of the Low Code platform should be a small snippet of
code, which like a lego brick is reusable across different use cases.
Serverless as a new Cloud paradigm
When lambda hit the mainstream, it was widely accepted that it was the best
candidate for that low code lego brick.
Where serverless works well
Data ML pipelines, batch processing, etc … It works and it is great!
Web applications (REST CRUD)? Probably still fine.
When things go south - Spaghetti code 4.0
What is the Industry saying?
Two different impediments hampering serverless adoption:
● Architecture complexity: tracing, observability, debugging, deployment etc...
● Fear: fear of losing control, fear of vendor lock in, fear of weak security,
unpredictable cost etc...
Source: O’Reilly serverless survey, Concerns, what works, and what to expect
What are we saying?
More than one roadblock, this talk is about the one not in the list!
Source: O’Reilly serverless survey, Concerns, what works, and what to expect
Serverless or not?
● Serverless promise:
○ Small snippets of code
○ Infinite scale
○ Separation of responsibilities (experts, IT
folks, Devops, ML folks, solution architects
etc…)
○ Easy to develop - Really?
○ Easy to deploy - Really?
○ Easy to support in production - Really?
● “LAMP” (django, rails, express, laravel …)
○ Easy to implement, deploy and support
○ Use laptop, any IAAS stack or “on prem” HW
Who is the guilty one?
Lambda calculus
If things are so simple, why we struggle with these things?
Are we fixing symptoms or the cause?
A Berkeley View on Serverless Computing
Link to paper
From the Berkley paper 1/3
From the Berkley paper 2/3
From the Berkley paper 3/3
Functions and entities in serverless?
If functions are “do it” calls who keeps the relation between entities?
● DynamoDB? (NoSQL ...)
● Digital twin? (entity centric)
● GraphQL? (graph centric)
● SPARQL? (ontology, semantics, ….)
● x_SQL? (relationship centric)
All we need is Orchestrator
AWS Step Functions - Finite State Machine
Azure Logic Apps - Flow Engine
GCP workflows
Challenge - OT/IT Convergence
Finite State Machines orchestrator?
FSM is a stock market in reverse: a small front door entry to a big theater.
You can’t process more than one event at the same time.
FSM for workflows, ticket handling, BPM, response on highly correlated triggers
(events), but not for data stream(s)!
Flow engine orchestrator?
Can anyone grasp what is going on here?
Interpretability, decision/control flow, stream merging etc…
Batch processing - pipelines
IoT stream IoT Hub Store
IoT Device
● Data
● Commands
● Config
Reports (BI)
Analytics ...
Digital Twin API’s
Other systems
(data)
data
Offline analytics approach with Lambda
IoT stream IoT Hub
IoT Device
● Data
● Commands
● Config
ML models
Digital Twin
Batch
processing
Store
triggers
Lambdas
Process flow
API’s
Other systems
(data)
data
Stream analytics & Lambda & Orchestrator
IoT stream IoT Hub
Store
IoT Device
● Data
● Commands
● Config
Reports (BI)
Analytics ...
Digital Twin API’s
Other systems
(data)
Stream query/filter
Lambdas
AWS step
functions,
Google Workflow
Rule1 is here!
Rule2 is here!
data
Stream processing with Lambda/Flow Engines & Orchestrator
IoT stream IoT Hub
IoT Device
● Data
● Commands
● Config
Digital Twin API’s
Other systems
(data)
Lambdas,
Flow Engines
AWS step
functions,
Google Workflow
Rule is here! How fast?
data
Rule2 is here!
fanout
OT/IT Convergence dilemma
● Choice1: Rules with S3/lambda: Lambda fanout,
who knows what is happening? It is great for batch
processing, but not more than that.
● Choice2: Stream analytics (rule 1) followed by
Orchestrator (rule 2): How to add new rules, mix
API’s and other sources?
● Choice3: Orchestrator (Flow) tapping into the
stream directly (queue or not doesn’t matter): How
fast this can be? Who adds rules and to which
particular type of a device? How to add new rules,
mix API’s and streams from different devices and
then use other REST sources?
Automation is a star topology
Automation requires constant connections to:
● Stream data
● Time series (historical) data
● Anomaly detection/prediction models
● Meta model (digital twins, relations etc.)
● ERP (IT) systems
● Notifications (email, SMS, calls …)
● ML (REST)
● API (external services)
Data
streams
Historical data
APIs
Predictions
DTwin
Alarms
ERP
Anomalies
All we need is a STAR Orchestrator
Automation Benchmarks
https://www.waylay.io/platform/benchmark
Waylay Engine is the best of two worlds: can ingest and merge data streams, while
at the same time it is as good as Finite State Machine in the logic interpretation.
Waylay IO Automation Engine
https://www.youtube.com/watch?v=NBT8UskyFYQ
We are on the mission.
An “Apple” like developers experience
Waylay IO mission is to bring Apple experiences to the developers community.
Waylay’s mission
Waylay IO Low Code Platform
● Low-code portal that simplifies development and deployment
● Easy integration of API enabled services
● AI/ML deployment without tears
● Excellent debugging and observability
● All necessary tools in one place
● From development to production in “no time”
● Built-in state of the art security similar to Auth0
● No setup, nothing to manage
● Pay-Per-Use: you only pay for consumption
Waylay supports (and pay for) OPEN source!
Waylay platform is built on top of open source cloud agnostic services, without
dependencies on any specific cloud provider (Open FAAS, Kafka, Cassandra, Elastic,
Mongo, Redis…)
Waylay IO Low Code Platform
https://docs-io.waylay.io/
Stream processing and lambdas?
Orchestrator can also be a container (in memory) for lambdas, why not?
API (lambda) fanout, that is fine
Inference
“In memory” lambdas
events
DTwin
Streams and DTwin
data - real time
injection
Does Lambda need to be an external “RPC” call?
Native ”functions”: 90% ~.02ns execution time. That’s the speed you need for
stream processing! No need to run “external” lambdas + RTT penalty.
Example Salesforce Digital Twin
Data ingestion
Stream processing
Application
Rules
API fanout
The ENGIE Smart Cabin solution
https://www.engie.be/en/business/reliability-security/high-voltage-cabin/smart-cabin/
Why not expressing relations in the rule?
objects
Rule 2
Rule 1
Rule 3
relations
relations
AI/ML models - from jupyter to deployment in seconds
ML model
data
Low code snippet
Waylay IO launch.
Just get it done!
Discover Waylay IO,
the first low-code automation platform.

Más contenido relacionado

La actualidad más candente

Python Quiz Questions.docx
Python Quiz Questions.docxPython Quiz Questions.docx
Python Quiz Questions.docxRMani7
 
#MSDEVMTL Introduction à #SonarQube
#MSDEVMTL Introduction à #SonarQube#MSDEVMTL Introduction à #SonarQube
#MSDEVMTL Introduction à #SonarQubeVincent Biret
 
Terraform Best Practices - DevOps Unicorns 2019
Terraform Best Practices - DevOps Unicorns 2019Terraform Best Practices - DevOps Unicorns 2019
Terraform Best Practices - DevOps Unicorns 2019Anton Babenko
 
Ship Faster, Reduce Risk, and Build Scale with Feature Flags
Ship Faster, Reduce Risk, and Build Scale with Feature FlagsShip Faster, Reduce Risk, and Build Scale with Feature Flags
Ship Faster, Reduce Risk, and Build Scale with Feature FlagsAtlassian
 
Azure DevOps Presentation
Azure DevOps PresentationAzure DevOps Presentation
Azure DevOps PresentationInCycleSoftware
 
DevOpsDays Taipei 2019 - Mastering IaC the DevOps Way
DevOpsDays Taipei 2019 - Mastering IaC the DevOps WayDevOpsDays Taipei 2019 - Mastering IaC the DevOps Way
DevOpsDays Taipei 2019 - Mastering IaC the DevOps Waysmalltown
 
Introducing Saga Pattern in Microservices with Spring Statemachine
Introducing Saga Pattern in Microservices with Spring StatemachineIntroducing Saga Pattern in Microservices with Spring Statemachine
Introducing Saga Pattern in Microservices with Spring StatemachineVMware Tanzu
 
Java multi threading
Java multi threadingJava multi threading
Java multi threadingRaja Sekhar
 
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...GetInData
 
Designing a complete ci cd pipeline using argo events, workflow and cd products
Designing a complete ci cd pipeline using argo events, workflow and cd productsDesigning a complete ci cd pipeline using argo events, workflow and cd products
Designing a complete ci cd pipeline using argo events, workflow and cd productsJulian Mazzitelli
 
GitOps with ArgoCD
GitOps with ArgoCDGitOps with ArgoCD
GitOps with ArgoCDCloudOps2005
 
Test and Behaviour Driven Development (TDD/BDD)
Test and Behaviour Driven Development (TDD/BDD)Test and Behaviour Driven Development (TDD/BDD)
Test and Behaviour Driven Development (TDD/BDD)Lars Thorup
 
Introduction to Terraform Enterprise
Introduction to Terraform EnterpriseIntroduction to Terraform Enterprise
Introduction to Terraform EnterpriseCarlos Nunez
 
OpenStack and MySQL
OpenStack and MySQLOpenStack and MySQL
OpenStack and MySQLMatt Lord
 
Intro to Helm for Kubernetes
Intro to Helm for KubernetesIntro to Helm for Kubernetes
Intro to Helm for KubernetesCarlos E. Salazar
 
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...HostedbyConfluent
 

La actualidad más candente (20)

Docker & kubernetes
Docker & kubernetesDocker & kubernetes
Docker & kubernetes
 
Python Quiz Questions.docx
Python Quiz Questions.docxPython Quiz Questions.docx
Python Quiz Questions.docx
 
#MSDEVMTL Introduction à #SonarQube
#MSDEVMTL Introduction à #SonarQube#MSDEVMTL Introduction à #SonarQube
#MSDEVMTL Introduction à #SonarQube
 
Quartz Scheduler
Quartz SchedulerQuartz Scheduler
Quartz Scheduler
 
Terraform Best Practices - DevOps Unicorns 2019
Terraform Best Practices - DevOps Unicorns 2019Terraform Best Practices - DevOps Unicorns 2019
Terraform Best Practices - DevOps Unicorns 2019
 
Ship Faster, Reduce Risk, and Build Scale with Feature Flags
Ship Faster, Reduce Risk, and Build Scale with Feature FlagsShip Faster, Reduce Risk, and Build Scale with Feature Flags
Ship Faster, Reduce Risk, and Build Scale with Feature Flags
 
Azure DevOps Presentation
Azure DevOps PresentationAzure DevOps Presentation
Azure DevOps Presentation
 
DevOpsDays Taipei 2019 - Mastering IaC the DevOps Way
DevOpsDays Taipei 2019 - Mastering IaC the DevOps WayDevOpsDays Taipei 2019 - Mastering IaC the DevOps Way
DevOpsDays Taipei 2019 - Mastering IaC the DevOps Way
 
Introducing Saga Pattern in Microservices with Spring Statemachine
Introducing Saga Pattern in Microservices with Spring StatemachineIntroducing Saga Pattern in Microservices with Spring Statemachine
Introducing Saga Pattern in Microservices with Spring Statemachine
 
Java multi threading
Java multi threadingJava multi threading
Java multi threading
 
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
 
Designing a complete ci cd pipeline using argo events, workflow and cd products
Designing a complete ci cd pipeline using argo events, workflow and cd productsDesigning a complete ci cd pipeline using argo events, workflow and cd products
Designing a complete ci cd pipeline using argo events, workflow and cd products
 
Terraform
TerraformTerraform
Terraform
 
GitOps with ArgoCD
GitOps with ArgoCDGitOps with ArgoCD
GitOps with ArgoCD
 
Test and Behaviour Driven Development (TDD/BDD)
Test and Behaviour Driven Development (TDD/BDD)Test and Behaviour Driven Development (TDD/BDD)
Test and Behaviour Driven Development (TDD/BDD)
 
Introduction to Terraform Enterprise
Introduction to Terraform EnterpriseIntroduction to Terraform Enterprise
Introduction to Terraform Enterprise
 
OpenStack and MySQL
OpenStack and MySQLOpenStack and MySQL
OpenStack and MySQL
 
Intro to Helm for Kubernetes
Intro to Helm for KubernetesIntro to Helm for Kubernetes
Intro to Helm for Kubernetes
 
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...
 
Introduction To Docker
Introduction To  DockerIntroduction To  Docker
Introduction To Docker
 

Similar a Has serverless adoption hit a roadblock?

Nyc mule soft_meetup_13_march_2021
Nyc mule soft_meetup_13_march_2021Nyc mule soft_meetup_13_march_2021
Nyc mule soft_meetup_13_march_2021NeerajKumar1965
 
Cloudsolutionday 2016: Getting Started with Severless Architecture
Cloudsolutionday 2016: Getting Started with Severless ArchitectureCloudsolutionday 2016: Getting Started with Severless Architecture
Cloudsolutionday 2016: Getting Started with Severless ArchitectureAWS Vietnam Community
 
Evolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsEvolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsNetwork Automation Forum
 
Serverless architecture
Serverless architectureServerless architecture
Serverless architecturevipin kumar
 
Building Cloud Native Applications with Oracle Autonomous Database.
Building Cloud Native Applications with Oracle Autonomous Database.Building Cloud Native Applications with Oracle Autonomous Database.
Building Cloud Native Applications with Oracle Autonomous Database.Oracle Developers
 
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020Tim Wagner
 
From DevOps to NoOps
From DevOps to NoOpsFrom DevOps to NoOps
From DevOps to NoOpsCapgemini
 
Serverless microservices in the wild
Serverless microservices in the wildServerless microservices in the wild
Serverless microservices in the wildRotem Tamir
 
When to use serverless computing.pdf
When to use serverless computing.pdfWhen to use serverless computing.pdf
When to use serverless computing.pdfSGBSeo
 
Will ServerLess kill containers and Operations
Will ServerLess kill containers and OperationsWill ServerLess kill containers and Operations
Will ServerLess kill containers and OperationsStephane Woillez
 
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...apidays
 
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...James Anderson
 
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...apidays LIVE Paris - Serverless security: how to protect what you don't see? ...
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...apidays
 
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS Summit
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS SummitDiscover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS Summit
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS SummitAmazon Web Services
 
Preparing for Neo - Singapore OutSystems User Group October 2022 Meetup
Preparing for Neo - Singapore OutSystems User Group October 2022 MeetupPreparing for Neo - Singapore OutSystems User Group October 2022 Meetup
Preparing for Neo - Singapore OutSystems User Group October 2022 MeetupYashrajNayak4
 
Viktor Turskyi "Effective NodeJS Application Development"
Viktor Turskyi "Effective NodeJS Application Development"Viktor Turskyi "Effective NodeJS Application Development"
Viktor Turskyi "Effective NodeJS Application Development"Fwdays
 
When to use serverless computing.pdf
When to use serverless computing.pdfWhen to use serverless computing.pdf
When to use serverless computing.pdfseo18
 
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloud
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloudInterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloud
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloudiMasters
 
Serverless Meetup - Event Sourcing
Serverless Meetup - Event SourcingServerless Meetup - Event Sourcing
Serverless Meetup - Event SourcingLuca Bianchi
 
Documenting serverless architectures could we do it better - o'reily sa con...
Documenting serverless architectures  could we do it better  - o'reily sa con...Documenting serverless architectures  could we do it better  - o'reily sa con...
Documenting serverless architectures could we do it better - o'reily sa con...Asher Sterkin
 

Similar a Has serverless adoption hit a roadblock? (20)

Nyc mule soft_meetup_13_march_2021
Nyc mule soft_meetup_13_march_2021Nyc mule soft_meetup_13_march_2021
Nyc mule soft_meetup_13_march_2021
 
Cloudsolutionday 2016: Getting Started with Severless Architecture
Cloudsolutionday 2016: Getting Started with Severless ArchitectureCloudsolutionday 2016: Getting Started with Severless Architecture
Cloudsolutionday 2016: Getting Started with Severless Architecture
 
Evolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to PlatformsEvolving the Network Automation Journey from Python to Platforms
Evolving the Network Automation Journey from Python to Platforms
 
Serverless architecture
Serverless architectureServerless architecture
Serverless architecture
 
Building Cloud Native Applications with Oracle Autonomous Database.
Building Cloud Native Applications with Oracle Autonomous Database.Building Cloud Native Applications with Oracle Autonomous Database.
Building Cloud Native Applications with Oracle Autonomous Database.
 
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020
AWS Serverless Community Day Keynote and Vendia Launch 6-26-2020
 
From DevOps to NoOps
From DevOps to NoOpsFrom DevOps to NoOps
From DevOps to NoOps
 
Serverless microservices in the wild
Serverless microservices in the wildServerless microservices in the wild
Serverless microservices in the wild
 
When to use serverless computing.pdf
When to use serverless computing.pdfWhen to use serverless computing.pdf
When to use serverless computing.pdf
 
Will ServerLess kill containers and Operations
Will ServerLess kill containers and OperationsWill ServerLess kill containers and Operations
Will ServerLess kill containers and Operations
 
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...
APIdays Paris 2018 - Will Serverless kill Containers and Operations? Stéphane...
 
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
GDG Cloud Southlake #16: Priyanka Vergadia: Scalable Data Analytics in Google...
 
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...apidays LIVE Paris - Serverless security: how to protect what you don't see? ...
apidays LIVE Paris - Serverless security: how to protect what you don't see? ...
 
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS Summit
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS SummitDiscover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS Summit
Discover MongoDB Atlas and MongoDB Stitch - DEM02-S - Mexico City AWS Summit
 
Preparing for Neo - Singapore OutSystems User Group October 2022 Meetup
Preparing for Neo - Singapore OutSystems User Group October 2022 MeetupPreparing for Neo - Singapore OutSystems User Group October 2022 Meetup
Preparing for Neo - Singapore OutSystems User Group October 2022 Meetup
 
Viktor Turskyi "Effective NodeJS Application Development"
Viktor Turskyi "Effective NodeJS Application Development"Viktor Turskyi "Effective NodeJS Application Development"
Viktor Turskyi "Effective NodeJS Application Development"
 
When to use serverless computing.pdf
When to use serverless computing.pdfWhen to use serverless computing.pdf
When to use serverless computing.pdf
 
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloud
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloudInterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloud
InterCon 2016 - SLA vs Agilidade: uso de microserviços e monitoramento de cloud
 
Serverless Meetup - Event Sourcing
Serverless Meetup - Event SourcingServerless Meetup - Event Sourcing
Serverless Meetup - Event Sourcing
 
Documenting serverless architectures could we do it better - o'reily sa con...
Documenting serverless architectures  could we do it better  - o'reily sa con...Documenting serverless architectures  could we do it better  - o'reily sa con...
Documenting serverless architectures could we do it better - o'reily sa con...
 

Más de Veselin Pizurica

Remote Patient & Elderly Care Monitoring
Remote Patient & Elderly Care MonitoringRemote Patient & Elderly Care Monitoring
Remote Patient & Elderly Care MonitoringVeselin Pizurica
 
Solving the weak spots of serverless with directed acyclic graph model
Solving the weak spots of serverless with directed acyclic graph modelSolving the weak spots of serverless with directed acyclic graph model
Solving the weak spots of serverless with directed acyclic graph modelVeselin Pizurica
 
How to use probabilistic inference programming for application orchestration ...
How to use probabilistic inference programming for application orchestration ...How to use probabilistic inference programming for application orchestration ...
How to use probabilistic inference programming for application orchestration ...Veselin Pizurica
 
A practical look at how to build & run IoT business logic
A practical look at how to build & run IoT business logicA practical look at how to build & run IoT business logic
A practical look at how to build & run IoT business logicVeselin Pizurica
 
Waylay building smart city solution: IoT convention Antwerp
Waylay building smart city solution: IoT convention AntwerpWaylay building smart city solution: IoT convention Antwerp
Waylay building smart city solution: IoT convention AntwerpVeselin Pizurica
 
Google Cloud infrastructure in Conrad Connect by Google & waylay
Google Cloud infrastructure in Conrad Connect by Google & waylayGoogle Cloud infrastructure in Conrad Connect by Google & waylay
Google Cloud infrastructure in Conrad Connect by Google & waylayVeselin Pizurica
 
Artificial intelligence by Aleksandra Pizurica
Artificial intelligence by Aleksandra PizuricaArtificial intelligence by Aleksandra Pizurica
Artificial intelligence by Aleksandra PizuricaVeselin Pizurica
 
Automation is eating the world
Automation is eating the worldAutomation is eating the world
Automation is eating the worldVeselin Pizurica
 
LPWAN - IoT (Platform) Killer Application
LPWAN - IoT (Platform) Killer ApplicationLPWAN - IoT (Platform) Killer Application
LPWAN - IoT (Platform) Killer ApplicationVeselin Pizurica
 
Automation, intelligence and knowledge modelling
Automation, intelligence and knowledge modellingAutomation, intelligence and knowledge modelling
Automation, intelligence and knowledge modellingVeselin Pizurica
 
When IoT Meets Artificial Intelligence
 When IoT Meets Artificial Intelligence When IoT Meets Artificial Intelligence
When IoT Meets Artificial IntelligenceVeselin Pizurica
 
Internet of Things introduction
Internet of Things introductionInternet of Things introduction
Internet of Things introductionVeselin Pizurica
 
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...Veselin Pizurica
 
Artificial intelligence and IoT
Artificial intelligence and IoTArtificial intelligence and IoT
Artificial intelligence and IoTVeselin Pizurica
 

Más de Veselin Pizurica (17)

Remote Patient & Elderly Care Monitoring
Remote Patient & Elderly Care MonitoringRemote Patient & Elderly Care Monitoring
Remote Patient & Elderly Care Monitoring
 
Solving the weak spots of serverless with directed acyclic graph model
Solving the weak spots of serverless with directed acyclic graph modelSolving the weak spots of serverless with directed acyclic graph model
Solving the weak spots of serverless with directed acyclic graph model
 
How to use probabilistic inference programming for application orchestration ...
How to use probabilistic inference programming for application orchestration ...How to use probabilistic inference programming for application orchestration ...
How to use probabilistic inference programming for application orchestration ...
 
A practical look at how to build & run IoT business logic
A practical look at how to build & run IoT business logicA practical look at how to build & run IoT business logic
A practical look at how to build & run IoT business logic
 
Waylay - We are hiring
Waylay - We are hiringWaylay - We are hiring
Waylay - We are hiring
 
Waylay building smart city solution: IoT convention Antwerp
Waylay building smart city solution: IoT convention AntwerpWaylay building smart city solution: IoT convention Antwerp
Waylay building smart city solution: IoT convention Antwerp
 
Google Cloud infrastructure in Conrad Connect by Google & waylay
Google Cloud infrastructure in Conrad Connect by Google & waylayGoogle Cloud infrastructure in Conrad Connect by Google & waylay
Google Cloud infrastructure in Conrad Connect by Google & waylay
 
Artificial intelligence by Aleksandra Pizurica
Artificial intelligence by Aleksandra PizuricaArtificial intelligence by Aleksandra Pizurica
Artificial intelligence by Aleksandra Pizurica
 
Automation is eating the world
Automation is eating the worldAutomation is eating the world
Automation is eating the world
 
LPWAN - IoT (Platform) Killer Application
LPWAN - IoT (Platform) Killer ApplicationLPWAN - IoT (Platform) Killer Application
LPWAN - IoT (Platform) Killer Application
 
Automation, intelligence and knowledge modelling
Automation, intelligence and knowledge modellingAutomation, intelligence and knowledge modelling
Automation, intelligence and knowledge modelling
 
When IoT Meets Artificial Intelligence
 When IoT Meets Artificial Intelligence When IoT Meets Artificial Intelligence
When IoT Meets Artificial Intelligence
 
Internet of Things introduction
Internet of Things introductionInternet of Things introduction
Internet of Things introduction
 
My life in one picture
My life in one pictureMy life in one picture
My life in one picture
 
WebRTC presentation
WebRTC presentationWebRTC presentation
WebRTC presentation
 
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
 
Artificial intelligence and IoT
Artificial intelligence and IoTArtificial intelligence and IoT
Artificial intelligence and IoT
 

Último

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 

Último (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 

Has serverless adoption hit a roadblock?

  • 1. Has serverless adoption hit a roadblock? Veselin Pizurica Founder & CTO 14 April 2021
  • 3. What is Low Code? Low-code development is a promise that developers can use a platform to code at a very fast pace, with minimal setup effort and quick deployment. It reduces the complexity of the application development process. The basic building block of the Low Code platform should be a small snippet of code, which like a lego brick is reusable across different use cases.
  • 4. Serverless as a new Cloud paradigm When lambda hit the mainstream, it was widely accepted that it was the best candidate for that low code lego brick.
  • 5. Where serverless works well Data ML pipelines, batch processing, etc … It works and it is great!
  • 6. Web applications (REST CRUD)? Probably still fine.
  • 7. When things go south - Spaghetti code 4.0
  • 8. What is the Industry saying? Two different impediments hampering serverless adoption: ● Architecture complexity: tracing, observability, debugging, deployment etc... ● Fear: fear of losing control, fear of vendor lock in, fear of weak security, unpredictable cost etc... Source: O’Reilly serverless survey, Concerns, what works, and what to expect
  • 9. What are we saying?
  • 10. More than one roadblock, this talk is about the one not in the list! Source: O’Reilly serverless survey, Concerns, what works, and what to expect
  • 11. Serverless or not? ● Serverless promise: ○ Small snippets of code ○ Infinite scale ○ Separation of responsibilities (experts, IT folks, Devops, ML folks, solution architects etc…) ○ Easy to develop - Really? ○ Easy to deploy - Really? ○ Easy to support in production - Really? ● “LAMP” (django, rails, express, laravel …) ○ Easy to implement, deploy and support ○ Use laptop, any IAAS stack or “on prem” HW
  • 12. Who is the guilty one?
  • 13. Lambda calculus If things are so simple, why we struggle with these things? Are we fixing symptoms or the cause?
  • 14. A Berkeley View on Serverless Computing Link to paper
  • 15. From the Berkley paper 1/3
  • 16. From the Berkley paper 2/3
  • 17. From the Berkley paper 3/3
  • 18. Functions and entities in serverless? If functions are “do it” calls who keeps the relation between entities? ● DynamoDB? (NoSQL ...) ● Digital twin? (entity centric) ● GraphQL? (graph centric) ● SPARQL? (ontology, semantics, ….) ● x_SQL? (relationship centric)
  • 19. All we need is Orchestrator
  • 20. AWS Step Functions - Finite State Machine
  • 21. Azure Logic Apps - Flow Engine
  • 23. Challenge - OT/IT Convergence
  • 24. Finite State Machines orchestrator? FSM is a stock market in reverse: a small front door entry to a big theater. You can’t process more than one event at the same time. FSM for workflows, ticket handling, BPM, response on highly correlated triggers (events), but not for data stream(s)!
  • 25. Flow engine orchestrator? Can anyone grasp what is going on here? Interpretability, decision/control flow, stream merging etc…
  • 26. Batch processing - pipelines IoT stream IoT Hub Store IoT Device ● Data ● Commands ● Config Reports (BI) Analytics ... Digital Twin API’s Other systems (data) data
  • 27. Offline analytics approach with Lambda IoT stream IoT Hub IoT Device ● Data ● Commands ● Config ML models Digital Twin Batch processing Store triggers Lambdas Process flow API’s Other systems (data) data
  • 28. Stream analytics & Lambda & Orchestrator IoT stream IoT Hub Store IoT Device ● Data ● Commands ● Config Reports (BI) Analytics ... Digital Twin API’s Other systems (data) Stream query/filter Lambdas AWS step functions, Google Workflow Rule1 is here! Rule2 is here! data
  • 29. Stream processing with Lambda/Flow Engines & Orchestrator IoT stream IoT Hub IoT Device ● Data ● Commands ● Config Digital Twin API’s Other systems (data) Lambdas, Flow Engines AWS step functions, Google Workflow Rule is here! How fast? data Rule2 is here! fanout
  • 30. OT/IT Convergence dilemma ● Choice1: Rules with S3/lambda: Lambda fanout, who knows what is happening? It is great for batch processing, but not more than that. ● Choice2: Stream analytics (rule 1) followed by Orchestrator (rule 2): How to add new rules, mix API’s and other sources? ● Choice3: Orchestrator (Flow) tapping into the stream directly (queue or not doesn’t matter): How fast this can be? Who adds rules and to which particular type of a device? How to add new rules, mix API’s and streams from different devices and then use other REST sources?
  • 31. Automation is a star topology Automation requires constant connections to: ● Stream data ● Time series (historical) data ● Anomaly detection/prediction models ● Meta model (digital twins, relations etc.) ● ERP (IT) systems ● Notifications (email, SMS, calls …) ● ML (REST) ● API (external services) Data streams Historical data APIs Predictions DTwin Alarms ERP Anomalies
  • 32. All we need is a STAR Orchestrator
  • 33. Automation Benchmarks https://www.waylay.io/platform/benchmark Waylay Engine is the best of two worlds: can ingest and merge data streams, while at the same time it is as good as Finite State Machine in the logic interpretation.
  • 34. Waylay IO Automation Engine https://www.youtube.com/watch?v=NBT8UskyFYQ
  • 35. We are on the mission.
  • 36. An “Apple” like developers experience Waylay IO mission is to bring Apple experiences to the developers community.
  • 37. Waylay’s mission Waylay IO Low Code Platform ● Low-code portal that simplifies development and deployment ● Easy integration of API enabled services ● AI/ML deployment without tears ● Excellent debugging and observability ● All necessary tools in one place ● From development to production in “no time” ● Built-in state of the art security similar to Auth0 ● No setup, nothing to manage ● Pay-Per-Use: you only pay for consumption
  • 38. Waylay supports (and pay for) OPEN source! Waylay platform is built on top of open source cloud agnostic services, without dependencies on any specific cloud provider (Open FAAS, Kafka, Cassandra, Elastic, Mongo, Redis…)
  • 39. Waylay IO Low Code Platform https://docs-io.waylay.io/
  • 40. Stream processing and lambdas? Orchestrator can also be a container (in memory) for lambdas, why not? API (lambda) fanout, that is fine Inference “In memory” lambdas events DTwin Streams and DTwin data - real time injection
  • 41. Does Lambda need to be an external “RPC” call? Native ”functions”: 90% ~.02ns execution time. That’s the speed you need for stream processing! No need to run “external” lambdas + RTT penalty.
  • 42. Example Salesforce Digital Twin Data ingestion Stream processing Application Rules API fanout
  • 43. The ENGIE Smart Cabin solution https://www.engie.be/en/business/reliability-security/high-voltage-cabin/smart-cabin/
  • 44. Why not expressing relations in the rule? objects Rule 2 Rule 1 Rule 3 relations relations
  • 45. AI/ML models - from jupyter to deployment in seconds ML model data Low code snippet
  • 47.
  • 48. Just get it done! Discover Waylay IO, the first low-code automation platform.