The maths behind microscaling

•

0 recomendaciones•538 vistas

The fast instantiation speed of containers promises a sea change in the way you scale workloads within your infrastructure, through the concept of microscaling In this talk we'll briefly make sure everyone is up to speed on the idea of microscaling, and then you'll explore some of the maths behind it, and look at the limits for what’s possible, both theoretically and experimentally. Find out more on microscaling at http://microscaling.org.

Tecnología

The Maths behind
Microscaling
Liz Rice
@lizrice | @microscaling

What is Microscaling?
Assumptions
Some theory
Some experiments

container scaling
work
performance metrics

work
performance metrics
container scaling
VM autoscaling

Orchestration
Cattle not pets
Heterogenous services

True for regular
autoscaling too
VMs take much longer to scale

How many containers?
Request
processing time
Rate of requests
known?
predictable?

performance target
actual performance
error
time t

performance target p
time t
actual performance x
e(t) = x(t) - p(t)
e(t) → 0
error e

x(t) is proportional to n(t)
n(t) = k x(t)
error e
time t
numberofcontainersn

x(t) is proportional to n(t)
nope!
error e
time t
numberofcontainersn
d(t) is proportional to e(t)
d

Woah, the future!
error e
time t
d(t) is proportional to e(t + T)
T
d

error e
time t
Proportional term
d(t) = Kp e(t)
The further we are from target
the more containers we need

error e
time t
Derivative term
The faster we approach target
the fewer containers we need
d(t) = Kp e(t) + Kd ė(t)

error e
time t
Integral term
d(t) = Kp e(t) + Kd ė(t) + Ki e(t)
Offset errors accumulated over time
∫

Which values for K?
Discrete containers?

Container parameters
=
metadata
Talk to us about
advantages of
container labelling

github.com/microscaling
app.microscaling.com
Liz Rice
@lizrice | @microscaling

Más contenido relacionado

La actualidad más candente

Lecture 12

Tanveer Malik

ReComp: challenges in selective recomputation of (expensive) data analytics t...

Paolo Missier

OPTIMIZING THE TICK STACK

InfluxData

Storm: a distributed ,fault tolerant ,real time computation

Nitin Guleria

Much of the knowledge produced through data-intensive computations is liable to decay over time, as the underlying data drifts, and the algorithms, tools, and external data sources used for processing change and evolve. Your genome, for example, does not change over time, but our understanding of it does. How often should be look back at it, in the hope to gain new insight e.g. into genetic diseases, and how much does that cost when you scale re-analysis to an entire population? The "total cost of ownership” of knowledge derived from data (TCO-DK) includes the cost of refreshing the knowledge over time in addition to the initial analysis, but is often not a primary consideration. The ReComp project aims to provide models, algorithms, and tools to help humans understand TCO-DK, i.e., the nature and impact of changes in data, and assess the cost and benefits of knowledge refresh. In this talk we try and map the scope of ReComp, by giving a number of patterns that cover typical analytics scenarios where re-computation is appropriate. We specifically describe two such scenarios, where we are conducting small scale, proof-of-concept ReComp experiments to help us sketch the general ReComp architecture. This initial exercise reveals a multiplicity of problems and research challenges, which will inform the rest of the project

Your data won’t stay smart forever:exploring the temporal dimension of (big ...

Paolo Missier

Moa: Real Time Analytics for Data Streams

Albert Bifet

Strata NYC 2015: Sketching Big Data with Spark: randomized algorithms for lar...

Databricks

The lifecycle of reproducible science data and what provenance has got to do ...

Paolo Missier

Time Series Data with Apache Cassandra

Eric Evans

Asymmetry in Large-Scale Graph Analysis, Explained

Vasia Kalavri

Graphite, an introduction

jamesrwu

SchemEX - Creating the Yellow Pages for the Linked Open Data Cloud

Ansgar Scherp

DEBS Grand Challenge is a yearly, real-life data based event processing challenge posted by Distributed Event Based Systems conference. The 2015 challenge uses a taxi trip data set from New York city that includes 173 million events col- lected over the year 2013. This paper presents how we used WSO2 CEP, an open source, commercially available Complex Event Processing Engine, to solve the problem. With a 8-core commodity physical machine, our solution did about 350,000 events/second throughput with mean latency less than one millisecond for both queries. With a VirtualBox VM, our solution did about 50,000 events/second throughput with mean latency of 1 and 6 milliseconds for the first and second queries respectively. The paper will outline the solution, present results, and discuss how we optimized the solution for maximum performance.

ACM DEBS Grand Challenge: Continuous Analytics on Geospatial Data Streams wit...

Srinath Perera

Fast Perceptron Decision Tree Learning from Evolving Data Streams

Albert Bifet

AP Calculus AB March 9, 2009

Darren Kuropatwa

Sentiment Knowledge Discovery in Twitter Streaming Data

Albert Bifet

Varying minimal clan size brings in certain imbalance when solving a linear (Diophantine) system on parallel architectures via composition of its clans using open source software PaAd. The problem is partially mended by dynamic scheduling of jobs. The present paper studies a task of preliminary balancing the clan size via their aggregation represented as a special case of graph partitioning. Due to complexity of the optimization criteria, taking into consideration both the number of equations and the number of variables on two stages of solution -- solving a system for each clan and solving a composition system -- simplified variants of the task are considered and solved using heuristic techniques: a fast bin packing with the first fit on a sorted array algorithm and a multi-objective graph partitioning with software package METIS. Obtained benchmarks show that aggregation of clans brings in an additional 3 times speed-up.

Speed-up Solving Linear Systems on Parallel Architectures via Aggregation of ...

DmitryZaitsev5

Network traffic monitoring tools are traditionally based on the packet paradigm where tools need to analyse each incoming and outgoing packet. As systems are moving towards a micro-service oriented architecture based on containers, the packet paradigm is no longer enough to provide IT visibility as services interact inside a system and not over a network where it is possible to install network sensors. This talk will explain how open source tools designed by ntop on top of InfluxDB allow packet monitoring tools to be complemented with container monitoring and thus implement a lightweight visibility solution for modern IT infrastructures.

IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntop

InfluxData

FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark

Rob Emanuele

"At OpenX we not only use the tools in big data ecosystems to solve our business problems, but also explore the cutting edge algorithms for practical uses. HyperLogLog is one of the algorithm that we use intensively in our internal system. It has really low computation cost and can easily plug into map-reduce framework (hadoop or spark). Some of the applications that worth to highlight are: * high cardinality test * distinct count of unique users over time * Visualize hyperloglog for fraud detection"

Big Data Day LA 2015 - Large Scale Distinct Count -- The HyperLogLog algorith...

Data Con LA

La actualidad más candente (20)

Lecture 12

ReComp: challenges in selective recomputation of (expensive) data analytics t...

OPTIMIZING THE TICK STACK

Storm: a distributed ,fault tolerant ,real time computation

Your data won’t stay smart forever:exploring the temporal dimension of (big ...

Moa: Real Time Analytics for Data Streams

Strata NYC 2015: Sketching Big Data with Spark: randomized algorithms for lar...

The lifecycle of reproducible science data and what provenance has got to do ...

Time Series Data with Apache Cassandra

Asymmetry in Large-Scale Graph Analysis, Explained

Graphite, an introduction

SchemEX - Creating the Yellow Pages for the Linked Open Data Cloud

ACM DEBS Grand Challenge: Continuous Analytics on Geospatial Data Streams wit...

Fast Perceptron Decision Tree Learning from Evolving Data Streams

AP Calculus AB March 9, 2009

Sentiment Knowledge Discovery in Twitter Streaming Data

Speed-up Solving Linear Systems on Parallel Architectures via Aggregation of ...

IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntop

FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark

Big Data Day LA 2015 - Large Scale Distinct Count -- The HyperLogLog algorith...

Similar a The maths behind microscaling

Algorithms 101 for Data Scientists

Christopher Conlan

Lecture 25

Shani729

02 order of growth

Hira Gul

Junhua wang ai_next_con

Junhua Wang

Self-adaptive container monitoring with performance-aware Load-Shedding policies

NECST Lab @ Politecnico di Milano

Big Oh.ppt

Senthil Vit

There are many modern techniques for identifying anomalies in datasets. There are fewer that work as online algorithms suitable for application to real-time streaming data. What’s worse? Most of these methodologies require a deep understanding of the data itself. In this talk, we tour what the options are for identifying anomalies in real-time data and discuss how much we really need to know before hand to guess at the ever-useful question: is this normal?

Is this normal?

Theo Schlossnagle

source{d} is building the open-source components to enable large-scale code analysis and machine learning on source code. Their powerful tools can ingest all of the world’s public git repositories turning code into ASTs ready for machine learning and other analyses, all exposed through a flexible and friendly API. Francesc will show you how to run machine learning on source code with a series of live demos.

Machine Learning on Code - SF meetup

source{d}

Approximation Data Structures for Streaming Applications

Debasish Ghosh

Deep Learning Inference at speed and scale

Bill Liu

Meetup Julio Algoritmos Genéticos

DataLab Community

Parallel Computing with R

Abhirup Mallik

Introduction to Algorithms

Venkatesh Iyer

Complexity Analysis

Shaista Qadir

Time Series Forecasting Modeling CMG12

Alex Gilgur

This talk was based on my Master's thesis which I had completed earlier that year. It gives an overview on how certain parallel dynamic programming can be computed in parallel efficiently, and what we want that to mean here. The plots in "Performance Examples" show speedup S on the left and efficiency E on the right, both against input size. Read more over here: http://reitzig.github.io/publications/Reitzig2012

Parallelising Dynamic Programming

Raphael Reitzig

Chapter two

mihiretu kassaye

Upm scube-dynsys-presentation

idragan

In todays world majority of information is generated by self sustaining systems like various kinds of bots, crawlers, servers, various online services, etc. This information is flowing on the axis of time and is generated by these actors under some complex logic. For example, a stream of buy/sell order requests by an Order Gateway in financial world, or a stream of web requests by a monitoring / crawling service in the web world, or may be a hacker's bot sitting on internet and attacking various computers. Although we may not be able to know the motive or intention behind these data sources. But via some unsupervised techniques we can try to infer the pattern or correlate the events based on their multiple occurrences on the axis of time. Associating a chain of events in order of time helps in doing a root event analysis. In certain cases a time ordered correlation and root event identification is good enough to automatically identify signatures of various malicious actors and take appropriate corrective actions to stop cyber attacks, stop malicious social campaigns, etc. Sessionisation is one such unsupervised technique that tries to find the signal in a stream of events associated with a timestamp. In the ideal world it would resolve to finding periods with a mixture of sinusoidal waves. But for the real world this is a much complex activity, as even the systematic events generated by machines over the internet behave in a much erratic manner. So the notion of a period for a signal also changes in the real world. We can no longer associate it with a number, it has to be treated as a random variable, with expected values and associated variance. Hence we need to model "Stochastic periods" and learn their probability distributions in an unsupervised manner. The main focus of this talk will be to showcase applied data science techniques to discover stochastic periods. There are many ways to obtain periods in data, so the journey would begin by a walk through of existing techniques like FFT (Fast Fourier Transform) then discuss about Gaussian Mixture Models. After highlighting the short comings of these techniques we will succinctly explain one of the most general non-parametric Bayesian approaches to solve this problem. Without going too deep in the complex math, we will get back to applied data science and discuss a much simpler technique that can solve the same problem if certain assumptions are satisfied. In this talk we will demonstrate some time based pattern we discovered while working on a security analytics use case that uses Sessionisation. In the talk we will demonstrate such patterns based on an open source malware attack datasets that is available publicly. Key concepts explained in talk: Sessionisation, Bayesian techniques of Machine Learning, Gaussian Mixture Models, Kernel density estimation, FFT, stochastic periods, probabilistic modelling, Bayesian non-parametric methods

ODSC 2019: Sessionisation via stochastic periods for root event identification

Kuldeep Jiwani

Algorithm chapter 2

chidabdu

Similar a The maths behind microscaling (20)

Algorithms 101 for Data Scientists

Lecture 25

02 order of growth

Junhua wang ai_next_con

Self-adaptive container monitoring with performance-aware Load-Shedding policies

Big Oh.ppt

Is this normal?

Machine Learning on Code - SF meetup

Approximation Data Structures for Streaming Applications

Deep Learning Inference at speed and scale

Meetup Julio Algoritmos Genéticos

Parallel Computing with R

Introduction to Algorithms

Complexity Analysis

Time Series Forecasting Modeling CMG12

Parallelising Dynamic Programming

Chapter two

Upm scube-dynsys-presentation

ODSC 2019: Sessionisation via stochastic periods for root event identification

Algorithm chapter 2

Más de Liz Rice

Container secrets talk from DevSecCon

Liz Rice

Your (container) secret's safe with me

Liz Rice

Your secret's safe with me

Liz Rice

Game of Hosts - Containers, VMs and Microscaling

Liz Rice

How to build a personalized interface for VOD

Liz Rice

Tank Top TV - Netflix viewing data

Liz Rice

Killing the TV time grid

Liz Rice

Cadbury

Liz Rice

Beatz

Liz Rice

Más de Liz Rice (9)

Container secrets talk from DevSecCon

Your (container) secret's safe with me

Your secret's safe with me

Game of Hosts - Containers, VMs and Microscaling

How to build a personalized interface for VOD

Tank Top TV - Netflix viewing data

Killing the TV time grid

Cadbury

Beatz

Último

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

DBX First Quarter 2024 Investor Presentation

Dropbox

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Exploring Multimodal Embeddings with Milvus

Zilliz

Architecting Cloud Native Applications

WSO2

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services