Needle in the Haystack—User Behavior Anomaly Detection for Information Security with Ping Yan and Wei Deng

•

4 likes•2,149 views

Salesforce recently invented and deployed a real-time, scalable, terabyte data-level and low false positive personalized anomaly detection system. Anomaly detection on user in-app behavior at terabyte-data scale is extremely challenging because traditional techniques like clustering methods suffer serious production performance issues. Salesforce’s method tackles the traditional challenges through three phases: 1) Leveraging Principal Component Analysis (PCA) to extract high-variance and low-variance feature subsets. The low-variance feature subset is valuable in cybersecurity because we want to determine if a user deviates from his or her stable behavior. The high-variance one is used for dimension reduction; 2) On each feature subset, they build a profile for each user to characterize the user’s baseline behavior and legitimate abnormal behavior; 3) During detection, for each incoming event, their method will compare it with the user’s profile and produce an anomaly score. The computation complexity of the detection module for each incoming event is constant. st cloud computing platforms; the novelty of our user behavior profiling based anomaly detection technique and the challenges of implementing and deploying it with Apache Spark in production. We will also demonstrate how our system outperforms the other traditional machine learning algorithms.

Data & Analytics

User Behavior Anomaly Detection for Platform
Security
Wei Deng, Ping Yan
Needle in the Haystack

Information Security is Hard
• Signatures
& Rules
Known
knowns
• Correlation
Analysis
Known
unknowns • Anomaly
Detection
Unknown
unknowns
2

User In-app Behavior
WHO
WHEN
WHERE
HOW
WHAT
Actions
logins
UI page views
API calls
password
reset
...
Entities
client IP
timestamps
user agents
...
Derived
hour of day
day of week
geo country
...
3

Challenges
• Size of data, speed to response
• Variability of threats
• Little to none ground truth
• Feature selection
• User behavior novelty
4

A Behavior Anomaly Detection Approach
5

PCA
• High variance variables
Representative of original data set
• Low variance variables
Representative of users’ stable behavior
7

Detection
• Deviation from user’s baseline
• Re-scale deviation score with a correction factor
10

Detection
11

Evaluation with Synthetic Data
12

Deployment
13

Thank You.
Wei Deng
wdeng@salesforce.com
Ping Yan
pyan@salesforce.com
@pingpingya

More Related Content

What's hot

Data drift and machine learning

Data drift and machine learning

Data drift and machine learning

A fast, adaptive and effective fraud detection system architecture, PAIR, is proposed and demonstrated. It allows multiple transactional data streams and supporting reference data streams with information fusion support. An ensemble of ML algorithms, with a combination of supervised/unsupervised, stream learning/offline learning and rule based are supported. The output is actionable, with multiple delivery mechanisms, to bring human in the loop. The system is responsive in reacting before the transaction completes and also in adapting to evolving situations. Later is enabled by modularity in the design to allow changes on the fly. New stream processing can be defined in a newly designed language. System provides for a set of integrative approaches, ability to define features, maintain history, compare with it and allow multiple separate processing at the same time. System is designed for scale at runtime and scale of development. A MASSES Simulator was built to validate the system from functional and non-functional (scale, response time etc.) point of view. A language for creating multiple simultaneous simulations, on the philosophy of specification by example, was built.

Fraud detection system

Fraud detection system

Fraud detection system

Detecting fraud with Python and machine learning

Detecting fraud with Python and machine learning

Detecting fraud with Python and machine learning

Malware Dectection Using Machine learning

Malware Dectection Using Machine learning

Malware Dectection Using Machine learning

Overfitting.pptx

Overfitting.pptx

Overfitting.pptx

PerumalPitchandi

Anomaly detection (or Outlier analysis) is the identification of items, events or observations which do not conform to an expected pattern or other items in a dataset. It is used is applications such as intrusion detection, fraud detection, fault detection and monitoring processes in various domains including energy, healthcare and finance. In this workshop, we will discuss the core techniques in anomaly detection and discuss advances in Deep Learning in this field. Through case studies, we will discuss how anomaly detection techniques could be applied to various business problems. We will also demonstrate examples using R, Python, Keras and Tensorflow applications to help reinforce concepts in anomaly detection and best practices in analyzing and reviewing results. What you will learn: Anomaly Detection: An introduction Graphical and Exploratory analysis techniques Statistical techniques in Anomaly Detection Machine learning methods for Outlier analysis Evaluating performance in Anomaly detection techniques Detecting anomalies in time series data Case study 1: Anomalies in Freddie Mac mortgage data Case study 2: Auto-encoder based Anomaly Detection for Credit risk with Keras and Tensorflow

Anomaly detection Workshop slides

Anomaly detection Workshop slides

Anomaly detection Workshop slides

QuantUniversity

Multiclass classification of imbalanced data

Multiclass classification of imbalanced data

Multiclass classification of imbalanced data

Threat Hunting

In the Credit Card Companies, illegitimate credit card usage is a serious problem which results in a need to accurately detect fraudulent transactions vs non-fraudulent transactions. All organizations can be hugely impacted by fraud and fraudulent activities, especially those in financial services. The threat can originate from internal or external, but the effects can be devastating – including loss of consumer confidence, incarceration for those involved, even up to downfall of a corporation. Despite regular fraud prevention measures, these are constantly being put to the test in an attempt to beat the system. Fraud detection is a task of predicting whether a card has been used by the cardholder. One of the methods to recognize fraud card usage is to leverage Machine Learning (ML) models. In order to more dynamically detect fraudulent transactions, one can train ML models on a set of dataset including credit card transaction information as well as card and demographic information of the owner of the account. This will be our goal of the project while leveraging Databricks.

Credit Card Fraud Detection Using ML In Databricks

Credit Card Fraud Detection Using ML In Databricks

Credit Card Fraud Detection Using ML In Databricks

Wrapper feature selection method

Wrapper feature selection method

Wrapper feature selection method

Link to the video of the presentation: https://www.youtube.com/watch?v=WG1k-Xh1TqM Every single security company is talking in some way or another about how they are applying machine learning. Companies go out of their way to make sure they mention machine learning and not statistics when they explain how they work. Recently, that's not enough anymore either. As a security company you have to claim artificial intelligence to be even part of the conversation. Guess what. It's all baloney. We have entered a state in cyber security that is, in fact, dangerous. We are blindly relying on algorithms to do the right thing. We are letting deep learning algorithms detect anomalies in our data without having a clue what that algorithm just did. In academia, they call this the lack of explainability and verifiability. But rather than building systems with actual security knowledge, companies are using algorithms that nobody understands and in turn discover wrong insights. In this talk, I will show the limitations of machine learning, outline the issues of explainability, and show where deep learning should never be applied. I will show examples of how the blind application of algorithms (including deep learning) actually leads to wrong results. Algorithms are dangerous. We need to revert back to experts and invest in systems that learn from, and absorb the knowledge, of experts.

AI & ML in Cyber Security - Why Algorithms are Dangerous

AI & ML in Cyber Security - Why Algorithms are Dangerous

AI & ML in Cyber Security - Why Algorithms are Dangerous

Hacking Predictive Modeling - RoadSec 2018

Hacking Predictive Modeling - RoadSec 2018

Hacking Predictive Modeling - RoadSec 2018

Organizations are collecting massive amounts of data from disparate sources. However, they continuously face the challenge of identifying patterns, detecting anomalies, and projecting future trends based on large data sets. Machine learning for anomaly detection provides a promising alternative for the detection and classification of anomalies. Find out how you can implement machine learning to increase speed and effectiveness in identifying and reporting anomalies. In this webinar, we will discuss : How machine learning can help in identifying anomalies Steps to approach an anomaly detection problem Various techniques available for anomaly detection Best algorithms that fit in different situations Implementing an anomaly detection use case on the StreamAnalytix platform To view the webinar - https://bit.ly/2IV2ahC

Anomaly detection with machine learning at scale

Anomaly detection with machine learning at scale

Anomaly detection with machine learning at scale

Impetus Technologies

LSTM Tutorial

Ralph Schlosser

Lstm

데이터를 둘러싼 정책과, 기업과 기술의 진화는 빠르게 변화하고 있으며, 모든 지향점은 기업들이 다양한 데이터를 활용하여 경쟁력을 확보하고 이를 통해 AI기반의 혁신을 하고자 하는데 있다. 이 과정에서 수 많은 기업의 업무 전무가, 데이터 사이언티스트 등이 다양한 기업의 혁신을 지원할 수 있는 AI 모델을 검증하는 과정을 거치게 됩니다. 하지만, 이렇게 수 많은 AI 모델이 실제 비즈니스에 적용되기 위해서는 인프라, 및 서비스 관점의 기술이 반드시 필요하게 됩니다. MLOps는 기업에 필요한 혁신적인 아이디어(AI Model)을 적시에 비즈니스 환경에 적용할 수 있도록 지원하는 기술 및 트렌드 입니다. 주요 내용은 - 데이터를 둘러싼 환경의 변화 - 기업의 AI Model 적용시 마주하는 현실 - MLOps가 해결 가능한 문제들 - MLOps의 영역별 주요 기술들 - MLOps 도입 시 기업의 AI 환경은 어떻게 변할까? - AI 모델을 비즈니스 환경에 적용(배포)한다는 것은? 2021년 12월 코리아 데이터 비즈니스 트렌드(데이터산업진흥원 주최)에서 발표한 내용을 공유 가능한 부분만 정리함. 발표 영상 참고 : https://www.youtube.com/watch?v=lL-QtEzJ3WY

Trends_of_MLOps_tech_in_business

Trends_of_MLOps_tech_in_business

Trends_of_MLOps_tech_in_business

Random forest algorithm

Random forest algorithm

Random forest algorithm

Cyber threat intelligence ppt

Cyber threat intelligence ppt

Cyber threat intelligence ppt

Wine industries use Product Quality Certification to promote their products and become a concern for every individual who consumes any product. But it's not possible to ensure wine quality by experts with such a huge demand for the product as it will increase the cost. It allows building a model using machine learning techniques with a user interface which predicts the quality of the wine by selecting the important parameters.

Wine Quality Analysis Using Machine Learning

Wine Quality Analysis Using Machine Learning

Wine Quality Analysis Using Machine Learning

A gentle introduction to Microsoft's AutoML SDK package. This presentation introduces the concept of why automated machine learning has an important place in any data scientists tool box. Auto ML SDK allows you to to build and run machine learning workflows with the Azure Machine Learning service. You can interact with the service in any Python environment, including Jupyter Notebooks or your favourite Python IDE. The demos included in the presentation are making use of the Azure Notebooks.

Microsoft Introduction to Automated Machine Learning

Microsoft Introduction to Automated Machine Learning

Microsoft Introduction to Automated Machine Learning

What's hot (20)

Data drift and machine learning

Data drift and machine learning

Data drift and machine learning

Fraud detection system

Fraud detection system

Fraud detection system

Detecting fraud with Python and machine learning

Detecting fraud with Python and machine learning

Detecting fraud with Python and machine learning

Malware Dectection Using Machine learning

Malware Dectection Using Machine learning

Malware Dectection Using Machine learning

Overfitting.pptx

Overfitting.pptx

Overfitting.pptx

Anomaly detection Workshop slides

Anomaly detection Workshop slides

Anomaly detection Workshop slides

Multiclass classification of imbalanced data

Multiclass classification of imbalanced data

Multiclass classification of imbalanced data

Threat Hunting

Credit Card Fraud Detection Using ML In Databricks

Credit Card Fraud Detection Using ML In Databricks

Credit Card Fraud Detection Using ML In Databricks

Wrapper feature selection method

Wrapper feature selection method

Wrapper feature selection method

AI & ML in Cyber Security - Why Algorithms are Dangerous

AI & ML in Cyber Security - Why Algorithms are Dangerous

AI & ML in Cyber Security - Why Algorithms are Dangerous

Hacking Predictive Modeling - RoadSec 2018

Hacking Predictive Modeling - RoadSec 2018

Hacking Predictive Modeling - RoadSec 2018

Anomaly detection with machine learning at scale

Anomaly detection with machine learning at scale

Anomaly detection with machine learning at scale

LSTM Tutorial

Lstm

Trends_of_MLOps_tech_in_business

Trends_of_MLOps_tech_in_business

Trends_of_MLOps_tech_in_business

Random forest algorithm

Random forest algorithm

Random forest algorithm

Cyber threat intelligence ppt

Cyber threat intelligence ppt

Cyber threat intelligence ppt

Wine Quality Analysis Using Machine Learning

Wine Quality Analysis Using Machine Learning

Wine Quality Analysis Using Machine Learning

Microsoft Introduction to Automated Machine Learning

Microsoft Introduction to Automated Machine Learning

Microsoft Introduction to Automated Machine Learning

Similar to Needle in the Haystack—User Behavior Anomaly Detection for Information Security with Ping Yan and Wei Deng

Selection criteria for today’s ICS cybersecurity technology presented at S4 2019. Includes: - Recommendations for best practices before evaluating an industrial cybersecurity solution in OT environments - Outline of different ICS cybersecurity technologies such as the differences between active and passive scanning, anomaly detection, threat behavior analytics - What’s important in an industrial control systems cybersecurity platform - Practical guide to pilots and bake-offs To learn more read the whitepaper Key Considerations For Selecting An Industrial Cybersecurity Solution for Asset Identification, Threat Detection, and Response https://dragos.com/resource/key-considerations-for-selecting-an-industrial-cybersecurity-solution-for-asset-identification-threat-detection-and-response/ For more about Dragos and the 2019 S4 Detection challenge, read the blog and watch the video here: https://dragos.com/blog/industry-news/dragos-results-of-s4-industrial-cybersecurity-detection-challenge-contest/ More info: www.dragos.com Follow us on LinkedIn: https://www.linkedin.com/company/dragos-inc./ Follow us on Twitter: https://twitter.com/dragosinc

Industrial Control Systems Cybersecurity Technology Selection

Industrial Control Systems Cybersecurity Technology Selection

Industrial Control Systems Cybersecurity Technology Selection

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

IBM QRadar UBA

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

TTPs for Threat hunting In Oil Refineries

TTPs for Threat hunting In Oil Refineries

TTPs for Threat hunting In Oil Refineries

CSA SV Threat detection and prediction

CSA SV Threat detection and prediction

CSA SV Threat detection and prediction

IT Operation Analytic for security- MiSSconf(sp1)

IT Operation Analytic for security- MiSSconf(sp1)

IT Operation Analytic for security- MiSSconf(sp1)

Nguyễn Tấn Vi - office of the CISO

Nguyễn Tấn Vi - office of the CISO

Nguyễn Tấn Vi - office of the CISO

Security Bootcamp

Splunk for Security: Background & Customer Case Study

Splunk for Security: Background & Customer Case Study

Splunk for Security: Background & Customer Case Study

ThirdEye - LinkedIn's Business-wide monitoring platform

ThirdEye - LinkedIn's Business-wide monitoring platform

ThirdEye - LinkedIn's Business-wide monitoring platform

CNIT 121: 2 IR Management Handbook

CNIT 121: 2 IR Management Handbook

CNIT 121: 2 IR Management Handbook

Build 2016 - T666 - Interactive Analytics with Application Insights

Build 2016 - T666 - Interactive Analytics with Application Insights

Build 2016 - T666 - Interactive Analytics with Application Insights

Windows Developer

Cyber Security and Data Science

Cyber Security and Data Science

Cyber Security and Data Science

Azure Application insights - An Introduction

Azure Application insights - An Introduction

Azure Application insights - An Introduction

Matthias Güntert

The intellectual property stored in your SCM system comprises your company’s most valuable assets. How do you keep those assets safe from threats inside and outside your organization? This session by Charlie McLouth, Director of Technical Sales at Perforce, and Mark Bennett, Vice President at Interset, will give you a deep dive into how Perforce Helix keeps your assets safe, including real-world scenarios of Interset's Threat Detection. You’ll hear how Interset Threat Detection applies advanced behavioral analytics to user activities to proactively surface threats to the IP stored in the Helix Versioning Engine. You’ll also hear how Helix’s fine-grained permissions model provides unified security policies that govern access-control based on LDAP authentication and contextual information such as IP address of the client or file paths.

Protecting Your IP with Perforce Helix and Interset

Protecting Your IP with Perforce Helix and Interset

Protecting Your IP with Perforce Helix and Interset

Information systems in the digital age are complex and expansive, with attack vectors coming in from every angle. This makes analyzing risk challenging, but more critical than ever. There is a need to better understand the dynamics of modern IT systems, security controls that protect them, and best practices for adherence to today’s GRC requirements. These slides are from our webinar covering topics like: · Threats, vulnerabilities, weaknesses – why their difference matters · How vulnerability scanning can help (and hinder) your efforts · Security engineering and the system development lifecycle · High impact activities - application risk rating and threat modeling

Assessing System Risk the Smart Way

Assessing System Risk the Smart Way

Assessing System Risk the Smart Way

Security Innovation

Face recognition technology

Face recognition technology

Face recognition technology

Implementing A User Activity & Behavior Monitoring Program

Implementing A User Activity & Behavior Monitoring Program

Implementing A User Activity & Behavior Monitoring Program

This presentation was delivered at BSides Augusta in September 2016. The A/V portion is available here: https://www.youtube.com/watch?v=i6p71t9PFWM Abstract: "We can all agree that threat ("Evil") detection is an essential component of a functioning security monitoring program. Let's start thinking about how to take our tradecraft to the next level and hunt for insecure conditions ("Ways for Evil to do Evil things") that might allow threat actors to succeed in their mission. This talk will run through some of the observations gathered during hunting expeditions inside the networks of multiple Fortune-ranked organizations and challenge you to expand your security operations thinking beyond signature-based detection. - What is Hunting? - How have we done it? - What have we found, and what should be done about those findings? - How might you achieve similar outcomes in your own environment?" Speakers: - Jacqueline Stokes (@find_evil) is an infosec enthusiast who picked up hacking as a preteen and cut her teeth over multiple years in Iraq. Her ongoing mission is to assess and advise clients on the most actionable and forward-thinking methods to improve detection, response, and containment of advanced threats. Jackie likes long walks on the beach, 90's nostalgia, and is the president and founding member of the Kevin Mandia Fan Club. - Danny Akacki (@dakacki) was a Lead Analyst with GE Capitals' Applied Intelligence team prior to his employment with Mandiant, and now works for Bank of America's hunt team. He is a pragmatic optimist and believes we are probably screwed, but hopes we aren't. Danny enjoys finding evil on the weekends. - Stephen Hinck (@stephenhinck) is a Senior Security Analyst at Oracle, Inc. Stephen stumbled into the information security world years ago and has since only managed to dig his way deeper to the rabbit hole. With a background in security operations, incident response and threat hunting, Stephen's experience is multi-faceted. Although he enjoys many things, he absolutely hates writing silly bios like this one.

Hunting: Defense Against The Dark Arts

Hunting: Defense Against The Dark Arts

Hunting: Defense Against The Dark Arts

Spyglass Security

Similar to Needle in the Haystack—User Behavior Anomaly Detection for Information Security with Ping Yan and Wei Deng (20)

Industrial Control Systems Cybersecurity Technology Selection

Industrial Control Systems Cybersecurity Technology Selection

Industrial Control Systems Cybersecurity Technology Selection

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

USING BEHAVIOR TO IMPROVE SECURITY AND ENHANCE RELATIONSHIPS

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

Finding the needle in the haystack: how Nestle is leveraging big data to defe...

IBM QRadar UBA

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

Rocana Deep Dive OC Big Data Meetup #19 Sept 21st 2016

TTPs for Threat hunting In Oil Refineries

TTPs for Threat hunting In Oil Refineries

TTPs for Threat hunting In Oil Refineries

CSA SV Threat detection and prediction

CSA SV Threat detection and prediction

CSA SV Threat detection and prediction

IT Operation Analytic for security- MiSSconf(sp1)

IT Operation Analytic for security- MiSSconf(sp1)

IT Operation Analytic for security- MiSSconf(sp1)

Nguyễn Tấn Vi - office of the CISO

Nguyễn Tấn Vi - office of the CISO

Nguyễn Tấn Vi - office of the CISO

Splunk for Security: Background & Customer Case Study

Splunk for Security: Background & Customer Case Study

Splunk for Security: Background & Customer Case Study

ThirdEye - LinkedIn's Business-wide monitoring platform

ThirdEye - LinkedIn's Business-wide monitoring platform

ThirdEye - LinkedIn's Business-wide monitoring platform

CNIT 121: 2 IR Management Handbook

CNIT 121: 2 IR Management Handbook

CNIT 121: 2 IR Management Handbook

Build 2016 - T666 - Interactive Analytics with Application Insights

Build 2016 - T666 - Interactive Analytics with Application Insights

Build 2016 - T666 - Interactive Analytics with Application Insights

Cyber Security and Data Science

Cyber Security and Data Science

Cyber Security and Data Science

Azure Application insights - An Introduction

Azure Application insights - An Introduction

Azure Application insights - An Introduction

Protecting Your IP with Perforce Helix and Interset

Protecting Your IP with Perforce Helix and Interset

Protecting Your IP with Perforce Helix and Interset

Assessing System Risk the Smart Way

Assessing System Risk the Smart Way

Assessing System Risk the Smart Way

Face recognition technology

Face recognition technology

Face recognition technology

Implementing A User Activity & Behavior Monitoring Program

Implementing A User Activity & Behavior Monitoring Program

Implementing A User Activity & Behavior Monitoring Program

Hunting: Defense Against The Dark Arts

Hunting: Defense Against The Dark Arts

Hunting: Defense Against The Dark Arts

More from Databricks

DW Migration Webinar-March 2022.pptx

DW Migration Webinar-March 2022.pptx

DW Migration Webinar-March 2022.pptx

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 1

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 1 | Part 2

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 2

The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse. Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today. Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow. This is an educational event. Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.

Data Lakehouse Symposium | Day 4

Data Lakehouse Symposium | Day 4

Data Lakehouse Symposium | Day 4

In this session, learn how to quickly supplement your on-premises Hadoop environment with a simple, open, and collaborative cloud architecture that enables you to generate greater value with scaled application of analytics and AI on all your data. You will also learn five critical steps for a successful migration to the Databricks Lakehouse Platform along with the resources available to help you begin to re-skill your data teams.

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

Bad data leads to bad decisions and broken customer experiences. Organizations depend on complete and accurate data to power their business, maintain efficiency, and uphold customer trust. With thousands of datasets and pipelines running, how do we ensure that all data meets quality standards, and that expectations are clear between producers and consumers? Investing in shared, flexible components and practices for monitoring data health is crucial for a complex data organization to rapidly and effectively scale. At Zillow, we built a centralized platform to meet our data quality needs across stakeholders. The platform is accessible to engineers, scientists, and analysts, and seamlessly integrates with existing data pipelines and data discovery tools. In this presentation, we will provide an overview of our platform’s capabilities, including: Giving producers and consumers the ability to define and view data quality expectations using a self-service onboarding portal Performing data quality validations using libraries built to work with spark Dynamically generating pipelines that can be abstracted away from users Flagging data that doesn’t meet quality standards at the earliest stage and giving producers the opportunity to resolve issues before use by downstream consumers Exposing data quality metrics alongside each dataset to provide producers and consumers with a comprehensive picture of health over time

Democratizing Data Quality Through a Centralized Platform

Democratizing Data Quality Through a Centralized Platform

Democratizing Data Quality Through a Centralized Platform

Data scientists face numerous challenges throughout the data science workflow that hinder productivity. As organizations continue to become more data-driven, a collaborative environment is more critical than ever — one that provides easier access and visibility into the data, reports and dashboards built against the data, reproducibility, and insights uncovered within the data.. Join us to hear how Databricks’ open and collaborative platform simplifies data science by enabling you to run all types of analytics workloads, from data preparation to exploratory analysis and predictive analytics, at scale — all on one unified platform.

Learn to Use Databricks for Data Science

Learn to Use Databricks for Data Science

Learn to Use Databricks for Data Science

Application performance monitoring (APM) has become the cornerstone of software engineering allowing engineering teams to quickly identify and remedy production issues. However, as the world moves to intelligent software applications that are built using machine learning, traditional APM quickly becomes insufficient to identify and remedy production issues encountered in these modern software applications. As a lead software engineer at NewRelic, my team built high-performance monitoring systems including Insights, Mobile, and SixthSense. As I transitioned to building ML Monitoring software, I found the architectural principles and design choices underlying APM to not be a good fit for this brand new world. In fact, blindly following APM designs led us down paths that would have been better left unexplored. In this talk, I draw upon my (and my team’s) experience building an ML Monitoring system from the ground up and deploying it on customer workloads running large-scale ML training with Spark as well as real-time inference systems. I will highlight how the key principles and architectural choices of APM don’t apply to ML monitoring. You’ll learn why, understand what ML Monitoring can successfully borrow from APM, and hear what is required to build a scalable, robust ML Monitoring architecture.

Why APM Is Not the Same As ML Monitoring

Why APM Is Not the Same As ML Monitoring

Why APM Is Not the Same As ML Monitoring

Autonomy and ownership are core to working at Stitch Fix, particularly on the Algorithms team. We enable data scientists to deploy and operate their models independently, with minimal need for handoffs or gatekeeping. By writing a simple function and calling out to an intuitive API, data scientists can harness a suite of platform-provided tooling meant to make ML operations easy. In this talk, we will dive into the abstractions the Data Platform team has built to enable this. We will go over the interface data scientists use to specify a model and what that hooks into, including online deployment, batch execution on Spark, and metrics tracking and visualization.

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

In this talk, I will dive into the stage level scheduling feature added to Apache Spark 3.1. Stage level scheduling extends upon Project Hydrogen by improving big data ETL and AI integration and also enables multiple other use cases. It is beneficial any time the user wants to change container resources between stages in a single Apache Spark application, whether those resources are CPU, Memory or GPUs. One of the most popular use cases is enabling end-to-end scalable Deep Learning and AI to efficiently use GPU resources. In this type of use case, users read from a distributed file system, do data manipulation and filtering to get the data into a format that the Deep Learning algorithm needs for training or inference and then sends the data into a Deep Learning algorithm. Using stage level scheduling combined with accelerator aware scheduling enables users to seamlessly go from ETL to Deep Learning running on the GPU by adjusting the container requirements for different stages in Spark within the same application. This makes writing these applications easier and can help with hardware utilization and costs. There are other ETL use cases where users want to change CPU and memory resources between stages, for instance there is data skew or perhaps the data size is much larger in certain stages of the application. In this talk, I will go over the feature details, cluster requirements, the API and use cases. I will demo how the stage level scheduling API can be used by Horovod to seamlessly go from data preparation to training using the Tensorflow Keras API using GPUs. The talk will also touch on other new Apache Spark 3.1 functionality, such as pluggable caching, which can be used to enable faster dataframe access when operating from GPUs.

Stage Level Scheduling Improving Big Data and AI Integration

Stage Level Scheduling Improving Big Data and AI Integration

Stage Level Scheduling Improving Big Data and AI Integration

In this talk, I would like to introduce an open-source tool built by our team that simplifies the data conversion from Apache Spark to deep learning frameworks. Imagine you have a large dataset, say 20 GBs, and you want to use it to train a TensorFlow model. Before feeding the data to the model, you need to clean and preprocess your data using Spark. Now you have your dataset in a Spark DataFrame. When it comes to the training part, you may have the problem: How can I convert my Spark DataFrame to some format recognized by my TensorFlow model? The existing data conversion process can be tedious. For example, to convert an Apache Spark DataFrame to a TensorFlow Dataset file format, you need to either save the Apache Spark DataFrame on a distributed filesystem in parquet format and load the converted data with third-party tools such as Petastorm, or save it directly in TFRecord files with spark-tensorflow-connector and load it back using TFRecordDataset. Both approaches take more than 20 lines of code to manage the intermediate data files, rely on different parsing syntax, and require extra attention for handling vector columns in the Spark DataFrames. In short, all these engineering frictions greatly reduced the data scientists’ productivity. The Databricks Machine Learning team contributed a new Spark Dataset Converter API to Petastorm to simplify these tedious data conversion process steps. With the new API, it takes a few lines of code to convert a Spark DataFrame to a TensorFlow Dataset or a PyTorch DataLoader with default parameters. In the talk, I will use an example to show how to use the Spark Dataset Converter to train a Tensorflow model and how simple it is to go from single-node training to distributed training on Databricks.

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Simplify Data Conversion from Spark to TensorFlow and PyTorch

There is no doubt Kubernetes has emerged as the next generation of cloud native infrastructure to support a wide variety of distributed workloads. Apache Spark has evolved to run both Machine Learning and large scale analytics workloads. There is growing interest in running Apache Spark natively on Kubernetes. By combining the flexibility of Kubernetes and scalable data processing with Apache Spark, you can run any data and machine pipelines on this infrastructure while effectively utilizing resources at disposal. In this talk, Rajesh Thallam and Sougata Biswas will share how to effectively run your Apache Spark applications on Google Kubernetes Engine (GKE) and Google Cloud Dataproc, orchestrate the data and machine learning pipelines with managed Apache Airflow on GKE (Google Cloud Composer). Following topics will be covered: – Understanding key traits of Apache Spark on Kubernetes- Things to know when running Apache Spark on Kubernetes such as autoscaling- Demonstrate running analytics pipelines on Apache Spark orchestrated with Apache Airflow on Kubernetes cluster.

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling your Data Pipelines with Apache Spark on Kubernetes

Pipelines have become ubiquitous, as the need for stringing multiple functions to compose applications has gained adoption and popularity. Common pipeline abstractions such as “fit” and “transform” are even shared across divergent platforms such as Python Scikit-Learn and Apache Spark. Scaling pipelines at the level of simple functions is desirable for many AI applications, however is not directly supported by Ray’s parallelism primitives. In this talk, Raghu will describe a pipeline abstraction that takes advantage of Ray’s compute model to efficiently scale arbitrarily complex pipeline workflows. He will demonstrate how this abstraction cleanly unifies pipeline workflows across multiple platforms such as Scikit-Learn and Spark, and achieves nearly optimal scale-out parallelism on pipelined computations. Attendees will learn how pipelined workflows can be mapped to Ray’s compute model and how they can both unify and accelerate their pipelines with Ray.

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

In this talk about zipline, we will introduce a new type of windowing construct called a sawtooth window. We will describe various properties about sawtooth windows that we utilize to achieve online-offline consistency, while still maintaining high-throughput, low-read latency and tunable write latency for serving machine learning features.We will also talk about a simple deployment strategy for correcting feature drift – due operations that are not “abelian groups”, that operate over change data.

Sawtooth Windows for Feature Aggregations

Sawtooth Windows for Feature Aggregations

Sawtooth Windows for Feature Aggregations

We want to present multiple anti patterns utilizing Redis in unconventional ways to get the maximum out of Apache Spark.All examples presented are tried and tested in production at Scale at Adobe. The most common integration is spark-redis which interfaces with Redis as a Dataframe backing Store or as an upstream for Structured Streaming. We deviate from the common use cases to explore where Redis can plug gaps while scaling out high throughput applications in Spark. Niche 1 : Long Running Spark Batch Job – Dispatch New Jobs by polling a Redis Queue · Why? o Custom queries on top a table; We load the data once and query N times · Why not Structured Streaming · Working Solution using Redis Niche 2 : Distributed Counters · Problems with Spark Accumulators · Utilize Redis Hashes as distributed counters · Precautions for retries and speculative execution · Pipelining to improve performance

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

In the era of microservices, decentralized ML architectures and complex data pipelines, data quality has become a bigger challenge than ever. When data is involved in complex business processes and decisions, bad data can, and will, affect the bottom line. As a result, ensuring data quality across the entire ML pipeline is both costly, and cumbersome while data monitoring is often fragmented and performed ad hoc. To address these challenges, we built whylogs, an open source standard for data logging. It is a lightweight data profiling library that enables end-to-end data profiling across the entire software stack. The library implements a language and platform agnostic approach to data quality and data monitoring. It can work with different modes of data operations, including streaming, batch and IoT data. In this talk, we will provide an overview of the whylogs architecture, including its lightweight statistical data collection approach and various integrations. We will demonstrate how the whylogs integration with Apache Spark achieves large scale data profiling, and we will show how users can apply this integration into existing data and ML pipelines.

Re-imagine Data Monitoring with whylogs and Spark

Re-imagine Data Monitoring with whylogs and Spark

Re-imagine Data Monitoring with whylogs and Spark

Machine learning (ML) models are typically part of prediction queries that consist of a data processing part (e.g., for joining, filtering, cleaning, featurization) and an ML part invoking one or more trained models. In this presentation, we identify significant and unexplored opportunities for optimization. To the best of our knowledge, this is the first effort to look at prediction queries holistically, optimizing across both the ML and SQL components. We will present Raven, an end-to-end optimizer for prediction queries. Raven relies on a unified intermediate representation that captures both data processing and ML operators in a single graph structure. This allows us to introduce optimization rules that (i) reduce unnecessary computations by passing information between the data processing and ML operators (ii) leverage operator transformations (e.g., turning a decision tree to a SQL expression or an equivalent neural network) to map operators to the right execution engine, and (iii) integrate compiler techniques to take advantage of the most efficient hardware backend (e.g., CPU, GPU) for each operator. We have implemented Raven as an extension to Spark’s Catalyst optimizer to enable the optimization of SparkSQL prediction queries. Our implementation also allows the optimization of prediction queries in SQL Server. As we will show, Raven is capable of improving prediction query performance on Apache Spark and SQL Server by up to 13.1x and 330x, respectively. For complex models, where GPU acceleration is beneficial, Raven provides up to 8x speedup compared to state-of-the-art systems. As part of the presentation, we will also give a demo showcasing Raven in action.

Raven: End-to-end Optimization of ML Prediction Queries

Raven: End-to-end Optimization of ML Prediction Queries

Raven: End-to-end Optimization of ML Prediction Queries

Semantic segmentation is the classification of every pixel in an image/video. The segmentation partitions a digital image into multiple objects to simplify/change the representation of the image into something that is more meaningful and easier to analyze [1][2]. The technique has a wide variety of applications ranging from perception in autonomous driving scenarios to cancer cell segmentation for medical diagnosis. Exponential growth in the datasets that require such segmentation is driven by improvements in the accuracy and quality of the sensors generating the data extending to 3D point cloud data. This growth is further compounded by exponential advances in cloud technologies enabling the storage and compute available for such applications. The need for semantically segmented datasets is a key requirement to improve the accuracy of inference engines that are built upon them. Streamlining the accuracy and efficiency of these systems directly affects the value of the business outcome for organizations that are developing such functionalities as a part of their AI strategy. This presentation details workflows for labeling, preprocessing, modeling, and evaluating performance/accuracy. Scientists and engineers leverage domain-specific features/tools that support the entire workflow from labeling the ground truth, handling data from a wide variety of sources/formats, developing models and finally deploying these models. Users can scale their deployments optimally on GPU-based cloud infrastructure to build accelerated training and inference pipelines while working with big datasets. These environments are optimized for engineers to develop such functionality with ease and then scale against large datasets with Spark-based clusters on the cloud.

Processing Large Datasets for ADAS Applications using Apache Spark

Processing Large Datasets for ADAS Applications using Apache Spark

Processing Large Datasets for ADAS Applications using Apache Spark

At Adobe Experience Platform, we ingest TBs of data every day and manage PBs of data for our customers as part of the Unified Profile Offering. At the heart of this is a bunch of complex ingestion of a mix of normalized and denormalized data with various linkage scenarios power by a central Identity Linking Graph. This helps power various marketing scenarios that are activated in multiple platforms and channels like email, advertisements etc. We will go over how we built a cost effective and scalable data pipeline using Apache Spark and Delta Lake and share our experiences. What are we storing? Multi Source – Multi Channel Problem Data Representation and Nested Schema Evolution Performance Trade Offs with Various formats Go over anti-patterns used (String FTW) Data Manipulation using UDFs Writer Worries and How to Wipe them Away Staging Tables FTW Datalake Replication Lag Tracking Performance Time!

Massive Data Processing in Adobe Using Delta Lake

Massive Data Processing in Adobe Using Delta Lake

Massive Data Processing in Adobe Using Delta Lake

More from Databricks (20)

DW Migration Webinar-March 2022.pptx

DW Migration Webinar-March 2022.pptx

DW Migration Webinar-March 2022.pptx

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 1

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 1 | Part 2

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 2

Data Lakehouse Symposium | Day 4

Data Lakehouse Symposium | Day 4

Data Lakehouse Symposium | Day 4

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop

Democratizing Data Quality Through a Centralized Platform

Democratizing Data Quality Through a Centralized Platform

Democratizing Data Quality Through a Centralized Platform

Learn to Use Databricks for Data Science

Learn to Use Databricks for Data Science

Learn to Use Databricks for Data Science

Why APM Is Not the Same As ML Monitoring

Why APM Is Not the Same As ML Monitoring

Why APM Is Not the Same As ML Monitoring

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix

Stage Level Scheduling Improving Big Data and AI Integration

Stage Level Scheduling Improving Big Data and AI Integration

Stage Level Scheduling Improving Big Data and AI Integration

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Simplify Data Conversion from Spark to TensorFlow and PyTorch

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling your Data Pipelines with Apache Spark on Kubernetes

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Scaling and Unifying SciKit Learn and Apache Spark Pipelines

Sawtooth Windows for Feature Aggregations

Sawtooth Windows for Feature Aggregations

Sawtooth Windows for Feature Aggregations

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink

Re-imagine Data Monitoring with whylogs and Spark

Re-imagine Data Monitoring with whylogs and Spark

Re-imagine Data Monitoring with whylogs and Spark

Raven: End-to-end Optimization of ML Prediction Queries

Raven: End-to-end Optimization of ML Prediction Queries

Raven: End-to-end Optimization of ML Prediction Queries

Processing Large Datasets for ADAS Applications using Apache Spark

Processing Large Datasets for ADAS Applications using Apache Spark

Processing Large Datasets for ADAS Applications using Apache Spark

Massive Data Processing in Adobe Using Delta Lake

Massive Data Processing in Adobe Using Delta Lake

Massive Data Processing in Adobe Using Delta Lake

Recently uploaded

原版定制【微信:176555708】【圣地亚哥州立大学毕业证（SDSU毕业证书）】【微信:176555708】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。【业务选择办理准则】一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信176555708】文凭即可二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信176555708】即可三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才留信网服务项目： 1、留学生专业人才库服务（留信分析） 2、国（境）学习人员提供就业推荐信服务 3、留学人员区块链存储服务 → 【关于价格问题（保证一手价格）】我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子我给客户的都是第一手的代理价格，因为我想坦诚对待大家不想跟大家在价格方面浪费时间对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...

Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...

Top profile Call Girls In Rohtak [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Rohtak [ 7014168258 ] Call Me For Genuine Models We...

Digital Transformation Playbook by Graham Ware

Digital Transformation Playbook by Graham Ware

Digital Transformation Playbook by Graham Ware

Top profile Call Girls In Nandurbar [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Nandurbar [ 7014168258 ] Call Me For Genuine Models...

Introduction to Statistics Presentation.pptx

Introduction to Statistics Presentation.pptx

Introduction to Statistics Presentation.pptx

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

Elaine Werffeli

Case Study 4 Where the cry of rebellion happen?

Case Study 4 Where the cry of rebellion happen?

Case Study 4 Where the cry of rebellion happen?

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

meghakumariji156

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 Rita Sharma Ji Our agency presents a selection of young, charming call girls #J11 available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives,#J11 College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in-call and out-call services for your convenience. Our in-call location in Kolkata ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500/in-call, ₹6000/out-call Body to body massage with sex: ₹3000/in-call Full night for one person: ₹7000/in-call, ₹10000/out-call Full night for more than 1 person: Contact us at 🔝 8005736733 🔝. for details Operating 24/7, we serve various locations in Kolkata, including Green Park, near metro stations. For premium call girl services in Kolkata 🔝 8005736733 🔝. Thank you for considering us!

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Statistics notes ,it includes mean to index numbers

Statistics notes ,it includes mean to index numbers

Statistics notes ,it includes mean to index numbers

20240412-SmartCityIndex-2024-Full-Report.pdf

20240412-SmartCityIndex-2024-Full-Report.pdf

20240412-SmartCityIndex-2024-Full-Report.pdf

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort Service Available 24/7 Hire CALL GIRL IN Lucknow 9548273370 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL IN #j11 We are Providing :- ● – Private independent collage Going girls . ● – independent Models . ● – House Wife’s . ● – Private Independent House Wife’s ● – Corporate M.N.C Working Profiles . ● – Call Center Girls . ● – Live Band Girls . ●- Foreigners & Many More . Service type: 1.In call 2.out call 3. full Lip to Lip kiss 4.69 5.b-job without Condom 6. Hard Core sex & Much More. 7 Body to Body Touch 8 Kissing 9 Sucking Boobs and More 10 Enjoy by Hand 11 Relax By Oral 12 Sex with Happy Ending • In Call and Out Call Service • 3* 5* 7* Hotels Service • 24 Hours Available • Indian, Russian, Punjabi, Kashmiri Escorts • Real Models, College Girls, House Wife, Also Available • Short Time and Full Time Service Available • Hygienic Full AC Neat and Clean Rooms Avail. In Hotel 24 hours • Daily Escorts Staff Available • Minimum to Maximu m Range Available.c

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...

Context 1. Housing Agent collected resale prices on HDB apartments in Singapore. Objective 2. To predict resale prices in to advise his potential clients. Strategies 3. Explore & Clean data for analysis. 4. Perform K-Means Clustering, in Orange, to find possible segments in the customer data. 5. Tune the model to improve its performance. 6. Visualise the findings, share conclusions, and give insight-driven recommendations. Author: Anthony mok Date: 18 Nov 2023 Email: xxiaohao@yahoo.com

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

ThinkInnovation

Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...

Ranking and Scoring Exercises for Research

Ranking and Scoring Exercises for Research

Ranking and Scoring Exercises for Research

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736733 Neha Thakur Our agency presents a selection of young, charming call girls #J11 available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives,#J11 College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in-call and out-call services for your convenience. Our in-call location in Kolkata ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500/in-call, ₹6000/out-call Body to body massage with sex: ₹3000/in-call Full night for one person: ₹7000/in-call, ₹10000/out-call Full night for more than 1 person: Contact us at 🔝 8005736733 🔝. for details Operating 24/7, we serve various locations in Kolkata, including Green Park, near metro stations. For premium call girl services in Kolkata 🔝 8005736733 🔝. Thank you for considering us!

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We are available 24*7 Booking Contact Details :- WhatsApp Chat :- +91-7014168258 If you're looking for India Call girls you've come to the right place. You'll find some of the most beautiful call girls in our location with. These ladies have pleasing personalities, hot figures, and a passion for physical pleasure. Call girls in India Lucknow Many men have booked them for their erotic and soul-mixing performances, which are sure to leave you with unforgettable memories. #K09 Escort Service India is available in the city for men and women of all ages. They can satisfy your sexual needs and will make your experience even more enjoyable and memorable. Whether you're looking for a blow-job, stripping, lovemaking, or other dirty acts, you'll be able to find a match for your tastes and budget. These highly trained professionals will help you have an unforgettable night. One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7014168258 We are available 24*7 all days of the year. Call us — 7014168258 Thank you for Visiting.

Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...

Recently uploaded (20)

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

怎样办理圣地亚哥州立大学毕业证（SDSU毕业证书）成绩单学校原版复制

Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...

Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...

Top profile Call Girls In Rohtak [ 7014168258 ] Call Me For Genuine Models We...

Digital Transformation Playbook by Graham Ware

Digital Transformation Playbook by Graham Ware

Digital Transformation Playbook by Graham Ware

Top profile Call Girls In Nandurbar [ 7014168258 ] Call Me For Genuine Models...

Introduction to Statistics Presentation.pptx

Introduction to Statistics Presentation.pptx

Introduction to Statistics Presentation.pptx

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...

Case Study 4 Where the cry of rebellion happen?

Case Study 4 Where the cry of rebellion happen?

Case Study 4 Where the cry of rebellion happen?

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

Giridih Escorts Service Girl ^ 9332606886, WhatsApp Anytime Giridih

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Kalyani ? Call Girl in Kolkata | Service-oriented sexy call girls 8005736733 ...

Statistics notes ,it includes mean to index numbers

Statistics notes ,it includes mean to index numbers

Statistics notes ,it includes mean to index numbers

20240412-SmartCityIndex-2024-Full-Report.pdf

20240412-SmartCityIndex-2024-Full-Report.pdf

20240412-SmartCityIndex-2024-Full-Report.pdf

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...

Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange

Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...

Ranking and Scoring Exercises for Research

Ranking and Scoring Exercises for Research

Ranking and Scoring Exercises for Research

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Sealdah % High Class Call Girls Kolkata - 450+ Call Girl Cash Payment 8005736...

Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...

Needle in the Haystack—User Behavior Anomaly Detection for Information Security with Ping Yan and Wei Deng

1. User Behavior Anomaly Detection for Platform Security Wei Deng, Ping Yan Needle in the Haystack

2. Information Security is Hard • Signatures & Rules Known knowns • Correlation Analysis Known unknowns • Anomaly Detection Unknown unknowns 2

3. User In-app Behavior WHO WHEN WHERE HOW WHAT Actions logins UI page views API calls password reset ... Entities client IP timestamps user agents ... Derived hour of day day of week geo country ... 3

4. Challenges • Size of data, speed to response • Variability of threats • Little to none ground truth • Feature selection • User behavior novelty 4

5. A Behavior Anomaly Detection Approach 5

6. Profile Store Anomaly Detection Engine Event PCA Matrix Selected Features Anomaly Detector Anomaly Profile Building Parsed Event User profiles Stage I – Profile Building Stage II – Detection Event Store PCA 6

7. PCA • High variance variables Representative of original data set • Low variance variables Representative of users’ stable behavior 7

8. Profile Building 3 statistics to summarize each user’s historical distribution • User’s behavior baseline • Variance of user’s behavior • Legitimate non-typical behavior 8

9. Profile Building 9

10. Detection • Deviation from user’s baseline • Re-scale deviation score with a correction factor 10

11. Detection 11

12. Evaluation with Synthetic Data 12

13. Deployment 13

14. Thank You. Wei Deng wdeng@salesforce.com Ping Yan pyan@salesforce.com @pingpingya