SlideShare una empresa de Scribd logo
1 de 11
Descargar para leer sin conexión
1
The Adversarial Robustness
Toolbox
Mathieu Sinn, PhD
Manager AI, Security & Privacy
IBM Research Europe
Dublin, Ireland
AICamp
IBM Series on AI Trust
August 24, 2020
Outline
• Adversarial threats to AI
• The Adversarial Robustness Toolbox
• Resources & Conclusions
“AI is the new electricity”
But… AI is also surprisingly brittle!
https://art-demo.mybluemix.net/
This does not only apply to images…
“Basketball throw” (72.5%) “Tennis swing” (49.5%)
Original Adversarial
https://github.com/Trusted-AI/adversarial-robustness-
toolbox/blob/main/notebooks/adversarial_action_recognition.ipynb
Adversarial Threats to AI
Financial services:
• Evade fraud detection
Autonomous vehicles:
• Targeted/untargeted
attacks on object
recognition and image
segmentation models
Cybersecurity:
• Evade spam filters,
malware detectors,
network intrusion
detection etc.
Security:
• Disappearance attacks
against CCTV
surveillance
Adversarial Threats to AI
Scenarios
Undermine trust in AI
8
Reports of cybersecurity vulnerabilities
due to evasion attacks against AI in
anti-malware / -virus products.
Such attacks are already happening...
Adversarial Robustness Toolbox (ART)
Repo: https://github.com/Trusted-AI/adversarial-robustness-toolbox
Docs: https://adversarial-robustness-toolbox.readthedocs.io/
Demo: https://art-demo.mybluemix.net
9
Open-source release @ RSA 2018:
Current stats:
• 1.6K GitHub stars
• 450+ forks
• 250+ clones/w
• 1K+ downloads/w
• Python library, 12K lines of code
• State-of-the-art attacks, defences and robustness metrics
Load classifier
model (Keras,
TF, PyTorch etc)
Perform attack
Load ART
modules
Evaluate
robustness
LightGBM
• GitHub
• https://github.com/Trusted-AI/adversarial-robustness-toolbox
• Documentation
• https://adversarial-robustness-toolbox.readthedocs.io
• Slack
• https://ibm-art.slack.com
• Demo
• https://art-demo.mybluemix.net/
• Blog
• https://www.ibm.com/blogs/research/2019/09/adversarial-robustness-360-toolbox-
v1-0
• White paper
• https://arxiv.org/abs/1807.01069
• Tutorial
• http://www.research.ibm.com/labs/ireland/nemesis2018/pdf/tutorial.pdf
Resources & Conclusions
https://www.research.ibm.com/artificial-intelligence/trusted-ai/
• Check Contributions page:
• https://github.com/Trusted-AI/adversarial-robustness-
toolbox/blob/main/CONTRIBUTING.md
• Create github issues for suspected bugs, missing features, ideas for
improvements etc.
• Contribute bug fixes, new features etc. via pull requests to dev branch
• Follow PEP 8 coding style, provide unit tests
• Sign DCO (via ‘-s’ flag) for every commit
ART – How to contribute?

Más contenido relacionado

Más de Bill Liu

Más de Bill Liu (20)

Deep Reinforcement Learning and Its Applications
Deep Reinforcement Learning and Its ApplicationsDeep Reinforcement Learning and Its Applications
Deep Reinforcement Learning and Its Applications
 
Big Data and AI in Fighting Against COVID-19
Big Data and AI in Fighting Against COVID-19Big Data and AI in Fighting Against COVID-19
Big Data and AI in Fighting Against COVID-19
 
Highly-scalable Reinforcement Learning RLlib for Real-world Applications
Highly-scalable Reinforcement Learning RLlib for Real-world ApplicationsHighly-scalable Reinforcement Learning RLlib for Real-world Applications
Highly-scalable Reinforcement Learning RLlib for Real-world Applications
 
Build computer vision models to perform object detection and classification w...
Build computer vision models to perform object detection and classification w...Build computer vision models to perform object detection and classification w...
Build computer vision models to perform object detection and classification w...
 
Causal Inference in Data Science and Machine Learning
Causal Inference in Data Science and Machine LearningCausal Inference in Data Science and Machine Learning
Causal Inference in Data Science and Machine Learning
 
Weekly #106: Deep Learning on Mobile
Weekly #106: Deep Learning on MobileWeekly #106: Deep Learning on Mobile
Weekly #106: Deep Learning on Mobile
 
Weekly #105: AutoViz and Auto_ViML Visualization and Machine Learning
Weekly #105: AutoViz and Auto_ViML Visualization and Machine LearningWeekly #105: AutoViz and Auto_ViML Visualization and Machine Learning
Weekly #105: AutoViz and Auto_ViML Visualization and Machine Learning
 
AISF19 - On Blending Machine Learning with Microeconomics
AISF19 - On Blending Machine Learning with MicroeconomicsAISF19 - On Blending Machine Learning with Microeconomics
AISF19 - On Blending Machine Learning with Microeconomics
 
AISF19 - Travel in the AI-First World
AISF19 - Travel in the AI-First WorldAISF19 - Travel in the AI-First World
AISF19 - Travel in the AI-First World
 
AISF19 - Unleash Computer Vision at the Edge
AISF19 - Unleash Computer Vision at the EdgeAISF19 - Unleash Computer Vision at the Edge
AISF19 - Unleash Computer Vision at the Edge
 
AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...
AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...
AISF19 - Building Scalable, Kubernetes-Native ML/AI Pipelines with TFX, KubeF...
 
Toronto meetup 20190917
Toronto meetup 20190917Toronto meetup 20190917
Toronto meetup 20190917
 
Feature Engineering for NLP
Feature Engineering for NLPFeature Engineering for NLP
Feature Engineering for NLP
 
Auto visualization and viml
Auto visualization and vimlAuto visualization and viml
Auto visualization and viml
 
Explainability and bias in AI
Explainability and bias in AIExplainability and bias in AI
Explainability and bias in AI
 
An Introduction to Neural Architecture Search
An Introduction to Neural Architecture SearchAn Introduction to Neural Architecture Search
An Introduction to Neural Architecture Search
 
weekly AI tech talk #85 ml-agents Enabling Learned Behaviors with Reinforceme...
weekly AI tech talk #85 ml-agents Enabling Learned Behaviors with Reinforceme...weekly AI tech talk #85 ml-agents Enabling Learned Behaviors with Reinforceme...
weekly AI tech talk #85 ml-agents Enabling Learned Behaviors with Reinforceme...
 
Data stream with cruise control
Data stream with cruise controlData stream with cruise control
Data stream with cruise control
 
AI in linkedin
AI in linkedinAI in linkedin
AI in linkedin
 
Deep natural language processing in search systems
Deep natural language processing in search systemsDeep natural language processing in search systems
Deep natural language processing in search systems
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 

IBM AI Talks #4: Adversarial Robustness 360 Toolbox For ML

  • 1. 1 The Adversarial Robustness Toolbox Mathieu Sinn, PhD Manager AI, Security & Privacy IBM Research Europe Dublin, Ireland AICamp IBM Series on AI Trust August 24, 2020
  • 2. Outline • Adversarial threats to AI • The Adversarial Robustness Toolbox • Resources & Conclusions
  • 3. “AI is the new electricity”
  • 4. But… AI is also surprisingly brittle! https://art-demo.mybluemix.net/
  • 5. This does not only apply to images… “Basketball throw” (72.5%) “Tennis swing” (49.5%) Original Adversarial https://github.com/Trusted-AI/adversarial-robustness- toolbox/blob/main/notebooks/adversarial_action_recognition.ipynb
  • 7. Financial services: • Evade fraud detection Autonomous vehicles: • Targeted/untargeted attacks on object recognition and image segmentation models Cybersecurity: • Evade spam filters, malware detectors, network intrusion detection etc. Security: • Disappearance attacks against CCTV surveillance Adversarial Threats to AI Scenarios Undermine trust in AI
  • 8. 8 Reports of cybersecurity vulnerabilities due to evasion attacks against AI in anti-malware / -virus products. Such attacks are already happening...
  • 9. Adversarial Robustness Toolbox (ART) Repo: https://github.com/Trusted-AI/adversarial-robustness-toolbox Docs: https://adversarial-robustness-toolbox.readthedocs.io/ Demo: https://art-demo.mybluemix.net 9 Open-source release @ RSA 2018: Current stats: • 1.6K GitHub stars • 450+ forks • 250+ clones/w • 1K+ downloads/w • Python library, 12K lines of code • State-of-the-art attacks, defences and robustness metrics Load classifier model (Keras, TF, PyTorch etc) Perform attack Load ART modules Evaluate robustness LightGBM
  • 10. • GitHub • https://github.com/Trusted-AI/adversarial-robustness-toolbox • Documentation • https://adversarial-robustness-toolbox.readthedocs.io • Slack • https://ibm-art.slack.com • Demo • https://art-demo.mybluemix.net/ • Blog • https://www.ibm.com/blogs/research/2019/09/adversarial-robustness-360-toolbox- v1-0 • White paper • https://arxiv.org/abs/1807.01069 • Tutorial • http://www.research.ibm.com/labs/ireland/nemesis2018/pdf/tutorial.pdf Resources & Conclusions https://www.research.ibm.com/artificial-intelligence/trusted-ai/
  • 11. • Check Contributions page: • https://github.com/Trusted-AI/adversarial-robustness- toolbox/blob/main/CONTRIBUTING.md • Create github issues for suspected bugs, missing features, ideas for improvements etc. • Contribute bug fixes, new features etc. via pull requests to dev branch • Follow PEP 8 coding style, provide unit tests • Sign DCO (via ‘-s’ flag) for every commit ART – How to contribute?