Slides of the presentation I gave at the /dev/070 meetup on Dec 13th 2017.
The repository with source code is located at: https://github.com/marcduiker/demos-azure-cognitive-services.
In order to run execute the requests in the .http files you need VS Code with the Rest Client extension.
3. Agenda
• What is Azure Cognitive Services
• Computer Vision API
• Azure Portal, VS Code & Visual Studio
• Custom Vision API
• Custom Vision portal
Improving your vision with Azure Cognitive Services - /dev/070 3
4. ML & AI is hot!
Improving your vision with Azure Cognitive Services - /dev/070 4
8. Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
16. How did we end up here?
Improving your vision with Azure Cognitive Services - /dev/070 16
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft CognitiveToolkit
(CNTK)
MicrosoftTechnology & Research
2015
2009 2016
18. Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - /dev/070 18
Tags
Descriptions
Faces
Colors
Domain models
ImageType
Cognitive Services
Computer Vision API
19. Computer Vision API examples
• API Reference
• https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e
c6739/operations/56f91f2e778daf14a499e1fa
• Perform API calls from VS Code
Improving your vision with Azure Cognitive Services - /dev/070 19
20. What do we need to get started?
• Create Computer Vision API endpoint in Azure
• Subscription key
• Create an application to
• Select an image
• Do a post to the Computer Vision API endpoint
Improving your vision with Azure Cognitive Services - /dev/070 20
22. Demo: HelloCV
• Provide a local image
• Do a request to Analyze endpoint
• Get analysis results back as json
Improving your vision with Azure Cognitive Services - /dev/070 22
Tags
Descriptions
Faces
Colors
ImageTypeCognitive Services
Computer Vision API
23. Demo: Analyze images on website
Improving your vision with Azure Cognitive Services - /dev/070 23
http://...
<img>
<img>
<img>
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website
24. Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - /dev/070 24
https://github.com/marcduiker/demos-azure-cognitive-services
25. Improving your vision with Azure Cognitive Services - MixUG 25
Custom Vision API (preview)
26. Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - /dev/070 26
Cognitive Services
Custom Vision API
Train
#A #B
? #A
27. Custom Vision Demo
Improving your vision with Azure Cognitive Services - /dev/070 27
Ferrari 250 GT SWB Aston Martin DB4
28. To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - /dev/070 28
29. Improving your vision with Azure Cognitive Services - MixUG 29
Thanks! See you next time!