1.
利用電腦視覺與人工智慧
創造更多物聯網價值
John Chang ( 張書源 )
資深軟體開發協理
john.chang@microsoft.com
Azure 雲的萬物論

2.
物聯網架構

3.
Custom Cloud
Gateway
Custom Cloud
Gateway
Field
Gateway
Device
VPN/ExpressRoute
OPC, HTTP, CoAP,…
Custom Protocols
Client SDK
IoT Edge
AMQP
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Cloud protocol
gateway sample
Cloud protocol
gateway sample
AMQP, MQTT, HTTPS
Applications
- Companion apps
- Dashboards
- Controllers
- …
CoAP, AllJoyn, OPC,…
Device
Device
CoAP, AllJoyn, OPC, …
Device
Device
Device
IoT Hub
Field
Gateway

4.
物聯網解決方案現況
依賴傳感器偵測環境狀態
傳感器誤差影響判斷結果
必須依賴大量傳感器
不易處理複雜的情境
需要整合不同傳感器判斷
需要大量投資在非本業項目

5.
理想的物聯網解決方案 :
主動了解環境狀態並做出反應

6.
理想的物聯網解決方案 :
主動了解環境狀態並做出反應
攝影機
麥克風

7.
Custom Cloud
Gateway
Custom Cloud
Gateway
Field
Gateway
Device
VPN/ExpressRoute
OPC, HTTP, CoAP,…
Custom Protocols
Client SDK
IoT Edge
AMQP
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Cloud protocol
gateway sample
Cloud protocol
gateway sample
AMQP, MQTT, HTTPS
Applications
- Companion apps
- Dashboards
- Controllers
- …
CoAP, AllJoyn, OPC,…
Device
Device
CoAP, AllJoyn, OPC, …
Device
Device
Device
IoT Hub
Field
Gateway
Data + AI

8.
結合攝影機偵測環境狀態
降低傳感器誤判
降低傳感器數量
容易處理複雜的情境
深度學習讓影像辨識技術更成熟
OpenCV 可在 IoT Edge 篩選影像
Azure 認知服務支援影像分析
可與 Azure 其他服務結合

9.
Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Computer Vision
Rule Engine
AzureIoT
Device Bot
SMS
Text
Phone
Call

10.
Demo
智慧物聯網範例

11.
Vision

12.
200K celebrities

13.
JSON:
{
"language": "en",
"orientation": "Up",
"regions": [
{
"boundingBox": "41,77,918,440",
"lines": [
{
"boundingBox": "41,77,723,89",
"words": [
{
"boundingBox": "41,102,225,64",
"text": "LIFE"
},
{
"boundingBox": "356,89,94,62",
"text": "IS"
},
{
"boundingBox": "539,77,225,64",
"text": "LIKE"
}
. . .

14.
"faceRectangle": {"width": 193,
"height": 193,
"left": 326,
"top": 204}
“scores": { "anger": 5.182241e-8,
"contempt": 0.0000242813,
"disgust": 5.621025e-7,
"fear": 0.00115027453,
"happiness": 1.06114619e-8,
"neutral": 0.003540177,
"sadness": 9.30888746e-7,
"surprise": 0.9952837}

15.
"faceRectangle": {"width": 193, "height": 193, "left": 326, "top": 204}
…
"attributes": { "age": 42, "gender": "male",
"headPose": { "roll": "8.2", "yaw": "-37.8", "pitch": "0.0" }}

16.
Demo
使用 Custom Vision
Service 建立智能物聯
網方案

17.
www.botframework.com

18.
謝謝
john.chang@microsoft.com