IoT transformation begins at home, but how can you get started quickly? Voice is a natural interface to interact not just with the world around us, but also with physical assets and things, such as connected home devices, including lights, thermostats, or TVs. In this session, we discuss how you can connect and control devices in your home using AWS IoT services and the Alexa Skills Kit. By the end of the session, you'll have a set of best practices for how to build IoT products in the connected home.

1. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Building IoT applicationsfor a
connected home
Indraneel Mitra (Neel)
Enterprise Solutions Architect
AWS
S V C 2 0 6
Garett Madole
Co-Founder, VP Engineering
Yonomi

2. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
What you will learn today
▪ Connected home market & use cases
▪ AWS IoT services integration
▪ Amazon Alexa skills integration
▪ Endpoint architectures
▪ Yonomi
▪ Q&A

3. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Connected home market
433 million
smart home deviceswere
shippedworldwide in2017
fromthe previousyear
27.6%
18.5%
IDC estimatesaCAGRof
devicesshippedin2022
940 million
as the marketgrowsto

4. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Connectedhome market—challenges& opportunities
Hard to differentiate in a
crowded market
Hard to improve customer
experiences while keeping
costs low
Hard to maintain interoperability
between multi-vendor devices
Lack of a reliable & scalable cloud
infrastructure platform
Edge-based computing can help
build innovative products
Need to ensure secure connections

5. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Connected home market
Usecases
Home automation Home security &monitoring
Wi-Fi routers &modems Cable set-top boxes
Home networking
Lighting systems
Media & entertainment
White goods & appliances
Small appliances
Home assistants
Sound bars
TVs
Vacuum robots
Door locks
Smart meters
Securitycameras
Water leakdetectors
Thermostat

6. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
AWS IoT services for the connectedhome

7. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.

8. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Home automation
Example
AWS IoT Greengrass can
run on a home gateway, such
as a router, so the lighting
system, TV, and Echo continue
to operate even if connection
to the cloud is lost
Smart TVs can connect
to AWS IoT Core to take
advantageof a fully scalable
cloud backend that provides easy
integration with Alexa
Amazon FreeRTOS provides
security,connectivity,and
updatability for devices running
on microcontrollers, likea light
bulb,so it can respond to voice
commands
AWS IoT Device Management,
AWS IoT Device Defender,
and AWS IoT Analytics
provideadded benefits, such as
remote device management,
monitoring,security,and insights
into device usage

9. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T

10. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Home networking
Example
AWS IoT Device Management
provides devicecertificates for
routers, and set-top boxes never
expire. You can perform OTA
updates to keep devices running
the latestversions of the software
AWS IoT Analytics can help
the operations team identify issues
based on historical data and
provideproactivesolutions to
customers
AWS IoT Greengrass can help
customers diagnosenetwork
issues on the device itself,
even without internet
connectivity;
then it can rely data back to
AWS IoTCore for preventative
action when cloud connection
is re-established
Customers
can diagnose
network issues
and apply fixes
themselves

11. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Problem
Technicolor is a leader in digital innovation for the Media
and Entertainment industry that works with cable,
telecommunications,and satelliteoperators to bring
bandwidth-intensiveexperiences into the home.
The company sees opportunities for network service
providers to build a bridgebetween cloud and edge
technology to introducenew revenue-generating services
whilemakinghome networks easier to
access,manage, and configurethrough voice
activated commands.
Solution
Technicolor will useAWS for home gateway applications,
leverage AWS IoT services and AWS IoT Greengrass,
integrate Alexa into its new gateway products to enable
users to configurenetwork settings and more justby
asking,into its new family of gateway products.The
collaboration will enablenetwork serviceproviders to gain
access to broad developer community through AWS,
improvingoverall quality of service,customer experience,
and cost control,whileaddressingprivacy issues by
empowering consumers to have greater control over their
own information.
Technicolor

12. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Home security & monitoring
Example
AWS IoT Greengrass ML Inference
bringsmachinelearningcapabilitiesto
a camera,
such astheability to detectan
intruder as it’s happening.
AWSIoT Greengrass allowsthe
security camera,door lock,and
even outdoor lightingto continue
operating,even when thecloud
connectionislost.Itcan also take
actionslocally,avoidinga costly
and timely round trip to thecloud.
Amazon FreeRTOS provides security,
connectivity,and updatability for
devices runningon microcontrollers,like
a connected door lock orvideo door
bell.
AWS IoT Device Management,
AWS IoT Device Defender,
and AWS IoT Analytics
provideadded benefits,such as
remote devicemanagement,
monitoring,security,and insights
into deviceusage.
IoT Things Graph
makes iteasy to build
a homesecurity solution
thatintegrates motion
sensors,smokedetectors,
and cameraswith facialrecognition
services,soyou
can spotan intruder and generate
alerts.

13. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Problem
Hive waslookingtoaccelerate product
developmentcyclesforitsnew connected
microcontroller-baseddevice—the
Hive LeakSensor.
Solution
Comparedwiththe in-house firmware
technologiesthatHive usedinitsprevioussensors,
AmazonFreeRTOSwasable toaccelerate time-to-
marketdue to significantreductionin
developmenteffortrequiredtosecurelyconnect
to AWSIoT services.
“AmazonFreeRTOSisanexcitingleap
forwardfor ourbusinessandourcustomers.Dev
teamscan nowfocustheirenergyonthe
applicationandnotthe plumbing,messaging,or
security.Instead,theychoose the board,the chip,
and connecttoAWS IoT servicesseamlessly.”
Hive

14. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.

15. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa Skills Kit
The Alexa Skills Kit (ASK) enables you to teach Alexa new skills
It contains the documentation, tools, and sample code needed to build Alexa
skills
https://developer.amazon.com/ask

16. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Types of Alexa skill models
Custom
Smart home
Flash briefing
Video
List
For crafting unique game or app experiences
For providing flash briefing content
For providing video playback of content
For using and maintaining lists
For controlling a smart home and devices

17. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa Skills Kit
Directive
Audio
Cards
Speechrecognition
Machine learning
Natural language understanding
Textto speech
Event
Skill
service
Alexa SkillsKit

18. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Smart home capability

19. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Smart home capability interface examples
Interface Capability
Alexa.Discovery Discover and describe endpoints
Alexa.PowerController Turning on or off
Alexa.PercentageController Sets a percentage
(Percentage, intensity, speed, and more)
Alexa.ColorController Change and report the color
(Hue, saturation, brightness)
Alexa.PlaybackController Control playback
(Play, pause, rewind, and more)
Alexa.ThermostatController Set a temperature or point or range

20. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.

21. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa Cloud
Endpoint Cloud
Skill Service
Directives
Events
Alexa Event Gateway
Login with Amazon
Amazon Web Services (AWS)
Lambda
Home Network
Internet
Account Linking / OAuth
Proactive Updates
AsynchronousResponses
Smart Home Skill API
Endpoints
Alexaapplication& devices

22. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa Cloud
API Gateway
Skill Service
Directives
Events
Alexa Event Gateway
Login
with
Amazon
Amazon Web Services (AWS)
Lambda
Home Network
Internet
Account Linking / OAuth
Proactive Updates
AsynchronousResponses
Smart Home Skill API
Alexaapplication& devices
Endpoints
AWS IoTDynamoDB
API Service
Lambda

23. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Where do you start?
Alexa custom skill Alexa smart home skill Alexa voice service
• AWS Cloud
• Customer defines intents
• AWS Lambda (preferred)or web
service
• Account linking optional
• Brownfielddevices
• AWS Cloud
• Alexa defines intents
• Lambda required
• Account linking required
• Brownfielddevices
• Build a voice enabled product
• Requires hardware (mic-array,
speaker)
• Requires AVS Device SDK
• Greenfieldproducts

24. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T

25. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Connected home virtuous cycle

26. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
What we are building

27. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T

28. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Interoperability & compatibility matters

29. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Consumer IoT musthaves
• Third-party integrations
• Voice assistants
• Security & privacy
• Identity service (OAuth)
• User & household-device management
• Device onboarding & maintenance
• Real-time notifications & communication
• Low operational costs for the lifetime of the product

30. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
SchlageLockscasestudy

31. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T

32. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Devices Service
DynamoDBLambda
Rules Service
DynamoDBLambdaSQS
Cognito
API Gateway
w/ WebSockets
Kinesis
SNS
MessageBus
User Profile Service
DynamoDBLambda
Push Notifications
PinpointLambda
Alexa Integration
DynamoDBLambdaSQS
IoTCore

33. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.
Alexa

34. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa integration
request()
alexa-clients
Alexa Smart Home Skill
Backend services
report()IoT Core

35. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.
“Alexa, setthe bedroom light to yellow”
{
"directive": {
"header": {
"namespace": "Alexa.ColorController",
"name": "SetColor",
"payloadVersion": "3",
"messageId": "abc-123-def-456",
"correlationToken": "dFMb0z+PgpgdDmluhJ1LddFvSqZ/jCc8ptlAKulUj90jSqg=="
},
"endpoint": {
"endpointId": "appliance-001",
"scope": {
"type": "BearerToken",
"token": "access-token-from-skill"
},
},
"payload": {
"color": {
"hue": 52.65,
"saturation": 0.7809,
"brightness": 0.9843
}
}
}
}

36. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.
Different companies,different APIs,different standards
Company A - HSL
{
"hue": 52.65,
"saturation": 96.08,
”lightness": 60
}
Company B - HSB
{
”hue": 52.65,
”saturation": 0.7809,
”brightness": 0.9843
}

37. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa Integration
request()
alexa-clients
Alexa Smart Home Skill
Backend Services
report()
Company A
Company B

38. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.
const defTemplate = {
sourceKey: 'colorSpectrum',
sourceMatch: `(key === defn.source) && (value.mode === 'hsl')`,
sourceExpr: `Converter.map(
['spectrumHSV'],
[
Converter.map(
['hue', 'saturation', 'value'],
Converter.color.hsl.hsv.raw([
value.hue,
value.saturation,
value.lightness])
)
]
)`,
targetKey: 'color',
targetMatch: `value.spectrumHSV !== undefined`,
targetExpr: `Converter.map(
['hue', 'saturation', 'lightness', 'mode'],
Converter.arrayMerge(Converter.color.hsv.hsl.raw([
value.spectrumHSV.hue,
value.spectrumHSV.saturation,
value.spectrumHSV.value
]), 'hsl')
)`
}
Property mapper
const mapper = new PropertyMapper(defTemplate);
external = mapper.transform(alexaPayload)

39. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Alexa integration
request()
alexa-clients
Alexa Smart Home Skill
Backend services
report()
Company A
Company B
mapper()IoT Core

40. S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.
Onboarding & user device associations
Mobile appUser
Device SoftAP SSID or BLE
Door lock1,3
2
4

41. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Demo

42. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Takeaways
• Consumer IoT has different
requirements
• Interoperability and third-party
support matters
• Voice assistants are a must – Alexa!
• Less to worry about with AWS IoT
• Utilize other AWS serverless
services for a low cost and elastic
infrastructure

43. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI TS U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.

44. © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.S U MMI T
Thank you!
S U MMI T © 2019, AmazonWebServices, Inc. oritsaffiliates. Allrightsreserved.