Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
Destacado
Destacado (20)
Similar a Get Started Developing with Alexa and Drupal
Similar a Get Started Developing with Alexa and Drupal (20)
Último
Último (20)
Get Started Developing with Alexa and Drupal
- 1. Get Started Developing with Alexa and DrupaL Twin Cities Drupal Camp June 23, 2017 Amber Matz & Blake Hall
- 2. About us Amber Matz Production Manager and Trainer Drupalize.Me @amberhimesmatz Blake Hall Senior Developer and Trainer Drupalize.Me @blakehall
- 3. What We’ll CoveR... • Designing a Voice Interface • Concepts & Process • Creating Your first custom alexa skill • 2 ways to integrate Data from a drupal 8 Site • demos!
- 4. • Custom skills • Smart Home Skills API • Flash Briefing Skill API • Video Skills api (new) Types of Skills
- 5. Soon, You will be: Ready to create your own custom alexa skill! • With or without Drupal Integration • Using "AWS Lambda" or A custom Endpoint
- 7. Choosing projects Choose projects where adding voice will: • make it faster • make it easier • make it fun
- 8. What's Faster? Setting timer with touch (Microwave/Phone) Or Saying "Alexa, Set a timer for 3 minutes" from anywhere in the room?
- 9. What's Easier? • Play/stop a song with menus, screens, buttons? • Hands-free, eyes-free voice request
- 10. More "Easy" Examples "Single-Turn Dialogue" is easy: • Asking alexa for the weather • Asking alexa for a joke
- 11. It should be easy • multiple-turn dialogue needs to be easy • Requires more design work • Explore interaction that can flow in various ways
- 12. Designing for fun • Games should be easy to play but still present a challenge • Is there a place to incorporate humor, surprise, or delight? • How do you want users to feel during/after interaction?
- 13. Be choosy • Be choosy about what to expose as voice interaction • Does it make it Faster, easier, or more fun for the user?
- 14. Design for voice • Determine the purpose • Identify User Stories • write out dialogue for the "happy paths" • Diagram the user flow • Create Interaction model
- 15. how not to start • Don't start with your apI • Don't just add voice commands for each API endpoint • Don't expect users to know your apI
- 16. What's the purpose? • Why would people want to use your alexa skill? • What will they get from the skill that they can't get another way?
- 17. User stories • What can a user do, or not do, with your skill? • What Info Does a person Need to use your skill? • What features directly support the purpose? • Is there Info They'll need from a website or app?
- 18. Dialogue Script • Write the Script between alexa and the user • Focus on the "happy Path" • Does the dialogue flow naturally?
- 19. Tips for Scripts • Keep interactions brief • Write for How people talk, not read or write • Indicate when the user needs to provide info
- 20. Diagram the flow • reference the happy path Script • map out all the inputs needed from the user • branch out to cover additional logic or error cases
- 21. User: “Alexa, Ask fish jokes for a silly joke” Alexa: "Why are salmon so good at using git? They Love to merge upstream.
- 22. Flow Diagram Alexa, ask Fish Jokes for a [silly] joke. Return a joke tagged with term “silly” from fishjokes4.life (Drupal site)
- 23. Interaction model • Implement the entire flow • what are the concrete things that can happen? => Intents • What is said to make these things happen? => Utterances
- 24. Recap: Design for voice • Be Choosy about the project • Determine the purpose • Identify user stories • Write a Script • Diagram the flow • Create the interaction model
- 27. key concepts
- 29. Alexa ask fish jokes for a silly joke
- 30. Alexa ask fish jokes for a silly joke Activation
- 31. Activation • Alexa, Echo, amazon, or Computer • Fixed by Amazon • Can’t be customized • configurable by device
- 32. Alexa ask fish jokes for a silly joke ActivationInvocation
- 33. Invocation • “open”, “launch”, “ask” + your skill name • how your skill is opened
- 34. Alexa ask fish jokes for a silly joke Activation Invocation Utterance&Intent
- 35. Utterances • The phrases your skill will recognize • think about the variables you need (slots)
- 36. Intents • map utterances to functionality • some are built in (help, stop, cancel)
- 37. Alexa ask fish jokes for a silly joke Activation Invocation Utterance&Intent
- 38. Custom skills
- 40. Lambda Blueprints Skill Alexa AWS Lambda Response • Java • Python • Node.js Find on Alexa GitHub AWS Lambda Blueprints
- 41. Lambda data sources Alexa Response or AWS Lambda Skill Results from a Web Services API Call Hard- coded values in an array
- 43. Web services API call Skill Alexa AWS Lambda Response Results from a Web Services API Call JSON
- 45. Creating a custom alexa skill
- 46. Get ready to rock Create an Amazon Developer Account Sign in to developer.amazon.com/ alexa Get started > Alexa Skills Kit
- 52. Add a new skill
- 53. configuration • created in developer portal • so that: alexa can route requests to the service for your skill • brings all skill components together
- 54. Invocation Name • Identifies the skill • user includes this name when initiating a conversation with your skill • must be unique
- 57. Interaction model • Intents • slots • Sample utterances
- 58. Intents Represent: • actions users can do with your skill • core functionality
- 59. Sample Utterances • words/phrases users say to invoke intents • you map utterances to intents • this map forms the interaction model
- 60. slots • Optional Arguments • Need a Type • Need Values • Custom or Built-in
- 61. Beta Interaction Model • Interactive • Walks You Through the process • generates json for you
- 62. Beta Dashboard
- 63. Beta: Add Intent
- 64. Beta: Utterances
- 65. Beta: Utterances
- 66. Sample Utterances Guidelines: • Do not include “Alexa”, “Amazon”, “Echo”, etc. • DO not include the name of your skill
- 67. Sample Utterances Guidelines: • Do include A variety of phrases • DO include “slot names” in curly brackets
- 68. Beta: Slots
- 69. Beta: Slots
- 70. Beta: Slots
- 72. Intent Schema • A JSON structure that declares the set of intents your skill can accept and process
- 73. Intent Schema TIP: • Include Built-In Amazon intents for common actions: “stop”, “Help”, “CANCEL”, ETC.
- 74. Intent Schema { "intents": [ { "intent": "GetNewFactIntent" }, { "intent": "AMAZON.HelpIntent" }, { "intent": "AMAZON.StopIntent" }, { "intent": "AMAZON.CancelIntent" } ] } } Custom intent Amazon built-in intents
- 75. Intent Schema { "intents": [ { "intent": "GetCategorizedJokes", "slots": [ { "name": "Category", "type": "LIST_OF_CATEGORIES" } ] }, { "intent": "GetFishJokes", }, { "intent": "AMAZON.HelpIntent" }, { "intent": "AMAZON.StopIntent" }, { "intent": "AMAZON.CancelIntent" } ] } Custom intent Custom intent } Amazon built-in intents Custom slot type
- 76. Endpoint
- 79. getting started • copy/paste blueprint code examples • refer to docs and resources • Check out Alexa Github
- 80. Write the code Using AWS LAMBDA? • Node.jS • Java • Python
- 81. simple example
- 83. Intent schema
- 84. utterances
- 85. Array of Jokes
- 86. Random Joke
- 87. web service
- 88. Web services API call Skill Alexa AWS Lambda Response Results from a Web Services API Call Views JSON
- 89. Intent schema
- 90. utterances
- 91. API Endpoint Parse the response
- 95. there’s a module for that!
- 97. Alexa module config • give drupal your alexa application id • give alexa the resource callback • write some code
- 98. Event Subscriber
- 99. Slot Random Joke
- 100. Response
- 101. “Alexa Ask fish jokes for a silly joke”
- 104. SSML
- 105. SSML • Whispers • word substitution • emphasis • prosody • Expletive beeps
- 106. SSML Examples • <amazon:effect name="whispered">Hi</ amazon:effect> • <emphasis level=“strong">billy bass</emphasis> • <say-as interpret-as=“digits">12345</ say-as>
- 107. already supported by the alexa library
- 110. Test your skill • Test with service simulator (in developer portal) • Test on Alexa-Enabled device
- 111. certification • Write description • Create + Upload Icon • Submission Checklist • Check email for feedback
- 112. Continue development After skill “Goes Live”: • Dev version auto-created in Developer portal • Work on dev, submit when ready • Certified dev version replaces live version
- 113. Continue development
- 114. demo time
- 115. demo: Fish Jokes
- 118. Demo: Fish jokes with category slot
- 121. Demo: Flash briefing
- 123. ECHO DOT + ARDUINO + Big Mouth Billy Bass 12v power Headphone Audio out 2 or 3 motors connected. 1 in use.
- 124. Tutorial • Instructables.com • “Animate a Billy Bass Mouth With Any Audio Source” • by Donald Bell http://www.instructables.com/id/Animate-a-Billy-Bass-Mouth-With-Any-Audio-Source/
- 125. Recap • Voice Design Process • Interaction Model • 3 ways to create a custom skill, with + without Drupal integration
- 126. q&A?