The document discusses how to implement chatbots for Alexa and Facebook Messenger. It provides an overview of key concepts like intents, slots, context and tools like the Amazon Skills Kit and Wit.ai. It also outlines the basic workflows including speech/text recognition and response generation as well as examples of bots built for Alexa and Facebook Messenger using APIs from Amazon, Wit.ai and Facebook.

1. 30.01.2017
how to implement chatbots for
alexa and fb messenger

2. About me
Co-Founder and CTO
Voice and chat user interfaces in combination with
AI to boost productivity at the workplace.
botconnect.io
Senior Analyst in Residence
Observing the technology industry and its impact on business and
society to deliver insight and foresight.
crisp-research.com

3. how does it work?
• tools/apis/sdks
• orchestration
• data transmission

4. chatbots
• text (aka chat)
• voice (aka digital assistants)
• medium.com: 10 Differences Between
Voice and Text Conversations

5. Speech Text
Automatic
Speech
Recognition
Text Intention
Natural
Language
Understanding
Intention Request
Intention
Handling
Request Text
Intention
Handling
wit.ai
wit.ai
app
alexa ask
app
app
alexa ask
Text Speech
Speech
Synthesis
alexa ask
alexa stackfb/wit stack
VUI
TUI
CUI

6. +

7. concepts
• intents
• slots, values
• session attributes (context)
• cards
• ssml

8. tools
• amazon skills kit
• amazon voice service
• amazon lambda (serverless computing)

11. alexa enabled
device avs/ask
1
Speech
input
4
Speech
output
aws lambda
2 Request
3 Respones
Speech recognition
Voice -> Text
Natural language understanding
Unstructured text ->
structured data (intents,
slots, slot values, session
attributes)
Speech synthesis
Text -> Voice
Intent handler
„emits“ (speech, cards)
wake word engine
audio i/o
audio streaming

12. LaunchRequest
LaunchRequest

13. Response
output text
context

14. IntentRequest
context
IntentRequest
intent
slots

15. response
output text
context

16. SSML

17. LaunchRequest
goto NewExercise
Intent: NewExercise
store result in context

19. coming soon: lex
• voice & text
• for every device

20. why should I buy something like a raw
echo dot for 300 bucks?

21. +

22. IMDB bot - fb messenger
https://www.omdbapi.com

23. IMDB bot - fb page

24. fb messenger api

25. fb messenger api

26. wit.ai

28. app on heroku
to expose app in internet you can use ngrok alternatively

29. concepts
• entities (incl. intents)
• actions
• context

30. messenger wit.ai apiappmessenger api
1
message
2
message
app.post(‚/webhook‘,(req,res))
wit.runActions(message)
send
runActions
api
webhook
send API
4
msg, actiontext
3

31. https://developers.facebook.com/docs/messenger-platform/webhook-reference/message
callback - incoming message1

32. https://wit.ai/docs/http/20160526#post--converse-link
Renamed into „send“ action
2
3
*
Wit converse api
*
text to fb
text from fb

33. https://github.com/hunkim/Wit-Facebook/blob/master/index.js
2 getting & handling the message

34. runActions
• Wit is instantiated with actions,
including ‚send’
• extracts entities from text
• calls actions to create values for
entities
• finally sends text with ‚send‘ action

35. Handling the message (actions)

36. https://developers.facebook.com/docs/messenger-platform/send-api-reference
fb send api4

37. thank you
moritz.strube@mac.com
@mostwi