Charles Verdon - Samedi SQL - Futur de l'intelligence d'affaire
1. Le futur de
l’intelligence
d’affaire c’est le
temps réel!
Charles Verdon
Technology Solutions Professional
Email: chverdon@microsoft.com
Twitter: @chverdon
7. It’s Big
So many devices and so much data…
It’s Noisy
So many opinions…
It’s Confusing
So many possible decisions…
Should we
wait?
How (where)
do we get
started?
Who can
really help
us?
Do we need
to start over?
What
technology
do we need?
B5075212
Microsoft Confidential
8. The Internet of Things starts with
Your Things.
• Build on the infrastructure you already have.
• Add more devices to the ones you already own.
• Get more from the data that already exists.
Stop just running your business.
Start making it thrive. Start realizing the
potential of the Internet of Your Things.
10. Generate new
insights to
create new
business value
Combine the
data you
already collect
Expand by adding new devices and assets, new services, new data
Utilize services
and the cloud
to jump-start
your efforts
Start by
connecting the
devices and LoB
Assets you
already have
13. Analytics Platform System
(APS)
Portal
O
p
e
r
a
t
i
o
n
a
l
SAP BW
JDE
BaaN
SAP
etc
Enterprise
Data
Warehouse
(EDW)
D
a
s
h
b
o
a
r
d
s
&
K
P
I
s
Data Mart
Data Mart
Operational
Data Store
(ODS)
E
T
L
E
S
B
E
T
L
E
T
L
Reports
Ad-hoc
Dashboard
Semi-structured
Unstructured
Streaming
OSI Soft, etc
Hadoop
OLAP
OLAP
17. Protocol reach to devices and platforms
Windows
Azure
Service Bus
• Queues
• Topics
• Event hubs
/azure-sdk-for-python/
/azure-sdk-for-php/
/azure-sdk-for-node/
/azure-sdk-for-java/
/azure-sdk-for-ruby/
HTTP(S)
https://github.com/windowsAzure/
AMQP 1.0
Other platforms
AMQP
1.0
Embedded
18. Quick Excursion: What is AMQP 1.0?
• Advanced Message Queueing Protocol v1.0, ISO/IEC 19464:2014
• Bi-Directional, Reliable, Multiplexed Message Transfer
• Common Type System: structure like JSON, richer value types for scientific and business apps,
compact binary encoding
• Credit-based flow control model, delivery settlement
+5
22. I believe over the next decade
computing will become even
more ubiquitous and intelligence
will become ambient This will be
made possible by an ever-
growing network of connected
devices, incredible computing
capacity from the cloud, insights
from big data, and intelligence
from machine learning
Satya Nadella, CEO
23. SQL Server
enables data
mining of
databases
Computers
work on users
behalf, filtering
junk email
Microsoft
Kinect can
watch users
gestures
Microsoft
launches Azure
Machine
Learning,
making years
of innovation
available
Microsoft
search engine
built with
machine
learning
Bing Maps
ships with ML
traffic-
prediction
service
Successful,
real-time,
speech-to-
speech
translation
Microsoft & Machine Learning
20 years of realizing innovation
John Platt,
Distinguished scientist at
Microsoft Research
1999 201220082004 201420102005
Machine learning is pervasive throughout
Microsoft products.
“ ”
24.
25.
26. Better Decisions with Data
Descriptive Diagnostic PrescriptivePredictive
BI Enablement Advanced Analytics
Enterprise Data Management
What happened? Why did it happen? What will happen? What should I do?
32. Data Science Process is All About Experimentation
Business
Understanding
Data
Understanding
Data
Preparation
Modeling
Evaluation
Deployment
and
Monitoring
Data
37. Developers uses declarative SQL commands
Some functions take several lines of code versus
thousands from other solutions
3 lines of code in Stream Analytics
Thousand lines of code in other solutions
38.
39. Stream Analytics, End-to-End Overview
Data Source
Collect Process
Consume
Deliver
Event Inputs
- Event Hub
- Azure Blob
Transform
- Temporal joins
- Filter
- Aggregates
- Projections
- Windows
- Etc.
Enrich
Correlate
Outputs
- SQL Azure
- Azure Blobs
- Event Hub
- Power BI
Azure
Storage
• TemporalSemantics
• Guaranteed delivery
• Guaranteed uptime
Azure Stream Analytics
Reference Data
- Azure Blob
40. Tumbling Windows
SELECT TollId, COUNT(*) FROM EntryStream
GROUP BY TollId, TumblingWindow(minute,5)
How many vehicles entered each toll both every 5 minutes?
45. Connect live to on-premises data
Live Connectivity to SQL Server Analysis Services
Live
Connectivity
46.
47.
48.
49. Use the Power BI REST API to
push data directly from your
application into a dataset in
Power BI. Your dashboards will
be updated in real-time when
the data changes. No more
waiting or having to press the
Refresh button!
Real-time dashboards
Create a connector (using REST,
OData, ODBC or other APIs) that
allows Power BI users to connect
to your data source and retrieve
data. Your connector can also
provide custom data models,
reports and dashboards for quick
insights.
Connectors for your
data sources
Use the Power BI REST APIs to
create custom datasets, reports
and dashboards from your
application. Integrate rich
analytics into your application by
embedding Power BI
dashboards, tiles and reports.
Rich analytics in your
application
Uncover real-time insights from
devices, sensors and
applications. Process streaming
data and events using Azure
Stream Analytics and monitor
the results using Power BI.
Real time dashboards
with Stream Analytics
Power BI
REST API
50.
51. Upcoming Data Platform Events
Microsoft Cloud Platform Day
• Montreal February 26: link
Microsoft Canada Webcast Series
• 12pm to 1pm: English
• 13h30 à 14h30: Français
• February 26: Analytics Platform System
• March 26: SQL Server In-Memory technologies
• April 30: Real-time BI
• May 28: Azure SQL
User Group SQL Saturdays
• PASS Ottawa Saturday April 25: link
SQL Server 2005
End-of-Life:
15 Months!