In this module, we will look at an overview of theory and scientific evidence about data visualisation. Understanding the ‘why’ can help to make us better at the ‘how’, regardless of the technology.We will also look at an overview of the Power BI suite of tools.
14. Objectives
20
15
10
5
0
Year
1962
1965
1968
1971
1974
1977
1980
1983
1986
1989
1992
1995
1998
2001
2004
2007
Total Expenditure on Health, % of GDP - 1960-
2007
Total Expenditure on Health, % of GDP - 1960-2007
28. Challenges to
unlocking data
insights
Integration with
existing tools
41%
Security &
manageability
37%
Lack of skills
& knowledge
59%
Connected
devices per adult
4.3
Source: Big Data & CIO Adoption Quantitative Research, Sept 2012, Microsoft
29. The endless cycle of idea and action,
Endless invention, endless experiment,
Brings knowledge of motion, but not of
stillness;
Knowledge of speech, but not of silence;
..
Where is the wisdom we have lost in
knowledge?
Where is the knowledge we have lost in
information?
Excerpt from The Rock by TS Eliot (1934)
34. You have to start with the truth. The
truth is the only way that we can get
anywhere. Because any decision-making
that is based upon lies or
ignorance can't lead to a good
conclusion.
Julian Assange, Wikileaks
35. You have to start with the truth. The
truth is the only way that we can get
anywhere. Because any decision-making
that is based upon lies or
ignorance can't lead to a good
conclusion.
Julian Assange, Wikileaks
36. What data will we look at today?
The true measure of a nation’s
standing is
how well it attends to its children –
their
health and safety, their material
security,
their education and socialization, and
their sense of being loved, valued,
and
included in the families and societies
into
which they are born.
UNICEF, Child poverty in perspective:
An overview of child well-being in rich
countries,
Innocenti Report Card 7, 2007
UNICEF Innocenti Research Centre, Florence.
38. Defining Business Intelligence (BI)
• Today, BI is generally a well-understood term
• According to Gartner, BI is defined as:
A broad category of applications and technologies for gathering, storing, analyzing, sharing
and providing access to data to help enterprise users make better business decisions
• It encompasses a broad spectrum of technologies and usually
requires skilled professionals to implement and manage
39. Course Outline
Module 1: Setting up your data for R with Power Query
Module 2: Introducing R
Module 3: The Big Picture: Putting Power BI and R together
Module 4: Visualising your data with Power View and Excel 2013
Module 5: Power Map
Module 6: Wrap up and Q and Q
40. In a Nutshell: Power BI and R
Prepare Data with
R
Analysing Data
with R
Putting it all
together
41. Introducing Microsoft SSBI
Microsoft Office 2013 – Excel
Over the past decade, the core spreadsheet capabilities have been enhanced to enable
analysts to analyze, communicate, and manage information
• Comprehensive support for querying Analysis Services data models
• Rich and interactive data visualizations
• Add-ins provide rich and integrated BI capabilities:
42. Introducing Microsoft SSBI
Microsoft Office 2013 – Excel
Product Purpose Excel 2010 Excel 2013
Power Query Data acquisition and preparation
Power Pivot Data modeling
Power View Presentation-ready, and interactive
reports
Power Map 3D geospatial visualization
43. Introducing Microsoft SSBI
Power BI for Office 365
Power BI delivers cloud-based BI abilities
BI site provide a cloud portal to share workbooks, and includes benefits:
‐ Data catalog to store and search for queries
‐ Data refresh from on-premise data
‐ Larger workbook sizes, up to 250MB
‐ HTML5 report viewing
‐ Natural language querying (Q&A)
44. Introducing SQL Server
SQL Server also can play a major role in delivering BI
Standard, Business Intelligence and Enterprise editions provide BI
capabilities to deliver larger scale BI solutions:
‐ Data warehousing
‐ Extract, Transform and Load (ETL) with Integration Services
‐ Data modeling (multidimensional and tabular)
‐ Data mining
‐ Reporting
45. Business Analysts
• Data Discovery
IT Professionals
• Configure data services
• Create, combine, manage
and publish advanced
queries
Users
• Search for, and consume,
published queries
Introducing Power Query
Power Query Audiences
46. Introducing Power Query
• Power Query is a new add-in for Excel to discover, transform and consume
data
• Allows defining queries which run a sequence of steps to import and
reshape data from one or more data sources
- Query steps are defined by using Power Query Formula Language (informally known as "M“)
Simple query step logic does not require writing formulas
Advanced query step logic can be written to leverage the full power of the language
• Supports a large collection of data source types
• Query results can be loaded into an Excel table or the workbook data model
47. Introducing Power Query
Power Query Ribbon
- Search for published queries and load their data
- Source external or workbook data to create a new query
- Combine queries to create a new query
- Manage workbook and machine settings
48. Working with Power Query
Creating Queries
• A query is typically created by sourcing external data
• Data can be sourced from:
- Web (an HTML page)
- File
- Database
- Other sources su
50. Working with Power Query
Creating Queries – Query
• Queries are defined in the Query Editor window
• Once a data source is defined, the query can be named, and steps created
• Steps can filter and shape data into a desired result
- Steps can easily be produced by applying column filters, and by using the commands
available from the ribbon, or the query and column context menus
- It is possible to select a step and preview the data at that step
- It is also possible to remove steps – but take care not to remove a step that downstream
steps depend on
- Step formulas can be viewed or edited in the formula bar
51. Working with Power Query
Creating Queries – Query Editor
Navigator Pane
Browse structured
data sources to
find the data
source that you
want to query
Query Name
Unique name
for the query
Formula Bar
View or edit the
formula directly
Applied Steps
Edit any query
step, represented
as a Gear icon,
by using the Edit
Settings option
on each step.
Steps can also be
deleted.
Query preview
Load Settings
Load worksheet
and/or data
model
Latest refresh
time
Refresh
Import the latest data
(run query steps)
52. Working with Power Query
Creating Queries – Query Editor Context Menus
Query
menu:
Column
menu:
Column
filters:
Click here to launch
the query menu
53. Working with Power Query
Combining Queries
• New queries can be created to:
- Merge two queries (joining on a common column)
- Append two queries (union)
54. Working with Power Query
Managing Queries
• Each query is added as a workbook
connection, and can be refreshed like
standard data connections
• Queries are managed in the Workbook
Queries pane
• Hovering over the query will produce a
preview of the data, and provide commands
• Queries can be edited, duplicated,
referenced, deleted, merged, appended or
shared
55. Working with Power Query
Advanced Scenarios
• The Power Query options allow enabling advanced query editing
• When enabled, a query can be edited as a script, and new queries
can be scripted from scratch
• Customized logic can be developed by implementing functionality
not exposed by the context menus, by using looping constructs,
and parameterizing queries to create functions to be invoked by
other queries
67. Ask real questions, get answers
Featuring Power BI for Office 365 Q&A
Q&A feature uses natural
language query
Type questions into the speech
bubble
Get immediate answers in the form
of interactive charts and graphs
69. Resources
Microsoft Download Center
- Microsoft Power Query for Excel (Preview)
- http://www.microsoft.com/en-us/download/details.aspx?id=39933
TechEd North America 2013
- DBI-B225: “Microsoft “Data Explorer ” for Excel: Discover, Combine, and Refine your
Data” by Faisal Mohamood
- http://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/DBI-B225
Power Query for Excel Formula Language Specification
- http://go.microsoft.com/fwlink/?LinkID=320633
Speaker Notes:
This slide allows the definition of BI.
OPTIONAL SLIDE: Screen shots of Excel 2013 Power Query and Windows Azure Marketplace for visual representation of solutions if demo isn’t possible, or if needed to address specific points.
Moving on to the second stage of the data science process – where you form theories, analyze & refine them – this time, I want to focus on a story from the financial services industry.
Ultimately – from end-users, business analysts, to BI pros, and data scientists – you want to enable them all – not just one. Because when you enable all of these people – you engage more people in analytics – you accelerate the time from raw data to insight across your company.
You need to drive adoption of the right tools to all users, not just BI experts or Data Scientists in a collaborative way and on any device. Through familiar tools like Excel and SharePoint, we enable all users to analyze and make collaborative decisions on structured and unstructured data. Through the Hive ODBC Driver, there is now easy and direct access from the end user tools to Hadoop data from traditional services like SQL Server Analysis Services.
Let’s dig in a little… stop for a minute – and picture Excel in your minds. What image comes into your head? Probably Excel from years past – spreadsheets with tables? If that’s the image in your head, then think back to the demo we just walked through. That’s Excel today. With the BI add-ins for Excel and SharePoint, powerful analytics and collaboration tools for everyone are ready and waiting.
In fact, Power View and Power Pivot both represent our investments in putting our best BI technology in Excel to make it accessible to everyone. And it allows you to do amazing visualizations that make it possible for you to look at your data in new ways – that makes insights and data analysis accessible to all users -- from the least sophisticated to the most.
One of the most common pain points we hear from IT and end users about BI is the classic problem – a repeating loop that never ends. The business asks IT for data. IT produces the data and gives it to the business. The business asks for more cuts, and the request goes back into the queue. IT has to pull together a new cube and another analysis. A week later, the business gets it, but says it’s almost right, but it’s missing these three things. The whole process starts over again. How many people have been on that cycle?
Power View and Power Pivot are all about bringing that full, self-service BI power into Excel so users can do that analysis, and they can cut and slice and dice rather than constantly coming to IT for that service.
Power View (an interactive data exploration, visualization, and presentation experience that encourages intuitive ad-hoc reporting) is available in Microsoft Excel 2013, but it’s also a feature of SharePoint Server 2010 and 2013 as part of the SQL Server Reporting Services.
Power Pivot is a powerful data mashup and data exploration tool. Again, thinking about the notion of accelerating time to insight, we’ve continued to integrate in-memory technologies right into our products. Power Pivot has in-memory built in so it delivers super-fast analytical performance – processing billions of rows in seconds.
Once users complete their analysis, they can publish the results to SharePoint or a Power BI site so that the data can be shared by everyone. Just having the finance director know the data and see the analysis is not enough for most companies. You want to push it out to your organization, and then refine that with external data.
SUGGESTED DEMO:
Demo featuring Power Query, Power View, Power Pivot and Power Map in Excel 2013. Demonstrate stage two of data science process – making it possible for everyone to form theories, analyze and refine – to work with big and small data using familiar powerful tools. Ultimately revealing insights.
OPTIONAL SLIDE: Screen shots of Excel 2013 featuring Q&A, Power View and Power Map for visual representation of solutions if demo isn’t possible, or if needed to address specific points.
Ask real questions and get answers with Q&A. With the natural language query capabilities in Power BI for Office 365, as questions about your data as you would in everyday language. From those questions, you’ll get answers in the form of instantly generated charts and graphs.
Visualize insights with Excel 2013, Power View and Power Pivot visual and modeling tools. Fine-tune reports with chart and view filters, and navigate quickly through your data, define relationship hierarchies and KPIs, model analytical requirements, and more.
Add depth to Excel reporting with 3D geospatial mapping in Power Map. Map up to a million rows of data visually in 3D on Bing Maps, discover insights and capture them as scenes, share stories with everyone by bringing your scenes together in a guided tour.
OPTIONAL SLIDE: Screen shots of Excel 2013 featuring Power View and Power Pivot for visual representation of solutions if demo isn’t possible, or if needed to address specific points.
OPTIONAL SLIDE: Screen shots of Excel 2013 featuring Power Map for visual representation of solutions if demo isn’t possible, or if needed to address specific points.
OPTIONAL SLIDE: With the natural language query capabilities in Power BI for Office 365, as questions about your data as you would in everyday language. From those questions, you’ll get answers in the form of instantly generated charts and graphs.
OPTIONAL SLIDE: Share insights about your data, find answers, and stay connected from anywhere with the web-based and mobile capabilities of Power BI for Office 365.
Quickly create collaborative BI-optimized workspaces in Office 365 to share BI worksheets with colleagues, collaborate over insights and results, and quickly find the data you’re looking for.
Access your BI from any device, anywhere using an HTML5-compatible browser, or through mobile BI apps.
Speaker Notes:
Highlight relevant resources for further attendees to continue their education.