ECS 19 - John White, Jason Himmelstein - Everything You Always Wanted To Know About Power BI

EVERYTHING YOU ALWAYS WANTED TO KNOW ABOUT POWER
BI

♡ DIAMOND AND PLATINUM SPONSORS ♡

https://link.tygraph.com/BIFocalSession
John P White, M.Sc.
CTO/Co-Founder of tyGraph
Office Apps and Services MVP
Data Platform MVP
jpw@unlimitedviz.com
http://whitepages.unlimitedviz.com
@diverdown1964

Subscribe &
listen to our
podcast at
BIFocal.show

About you…
Tell us a bit about yourself:
Name
City and country
Company (Industry)
Level of familiarity
Cloud, On-prem, or both

Agenda

Report

Data Warehouse/Mart

OLAP Cubes, Dimensions, Measures
Dimensions Measures

Tabular Data Model

Power BI Data Set

Power BI Report - .pbix
Single data set
Can have many data sources

Power BI Dashboard
Can contain multiple visuals from
multiple reports
Not bound to one data set
Visuals are not cross-filtered
Contents of one cannot effect the
contents of another
Clicking on a visual takes you to the
report it is based upon

What is Business Intelligence?
Business intelligence (BI) is the transformation of raw data into meaningful and useful
information for business analysis purposes. ….BI technologies provide historical, current and
predictive views of business operations. Common functions of business intelligence
technologies are reporting, online analytical processing, analytics, data mining, process mining,
complex event processing, business performance management, benchmarking, text mining,
predictive analytics and prescriptive analytics.
- Wikipedia

What is Business Intelligence?
"Business Intelligence is like teenage sex:
everyone talks about it, nobody really knows how
to do it, everyone thinks everyone else is doing it,
so everyone claims they are doing it."

“Without data,
you’re just
another
person with
an opinion”
W. Edwards Deming,
Data Scientist

Reporting
Monitoring PlanningReal Time Reporting

Classic enterprise BI architecture

Self Service BI – Excel and PowerPivot
.xlsx file

Self Service BI – SharePoint On Premises
Online

Self Service BI – SharePoint Online
Online

Self Service BI – SharePoint and Power BI
Online

Business Intelligence grow-up story
Analyst Team Enterprise

Self Service BI – Power BI Service

Data Acquisition – Get Data

Data Acquisition – Service Apps

Data Acquisition - Files

Data Acquisition - Databases

https://link.tygraph.com/BIFocalSession Reports

Dashboards

Workbooks

Workspaces
V1 - Designed for groups
V2 – Not attached to Office 365
Groups

Dataflows

Demos
Importing data from CSV
Connecting to Analysis Services
Service Apps
Working with dashboards
Working with Apps and App workspaces

Power BI Desktop

Consumption (Browser) vs Design (Desktop)
Browser
• Get Data (limited)
• Power BI visuals
•  Edit queries
•  Modify data model
• Create/edit/use reports
• Create/edit/use dashboards
• Q&A
• Configure data refresh
• Create/edit/use Apps
Desktop
• Get Data
• Power BI visuals
• Edit queries
• Modify data model
• Create/edit/use reports
•  Create/edit/use dashboards
•  Q&A
•  Configure data refresh
•  Create/edit/use Apps

Power BI Service

Self Service BI – Power BI Desktop
.pbix file

ETL - Power Query or Get Data (M)
Connect to many
data sources
Data
Transformation
Combine
multiple queries
into single model
Refreshable

Power Query Functions
Data based Declarative
Reuse
complex
queries
Multiple data
source calls

Modeling – PowerPivot or DAX
Calculated
columns
Calculated
measures
Calculated
tables
Data
categorization
Custom
sorting

Time Intelligence
• Year, Quarter, Month, DayAutomated
• M Expression (Power Query)
• DAX expressions
From a
data source
Relate to
date
columns

Visualizations
Identical to PBI
Service
32 OOB visuals
Open Source
Custom Visuals
Gallery
Cross Filtering
and Drilldown
Filter at 4 levels

Filters
Visualizations Pane
4 Scopes
• Visual
• Page Level
• Report
• Drillthrough
Not Slicers Filters pane
Not available to
anonymous

Mobile Designer
Phone only
Layout
only
Power BI
Mobile app

Power BI Desktop Template Files
Power BI
Desktop
distribution
Designer
“Content Pack”
Deliver only
connections and
design elements

Demos
Walk around Power BI Desktop
Using Power Query
Building a model
Folders
Web scraping

Excel

Anatomy of an Excel file
Worksheet
data
Visuals
Classic data
connections
Power Query
connections
Data model
Power View
sheets
3D Maps

Scenario 1 – Service import from Excel file
File stored in SharePoint, OneDrive, or local file
system
Works with or without a data model
Refresh is hourly for SP, OD
File System

Scenario 2 – Service connection to Excel file
File stored in SharePoint/OneDrive
Works with or without a data model
Refresh requires a data model

Scenario 3 – Desktop import Excel Data
Multiple connectors possible
Only worksheet data
File System
Excel connector

Scenario 3 – Desktop import Excel Data
SharePoint Folder connector
Multiple connectors possible
Only worksheet data

Scenario 4 – Import Excel workbook contents
One-way ticket
File System
Import contents

Import from Excel
X
Data model (DAX)
Converted to PQ
Queries (M)
Converted to PBI visuals
X
X
Worksheet data
Data model (DAX)
Classic Data connections
Power Queries (M)
Power View sheets
Visuals
3D Maps

Scenario 5 – Analyze in Excel

Demos
Service importing from Excel
Service connecting to Excel
Desktop importing data from Excel file
Desktop importing Excel file
Analyze in Excel

BI Tools for SharePoint Data
SQL Server Reporting
Services / Power BI
Report Server
• Paginated Reports
SQL Server
Integration Services
(SSIS)
• Extract-Transform-Load
Power Query
• “Get Data” in Power BI
and Excel

SSRS and SharePoint Data
On-Premises
Only
CAML Queries
on back end
Kerberos or
cached
credentials
Connects live
10x slower than
equivalent SQL
Queries

SSIS and SharePoint Data
Extract/Transform/Load Mashups
SharePoint List Data Source
• SOAP web services
• Read/Write
• Deprecated
• On-Prem only
SSIS OData data source
• REST Web services
• Supports Azure Active Directory
(AAD) authentication
• Read Only
• Some data limitations

Power Query and SharePoint Data
Applies to Excel and Power BI
Multiple options
Cached data model
• Less perf impact, manageable
Supported by SQL Server Analysis Services (SSAS), Azure Analysis Services (AAS)
Mashup with multiple data sources
Helpers for complex SharePoint data types
All on-premises sources work with the On-Prem data gateway

Power Query SharePoint Data Connectors
OData
• Siteurl +
/_vti_bin/listdata.svc
SharePoint List /
Online List
SharePoint Folders
• SharePoint
documents

Complex SharePoint column types
Person
Hyperlink or Picture
Managed Metadata
Lookup
Choice
Rich Text
Location

Techniques for Complex Data
FieldValuesAsText
Column
Extensions
Build relational
tables

Working With Blog Series
Using Power BI to Report on Multi-Value SharePoint Fields
https://whitepages.unlimitedviz.com/2018/01/using-power-bi-to-report-on-multi-value-sharepoint-fields/
Using Power BI to Report on Person Fields in SharePoint
https://whitepages.unlimitedviz.com/2018/01/using-power-bi-to-report-on-person-fields-in-sharepoint/
Using Power BI to Report on Managed Metadata Fields in SharePoint
https://whitepages.unlimitedviz.com/2018/04/using-powerbi-report-managed-metadata-fields-sharepoint/
Using Power BI to Report on Rich Text Data Fields in SharePoint
https://whitepages.unlimitedviz.com/2018/04/power-bi-report-rich-text-sharepoint/
Using Power BI to Report on Hyperlink or Picture Fields in SharePoint
https://whitepages.unlimitedviz.com/2018/04/powerbi-report-hyperlink-picture-fields-sharepoint/
Using Power BI to Report on Lookup Fields in SharePoint
https://whitepages.unlimitedviz.com/2018/04/using-powerbi-report-lookup-fields-sharepoint/
Using Power BI to Report on Location Fields in SharePoint
https://whitepages.unlimitedviz.com/2019/01/using-power-bi-to-report-on-location-columns-in-sharepoint/

Demos:
Working with SharePoint
Data

SharePoint as a Report Canvas

SharePoint Modern – Power BI Web Part
Client side
rendering
No server
configuration
Works best
with Groups
Online only

SharePoint Classic – Secure Embed
Client side
rendering
License
required
Treat like
media embed
Script web
part
Modern or
classic
Online or on
prem

SharePoint dashboards
Excel Services web part
for Excel reports
(onPrem & online)
SSRS Report Viewer
web part
(onPrem only)
Power BI web part
(online only)
Secure Embed
SSRS/PBIRS with
rs:Embed=true
for Interactive and
mobile reports
(onPrem & online)
Other content types

Demo
Power BI Web Part
Secure Embed

On Premises options

Microsoft - Business Intelligence – our reporting roadmap –
October 2015
“Reporting Services is our on-premises
solution for BI report delivery”

What Microsoft didn’t say out loud – October 2015
“Power BI is our cloud solution for BI report
delivery”

Four Report Types
• Classic SSRS (RDL)
Paginated
• Power BI (PBIX)
Interactive
• SSRS Mobile (RSMOBILE)
• Power BI (PBIX)
• Both use Power BI Mobile AppMobile
• Excel (XLSX)
Analytical

Power BI Report Server
Lightweight
standalone
installer
Superset of
SSRS
Renders Excel

Power BI Desktop for Power BI Report Server
Source: https://blogs.msdn.microsoft.com/samlester/2018/02/19/understanding-the-differences-between-power-bi-desktop-and-power-bi-desktop-optimized-for-power-bi-report-server/

Power BI Report Server Licensing
SQL Server Enterprise Edition
• Requires that you purchased Software
Assurance
• Entitlement to same number of Cores as
SQL Server is licensed for
• Unlimited visualizations
• No per seat costs
Power BI Premium P SKUs
• Entitlement to same number of Cores as
Premium is licensed for
• Unlimited visualizations
• No per seat costs

Platforms
Power BI
• Paginated
• Interactive
• Analytical*
• Mobile (PBI)
Excel/Excel
Services/Excel Online
Server
•  Paginated
•  Interactive
• Analytical
•  Mobile (PBI)
SQL Server Reporting
Services/PBI Report
Server
• Paginated
• Interactive
• Analytical
• Mobile (rsmobile)
*via Excel Online

SharePoint embed options
Report type & platform SharePoint Online
modern page
SharePoint Online
classic page
SharePoint
on-premises
PBIX in Power BI Service Power BI WP or Secure
embed with script editor WP
Secure embed with
script editor WP
Secure embed with script
editor WP
PBIX in PBIRS Modern embed content WP Script editor WP* Script editor WP
RDL in PBIRS/SSRS Native Modern embed content WP Script editor WP* Report Viewer WP
RDL in SSRS Integrated mode Modern embed content WP Script editor WP* SSRS Integrated WP
XLSX (stored in SharePoint) Excel Online Embedding ** Excel Services WP Excel Services WP
RSMobile in PBIRS/SSRS Native Modern embed content WP Script editor WP* Script editor WP

BI Features in SharePoint 2019
Feature Status Migration Action (on prem)
SQL Server Reporting Services
Integrated Mode
Removed Move to SSRS Native Mode / PBIRS
Power View Removed Convert to PBI Desktop
BISM file connections Removed Recreate in PBI Desktop
PerformancePoint Deprecated Gradual conversion to PBIRS
PerformancePoint –
Decomposition Trees
Removed Recreate in PBI Desktop
Power Pivot for SharePoint Removed Move to PBIRS
Scheduled workbook data refresh Removed Store workbooks in PBIRS
Workbook as a data source Removed Import data model to SSAS
PowerPivot management
dashboard
Removed N/A
PowerPivot Gallery Removed N/A

Staying current

Realtime vs Real “enough” time
Data Latency
Complexity/Cost

Refresh
On Demand
(manual)
Automatic daily,
weekly, Up to 8
times per day
Token cached
in service
Failure alerts
On-premises
data through
gateway

On premises data gateway
Azure Service Bus
On-premises
Files
SharePoint
On-premises data Gateway
Data source connection credentials can only be decrypted
by the gateway
Cloud
Gateway Cloud Service
Data source connection credentials are
encrypted
Cloud
Services
Power BI,
Microsoft
Flow etc.
PowerApps
On-premises
data sources SQL ServerOther
Data Sources

Configuring the Gateway
Personal vs
Enterprise
Gateway
machine
Access
configured in
portal

Data refresh

Direct Query - Databases

Direct Connect - SSAS

Direct Query supported data sources*
On Premises
• Analysis Service Tabular
• Analysis Services Multidimensional
(cubes)
• SQL Server
• SAP HANA
• IBM Netezza
• Oracle
• Teradata
• Snowflake
• SAP Business Warehouse
Cloud
• Amazon Redshift
• Impala
• Azure Databricks
• Azure HDInsight Spark (Beta)
• Azure SQL Database
• Azure SQL Data Warehouse
• Google BigQuery (Beta)
• Impala (version 2.x)
https://docs.microsoft.com/en-us/power-bi/desktop-directquery-data-sources

Designing for the Gateway

Incremental Refresh
Based on Time
Slices
Query Filters Initial full refresh
Requires
dedicated capacity
(premium)
Model changes
require full load

NEW! – Composite Models and Aggregations

Demos
Configuring cloud refresh
Configuring data sources

Shared Licensing
Free and Pro
• 10 GB storage limit
• 8 Refreshes per day
• Live data sources
• On-premises and cloud data sources
• Service content packs
• Streaming – 1,000,000 rows/hour
Power BI Pro
($9.99/user/mo)
• Dashboard sharing
• Publish to Premium
• Modern Groups
• Organizational content packs
• Row Level Security
• Data Catalog
• SharePoint Web Part

Dedicated capacity based licenses
Dedicated
Resources
10G model
size limits
Up to 48
refreshes per
day
Unlimited
sharing

Shared vs Dedicated licensing
• Dedicated (premium): Capped resources, Unlimited Users & Usage
• A customer is provided with a fixed set of resources and has the flexibility to apply them to any number of
users and any load pattern. Our goal is to remove any usage cap or limit in this mode. The customer has a lot
of control (and visibility) to the resources provided to them so they can use them in an optimal manner.
•
• Shared: Unlimited resources, Capped Users & Usage
• A customer is limited to serving only a specific set of users (those who have a license) and there are limits on
model size, refresh frequencies, and other scale factors of the usage pattern. But within those (documented)
usage patterns boundaries, Microsoft is responsible for supplying sufficient resources to create a good
experience. Resource management therefore is completely hidden from the customer and they never have to
worry about it.
• - Amir Netz, Chief Architect for Microsoft BI

Dedicated Capacity Based Licensing
A (Embedded)
• Embed PBI Reports in your own
application
• Billed in 1 hour increments
EM (Embedding)
• Embed PBI Reports in SaaS
applications (SharePoint, Teams)
application
• Billed in 1 month increments
P (Premium)
• Embed PBI Reports in SaaS
applications (SharePoint, Teams)
application
• Share Power Reports, dashboards
and datasets through Power BI
Apps (workspaces)
• Ad hoc dashboard sharing from
personal workspaces
• Billed in 1 month increments

Premium (P) Cost
Capacity Node Cores Back end cores Front end cores Cost
P1 8 4 cores, 25 GB RAM 4 cores $4,995/month

Embedding (EM) Cost
EM1 1 0.5 cores, 3 GB RAM 0.5 cores $625/month
EM2 2 1 core, 5 GB RAM 1 core $1,245/month
EM3 4 2 cores, 10 GB RAM 2 cores $2,495/month

Embedded (A) Cost
A1 1 0.5 cores, 3 GB RAM 0.5 cores ~$1/hr
A2 2 1 core, 5 GB RAM 1 core ~$2/hr
A3 4 2 cores, 10 GB RAM 2 cores ~$4/hr

Demo
Moving Workspaces to Premium Capacity

Miscellaneous

NEW! – Dataflows (in preview)

Custom Visuals
Power BI
Developer
Tools
JavaScript D3
based
Requires
Node.js
Community
gallery

Custom Themes
Color palette
across visuals
JSON files
Community
gallery

Q&A and Cortana
Imported only
Cortana Turned off/on tenant
wide
Q&A via dashboards
Good luck with Cortana…
•https://app.powerbi.com/cortana/test

Quick Insights
Data
trends
Machine
learning

Mobile client
iOS (iPhone
and iPad)
Android
Windows
Mobile

Data Alerts
Run on
refresh
Service
alert
Send
email
Trigger a
Flow

Sharing
User to Users
(Read Only)
Organizational
Content Packs
PBIX File Groups
Anonymous
embedding
Apps

Publishing Apps
Publishes from
workspace
Copy of UI elements
stored in App
App is not
connected to a
Group
App has its own
security model
Remains connected
to the workspace
data sets
Update republished
changes
Can be pushed to
users

Streaming data
First in/First
out
Real time tile
updates
No data
model editing
Monitoring

Streaming data sources
POWER BI API AZURE STREAMING
ANALYTICS
PUBNUB MICROSOFT FLOW

Flow Integration
Power BI alert
trigger
Add data to Power
BI

Admin portal
Usage metrics User
management
Audit logs
Settings Not how admin
is granted

Demos
Dataflows
Publishing Apps

thank you
questions?
@diverdown1964
jpw@unlimitedviz.com
@jasehimm
jase@sharepointlonghorn.com

ECS 19 - John White, Jason Himmelstein - Everything You Always Wanted To Know About Power BI

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a ECS 19 - John White, Jason Himmelstein - Everything You Always Wanted To Know About Power BI

Similar a ECS 19 - John White, Jason Himmelstein - Everything You Always Wanted To Know About Power BI (20)

Más de European Collaboration Summit

Más de European Collaboration Summit (20)

Último

Último (20)

ECS 19 - John White, Jason Himmelstein - Everything You Always Wanted To Know About Power BI