Searching for SharePoint Analytics

1. SEARCHING FOR SHAREPOINT ANALYTICS HOW TO GET INSIGHT ON YOUR INTRANET Jeff Fried CTO, BA Insight SharePoint Saturday NYC July 2016

2. THANK YOU EVENT SPONSORS We appreciated you supporting the New York SharePoint Community! • Diamond, Platinum, Gold, & Silver have tables scattered throughout • Please visit them and inquire about their products & services • To be eligible for prizes make sure to get your bingo card stamped by ALL sponsors • Raffle at the end of the day and you must be present to win!

3. Focused on Search and SharePoint since 2004 Longtime Search Nerd • CTO, BA Insight • Senior PM, Microsoft • VP, FAST • SVP, LingoMotors About Jeff Fried Passionate About • Search • SharePoint • Search-driven applications • Information Strategy Blog: BAinsight.com/blog Technet Column “A View from the Crawlspace” jeff.fried@bainsight.com

4. About BA Insight   – Connectivity – Applications - – Classification - – Analytics 

5.  Analytics Out-of-the-Box  Build your own Analytics  What else is out there?  What’s coming next? Outline

6. The Value of Analytics • Continually improve performance and satisfaction – Improve infrastructural performance – improve your search centre's performance • Increase user engagement • Validate that SharePoint is delivering results • Use today's analytics to help drive tomorrows experiences

7. Layers of Analytics Infrastructure Application Behaviour Website SharePoint/Intranet Web services Page load People happy? Servers, Farm Health checks How are people using SharePoint

8.  Analytics Out-of-the-Box  Build your own Analytics  What else is out there?  What’s next? Outline

9. SharePoint Evolution

10. SharePoint 2010 Analytics  Web Analytics Reports  Traffic reports  Search reports  Inventory reports  These reports aggregated at the following levels:  Per web application in the farm  Per site collection  Per site  Per search service application  OoTB these reports are visible to Administrators at each level  ‘View Web Analytics Data’ Permission Level

11. SP 2010 – Report Summary

12. SP 2010 - Traffic Reports How much traffic your site gets (Number of Page Views); Who visits your sites (Top Visitors); How visitors arrive at your site (Top Referrers); Daily Unique Visitors Top Destinations Top Browsers

13. SP 2010 - Search Reports How many times users searched (Number of Queries) What were the most used search terms (Top Queries) What queries have high failure rates (Failed Queries) Best Bet Usage, Search keywords

14. SP 2010 - Inventory Reports What is the total disk drive space user (Storage Usage) How many sites exist (Number of Sites) Top Site Product Versions Top Site Languages

15. SP 2010 – Schedule & Export

16. SharePoint 2013 Analytics Popularity Trends shows usage event statistics for a site collection, a site, or an individual item in a library or list.

17. SharePoint 2013 Analytics Most Popular Items shows usage event statistics for all items in a library or list.

18. SharePoint 2013 Analytics

19. SharePoint 2013 Audit Reports

20. SharePoint 2013 Audit Reports

21. SharePoint 2016 Analytics

22. SP 2016

23.  Better statistics on how SharePoint is being used, and how things may fail  Real time telemetry (latency, 404’s, document usage stats)  SLAPI (SharePoint Logging API)  Enhanced usage database (improves *significantly* upon existing usage database)  Generates updated report data in real time  Stats / Reports on usage, health, storage, performance, and much more  There’s a lot of useful data in there Advanced Data Analysis & Reporting

24.  SharePoint Online Reports: Very much like on premises  New usage reports for SharePoint, OneDrive, Yammer and Skype now available  Providing a complete picture across all Office 365 services  Activity Dashboard  Email  Office Activations  SharePoint  OneDrive  Skype for Business  Yammer SharePoint Online Analytics

25. SharePoint Online Analytics

26. SharePoint Online Analytics

28. SharePoint Analytics – Lacking! • Reports – not Real time • Require Site Admin Access • Lack of Breakdown e.g. by Hour • No OoTB Dash boarding • Custom means Custom

29. SharePoint Search Analytics DB´s Properties Analytics IndexTimer Jobs Crawler Logs Events Configuration PowerShell analysisenginepssnapin Thank you to Nicki Borrell  Analytics Timer Job for Search Service Application Search Service Application Microsoft SharePoint Foundation Usage Data Import Microsoft SharePoint Foundation Usage Data Processing Usage Analytics Timer Job for Search Application Search Service Application

30. Analytics Beyond OoTB: SSRS

31. Analytics Beyond OoTB: SSRS

32. Analytics Beyond OoTB: Power BI

33. Custom Solutions with PowerPivot Thank you to Nicki Borrell 

34. Custom Solutions with PowerPivot

35. PowerShell & Custom Code Thank you to Nicki Borrell  PowerShell: • Get Usage Report: – $searchApp.GetRollupAnalyticsItemData … • Get Search Report: – $searchApp.GetSearchReport …

36. PowerShell & Custom Code Thank you to Radu Tut  $searchApp = Get-SPEnterpriseSearchServiceApplication $site = Get-SPSite "{SiteUrl}" $result = $searchApp.GetRollupAnalyticsItemData(1,[System.Guid]::Empty,$site.ID,[System.Guid]::Empty) $result #for a specific date or for a specific month $date = Get-Date "2013-01-18" $result.GetHitCountForDay($date) $result.GetHitCountForMonth($date)

37. PowerShell & Custom Code Thank you to Nicki Borrell  PowerShell: • Get Usage Report: – $searchApp.GetRollupAnalyticsItemData … • Get Search Report: – $searchApp.GetSearchReport … Custom Code:

38. PowerShell & Custom Code SPSecurity.RunWithElevatedPrivileges(delegate { // You can use SPContext.Current.Site.ID if you have HttpContext using (var site = new SPSite(siteId)) { var context = SPServiceContext.GetContext(site); var searchProxy = context.GetDefaultProxy(typeof(SearchServiceApplicationProxy)) as SearchServiceApplicationProxy; var usageData= searchProxy.GetRollupAnalyticsItemData(1,Guid.Empty,site.ID,Guid.Empty); // process it } }); Thank you to Radu Tut 

40. Demo 41

42. How does Delve Analytics differ? Infrastructure Application Behaviour User

43. Delve Analytics

44. Delve Analytics

45. Delve Analytics

46. Delve Analytics

47. Session Summary  Analytics Out of the Box  How analytics have changed through the versions of SharePoint 2010, 2013 and SharePoint 2016 - sometimes not for the better  Build your own Analytics  What options are available beyond out-of-the-box reports - building your own, and add-on dashboards and reports  Analytics – What else is out there?  Analytics in the Real World  The Value of Analytics  Analytics – What’s next?

48. www.BAinsight.com Jeff.Fried@BAinsight.com @jefffried

49. CONFERENCE MATERIALS • Slides / Demo will be posted on Lanyrd.com • http://lanyrd.com/2016/spsnyc • Photos posted to our Facebook page • https://www.facebook.com/sharepointsaturdaynyc • Tweet Us - @SPSNYC or #SPSNYC • Sign Up for our NO SPAM mailing list for all conference news & announcements • http://goo.gl/7WzmPW • Problems / Questions / Complaints / Suggestions • Info@SPSNYMetro.com

50. • Visit ExtaCloud’s booth for wrist bands! Scallywag's Irish Pub 508 9th Ave, between 38th & 39th. [6 minutes walk] Scallywags also serves food. http://www.scallywagsnyc.com/

51. References  Discontinued features and modified functionality in Microsoft SharePoint 2013  Introducing Delve Analytics in Office 365  Introducing Web Analytics in SharePoint 2010  New Analytics in SharePoint 2013  New usage reports for SharePoint, OneDrive, Yammer and Skype now available

52. Searching for SharePoint Analytics How to get insight on your Intranet Jeff Fried CTO, BA Insight SharePoint Saturday NYC July 2016

53. For More Information • Check out our resources on: www.BAinsight.com • Reach me via email at: Jeff.Fried@BAinsight.com • Follow me on Twitter at: @jefffried