SlideShare una empresa de Scribd logo
1 de 25
@seangorman
Is big data the new reductionism?
People from different places and different
backgrounds tend to produce different sorts of
information. And so we risk ignoring a lot of
important nuance if relying on big data as a
social/economic/political mirror.
                              Mark Graham, “Big data and the end
                              of theory” The Guardian. March 2012
Alternatives to reductionism?
The NYC Marathon’s Human Sensor Network
32,000+ unique devices
3.5 million events fired
Streaming Analysis Architecture
Just in Time Analytics - Where Conference

Más contenido relacionado

La actualidad más candente

BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...Big Data Week
 
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Angelo Gino Varrati
 
Small Business Solutions
Small Business SolutionsSmall Business Solutions
Small Business SolutionsTrevarthen
 
Policy paper - Bigdata skill building
Policy paper - Bigdata skill buildingPolicy paper - Bigdata skill building
Policy paper - Bigdata skill buildingRitesh Shrivastava
 
Novedades de Utility Network
Novedades de Utility NetworkNovedades de Utility Network
Novedades de Utility NetworkEsri España
 
Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Christian Villum
 
Wall Street Network case study
Wall Street Network case studyWall Street Network case study
Wall Street Network case studyEsri
 
Crowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationCrowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationDany Laksono
 
Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Jens Frid
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenDigipolis Antwerpen
 
We are just playing GO......
We are just playing GO......We are just playing GO......
We are just playing GO......JamesAKirkcaldy
 
The beauty of data visualization
The beauty of data visualizationThe beauty of data visualization
The beauty of data visualizationDebashish Jana
 
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAugmentedWorldExpo
 
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈NAVER D2
 

La actualidad más candente (15)

BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
BDW16 London - Mark van Rijmenam, Datafloq - Big Data is Dead, Long Live Big ...
 
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
Un caso di studio sui big data - Campus Connestions Summit 2018 - #CCS18
 
Small Business Solutions
Small Business SolutionsSmall Business Solutions
Small Business Solutions
 
Policy paper - Bigdata skill building
Policy paper - Bigdata skill buildingPolicy paper - Bigdata skill building
Policy paper - Bigdata skill building
 
Novedades de Utility Network
Novedades de Utility NetworkNovedades de Utility Network
Novedades de Utility Network
 
Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)Open Data 101 (from GO Open Data 2015, Toronto Canada)
Open Data 101 (from GO Open Data 2015, Toronto Canada)
 
Wall Street Network case study
Wall Street Network case studyWall Street Network case study
Wall Street Network case study
 
Crowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamificationCrowdsourcing and storytelling by gamification
Crowdsourcing and storytelling by gamification
 
Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019Scalout @ Data Innovation Summit 2019
Scalout @ Data Innovation Summit 2019
 
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunenMeetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
Meetup 27/6/2018: AIOPS om de uitdagingen van een slimme stad te ondersteunen
 
We are just playing GO......
We are just playing GO......We are just playing GO......
We are just playing GO......
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
The beauty of data visualization
The beauty of data visualizationThe beauty of data visualization
The beauty of data visualization
 
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSightAWE Tel Aviv Startup Pitch: Omri Stein with ReSight
AWE Tel Aviv Startup Pitch: Omri Stein with ReSight
 
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
[145] printf("Hello, AR"); //세상을 바꾸는 새로운 눈
 

Destacado

Wherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social MediaWherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social Mediaseagor
 
The State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data MeetupThe State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data Meetupseagor
 
Oscar twitter geo_sentiment
Oscar twitter geo_sentimentOscar twitter geo_sentiment
Oscar twitter geo_sentimentseagor
 
Gsapp xcities gorman_upload
Gsapp xcities gorman_uploadGsapp xcities gorman_upload
Gsapp xcities gorman_uploadseagor
 
Geo Web F1 Enterprise
Geo Web F1 EnterpriseGeo Web F1 Enterprise
Geo Web F1 Enterpriseseagor
 
Where 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQWhere 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQseagor
 
ONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQseagor
 
Black Friday Twitter Brand Analysis
Black Friday Twitter Brand AnalysisBlack Friday Twitter Brand Analysis
Black Friday Twitter Brand Analysisseagor
 
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Amazon Web Services
 

Destacado (9)

Wherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social MediaWherecamp Lightningtalk - GeoMining Social Media
Wherecamp Lightningtalk - GeoMining Social Media
 
The State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data MeetupThe State of Big Data for Geo - ESRI Big Data Meetup
The State of Big Data for Geo - ESRI Big Data Meetup
 
Oscar twitter geo_sentiment
Oscar twitter geo_sentimentOscar twitter geo_sentiment
Oscar twitter geo_sentiment
 
Gsapp xcities gorman_upload
Gsapp xcities gorman_uploadGsapp xcities gorman_upload
Gsapp xcities gorman_upload
 
Geo Web F1 Enterprise
Geo Web F1 EnterpriseGeo Web F1 Enterprise
Geo Web F1 Enterprise
 
Where 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQWhere 2.0 NoSQL Presentation 2008 - GeoIQ
Where 2.0 NoSQL Presentation 2008 - GeoIQ
 
ONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQONR Social Media Conference - GeoIQ
ONR Social Media Conference - GeoIQ
 
Black Friday Twitter Brand Analysis
Black Friday Twitter Brand AnalysisBlack Friday Twitter Brand Analysis
Black Friday Twitter Brand Analysis
 
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
Adding Location and Geospatial Analytics to Big Data Analytics (BDT210) | AWS...
 

Último

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 

Último (20)

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 

Just in Time Analytics - Where Conference

Notas del editor

  1. Just in time manufacturing – kanban. 1950’s Toyota looked at how supermarkets handle inventory delivering produce just at the time customers in the store needed. In manufacturing large inventories were kept in storage and analysis was done on what volumes levels should be held based on historical data.  In contexts where supply time is lengthy and demand is difficult to forecast, the best case can be to respond quickly to observed demand.Kanban changed this with dynamic job queues and just in time delivery. Can the information economy get the same gains the manufacturing economy got with just in time methods.
  2. The heijunka box is generally a wall schedule which is divided into a grid of boxes or a set of 'pigeon-holes'/rectangular receptacles. Each column of boxes representing a specific period of time, lines are drawn down the schedule/grid to visually break the schedule into columns of individual shifts or days or weeks. Coloured cards representing individual jobs (referred to as kanban cards) are placed on the heijunka box to provide a visual representation of the upcoming production runs.The heijunka box makes it easy to see what type of jobs are queued for production and for when they are scheduled. Workers on the process remove the kanban cards for the current period from the box in order to know what to do. These cards will be passed to another section when they process the related job.
  3. Today’s data warehouses
  4. Big data originated with batch operations with massive amount of data. In effect performing valuable post mortems on our digital exhaust
  5. Increasing the data we create is coming in real time
  6. It is not just social media but sensors, mobile, all globally instrumented
  7. Real time analytic tools are quickly emerging but are out old analytical methods appropriate
  8. In 1749 the German scholar Gottfried Achenwall suggested that since this ‘science’ [the study of society by counting] dealt with the natural ‘states” of society, it should be called Statistik.
  9. Two trends using big data as a reflection of society and data is a living organism and a post mortem is for things that are dead.
  10. The downside to reductionist approaches. Is the end of theory premature?
  11. Any event with a very low probabilitythat occurs gives us a great deal of information, whereas when an event with a highprobability occurs, this is less of a surprise and gives us correspondingly less information but greater certainty. Information thus varies inversely with probability.You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage!
  12. Entropy measures of Vogue covers based on the complexity of the pixel variations in the graphic layout
  13. This function has many attractive properties for describing spatial distributions.Here, we initially assume that the probability piis proportional to some count ordensity of spatial activity, such as population in a zone i that might be a censustract. If all the population were located in a ‘‘mile-high building’’ such as the oneproposed for a town of 100,000 people in 1956 by Frank Lloyd Wright (Rybczynski2010), then pi 5 1 and pk ¼ 0; 8k ¼6 i, and the entropy would be at a minimum,with Hmin 5 0. If the population were evenly spread throughout the tracts as pi ¼ 1=n; 8i, then the entropy would be at a maximum, with Hmax ¼ log n. (Batty 2011)
  14. Max entropy over space and time
  15. Traditional statistical approaches to dynamic data. Categorical splits.
  16. Kernel density functions
  17. Delaunay triangulation