SlideShare una empresa de Scribd logo
1 de 28
Descargar para leer sin conexión
Data Decay and the Illusion of the Present
Dan Lynn
@danklynn
Keeps all your contacts in one place and keeps them
automatically up to date.
Based in Denver, Colorado

CTO & Co-Founder
dan@fullcontact.com
@danklynn
Let’s talk about time.
The Past
http://wearcam.org/dundas-square/2004sep23/cement.jpg
The Present
The Past

The Future
Unless you’re a yogi,
you probably can’t
even perceive the
present.
http://applemagazine.com/wp-content/uploads/2012/12/
exc.jpeg
“Traders may have gotten last week’s Fed
news 7 milliseconds early“
- Washington Post (September 24, 2013)
Data is always old
It’s just a question of how old.
How do APIs keep
data fresh?
Polling
GET /notifications?since=1382630675166

• Simple
• But can lead to complex scheduling
• Trades efficient use of resources for
fresh data.
“98.5% of polls are wasted”
- Zapier
Ping/Pull
• XML-RPC
• Facebook Realtime updates
• Avoids scheduled polling
• Consumer must host an endpoint
• Moderate latency (3 hops)
• Complex
Push
• Github service hooks
• Content of change is pushed
• Payload can be diff or full resource
• Consumer must host an endpoint
• Lowest latency (1 hop)
We are moving
towards a push-based
API ecosystem
Flight Delays

“Security is abnormally slow.”
Contact Information
“Dan Lynn changed his phone number”
Dynamic Subscriptions
POST /contacts/123/subscriptions
{
"url" : "https://.../updates?contactId=123"
}

201 Created
{ "url" : "/contacts/123/subscriptions/a3b"}
Dynamic Subscriptions
DELETE /contacts/123/subscriptions/a3b
200 OK
So which model is right
for your API?
What’s the cost of
acting on wrong
data?
$100 per contact
If left untreated

Source: SiriusDecisions
Low time sensitivity?
Polling is fine.
High time sensitivity?
Go with push.
APIs are combating
information asymmetry.
Thanks!
@danklynn
See Also:
http://xmpp.org/extensions/xep-0060.html
https://code.google.com/p/pubsubhubbub/
http://www.resthooks.org/

Más contenido relacionado

Destacado

Individuals with disabilities in higher education
Individuals with disabilities in higher educationIndividuals with disabilities in higher education
Individuals with disabilities in higher education
Susan Moore
 
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board MeetingUtah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah Division of Wildlife Resources
 
Using smtp over_bgan_en
Using smtp over_bgan_enUsing smtp over_bgan_en
Using smtp over_bgan_en
madhu4a
 
Chelsea Property Group (Reit)
Chelsea Property Group (Reit)Chelsea Property Group (Reit)
Chelsea Property Group (Reit)
russellernst
 
【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】
Up Hatch
 

Destacado (20)

Epidermis
EpidermisEpidermis
Epidermis
 
SMS For Email Service Providers Webinar
SMS For Email Service Providers WebinarSMS For Email Service Providers Webinar
SMS For Email Service Providers Webinar
 
Jasmine soap
Jasmine soapJasmine soap
Jasmine soap
 
SqaВфны8
SqaВфны8SqaВфны8
SqaВфны8
 
Individuals with disabilities in higher education
Individuals with disabilities in higher educationIndividuals with disabilities in higher education
Individuals with disabilities in higher education
 
Jasmine soap
Jasmine soapJasmine soap
Jasmine soap
 
Presentacio1
Presentacio1Presentacio1
Presentacio1
 
אז איך מתמודדים עם לחץ בחינות
אז איך מתמודדים עם לחץ בחינותאז איך מתמודדים עם לחץ בחינות
אז איך מתמודדים עם לחץ בחינות
 
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board MeetingUtah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
Utah’s Watershed Restoration Initiative — Dec. 2010 Board Meeting
 
Extending your CRM to Mobile_april 2011
Extending your CRM to Mobile_april 2011Extending your CRM to Mobile_april 2011
Extending your CRM to Mobile_april 2011
 
Canoe Trip 2011 - February Meeting
Canoe Trip 2011 - February MeetingCanoe Trip 2011 - February Meeting
Canoe Trip 2011 - February Meeting
 
Batik aceh dan penjelasannya
Batik aceh dan penjelasannyaBatik aceh dan penjelasannya
Batik aceh dan penjelasannya
 
ניהול זמנים פסיכומטרי בפרק הכמותי
ניהול זמנים פסיכומטרי בפרק הכמותיניהול זמנים פסיכומטרי בפרק הכמותי
ניהול זמנים פסיכומטרי בפרק הכמותי
 
2011 Antlerless Recommendations, May 4, 2011
2011 Antlerless Recommendations, May 4, 20112011 Antlerless Recommendations, May 4, 2011
2011 Antlerless Recommendations, May 4, 2011
 
Commsday presentation
Commsday presentationCommsday presentation
Commsday presentation
 
Hypotheekvormen
HypotheekvormenHypotheekvormen
Hypotheekvormen
 
Using smtp over_bgan_en
Using smtp over_bgan_enUsing smtp over_bgan_en
Using smtp over_bgan_en
 
Chelsea Property Group (Reit)
Chelsea Property Group (Reit)Chelsea Property Group (Reit)
Chelsea Property Group (Reit)
 
Sampling Data in T-SQL
Sampling Data in T-SQLSampling Data in T-SQL
Sampling Data in T-SQL
 
【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】【STR2 CyberX プレゼンテーション】
【STR2 CyberX プレゼンテーション】
 

Similar a Data decay and the illusion of the present

Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperative
Trillium Software
 

Similar a Data decay and the illusion of the present (20)

Crossing the bridge - how do we link end-user-computing and formal tech for d...
Crossing the bridge - how do we link end-user-computing and formal tech for d...Crossing the bridge - how do we link end-user-computing and formal tech for d...
Crossing the bridge - how do we link end-user-computing and formal tech for d...
 
Data science presentation 2nd CI day
Data science presentation 2nd CI dayData science presentation 2nd CI day
Data science presentation 2nd CI day
 
Less is More: Behind the Data at Risk I/O
Less is More: Behind the Data at Risk I/OLess is More: Behind the Data at Risk I/O
Less is More: Behind the Data at Risk I/O
 
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision MakingFast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
Fast Data Mining: Real Time Knowledge Discovery for Predictive Decision Making
 
Future of data science as a profession
Future of data science as a professionFuture of data science as a profession
Future of data science as a profession
 
Big data and the data quality imperative
Big data and the data quality imperativeBig data and the data quality imperative
Big data and the data quality imperative
 
DataOps @ Scale: A Modern Framework for Data Management in the Public Sector
DataOps @ Scale: A Modern Framework for Data Management in the Public SectorDataOps @ Scale: A Modern Framework for Data Management in the Public Sector
DataOps @ Scale: A Modern Framework for Data Management in the Public Sector
 
10 Decisions You Will Face With Any Donor Data Migration Project
10 Decisions You Will Face With Any Donor Data Migration Project10 Decisions You Will Face With Any Donor Data Migration Project
10 Decisions You Will Face With Any Donor Data Migration Project
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science
 
Close Encounters with the Third Kind of Database
Close Encounters with the Third Kind of DatabaseClose Encounters with the Third Kind of Database
Close Encounters with the Third Kind of Database
 
FutureSkills: Refreshing IT Skills in State and Local Government
FutureSkills: Refreshing IT Skills in State and Local GovernmentFutureSkills: Refreshing IT Skills in State and Local Government
FutureSkills: Refreshing IT Skills in State and Local Government
 
Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...Human-centered data: using data science and human-centered design to grow you...
Human-centered data: using data science and human-centered design to grow you...
 
Internet of Things - Lecture 1 - Introduction
Internet of Things - Lecture 1 - IntroductionInternet of Things - Lecture 1 - Introduction
Internet of Things - Lecture 1 - Introduction
 
Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big data
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
 
MySQL Backed - Fraud Prevention
MySQL Backed - Fraud PreventionMySQL Backed - Fraud Prevention
MySQL Backed - Fraud Prevention
 
Data in the Wild: Survival Guide
Data in the Wild: Survival GuideData in the Wild: Survival Guide
Data in the Wild: Survival Guide
 
Data Mesh @ Yelp - 2019
Data Mesh @ Yelp - 2019Data Mesh @ Yelp - 2019
Data Mesh @ Yelp - 2019
 
Tableau - Make your SEO data work for you!
Tableau - Make your SEO data work for you!Tableau - Make your SEO data work for you!
Tableau - Make your SEO data work for you!
 
Explaining the importance of a database lock in clinical research
Explaining the importance of a database lock in clinical researchExplaining the importance of a database lock in clinical research
Explaining the importance of a database lock in clinical research
 

Más de Dan Lynn (6)

Dirty data? Clean it up! - Datapalooza Denver 2016
Dirty data? Clean it up! - Datapalooza Denver 2016Dirty data? Clean it up! - Datapalooza Denver 2016
Dirty data? Clean it up! - Datapalooza Denver 2016
 
Data Streaming Technology Overview
Data Streaming Technology OverviewData Streaming Technology Overview
Data Streaming Technology Overview
 
Storm - As deep into real-time data processing as you can get in 30 minutes.
Storm - As deep into real-time data processing as you can get in 30 minutes.Storm - As deep into real-time data processing as you can get in 30 minutes.
Storm - As deep into real-time data processing as you can get in 30 minutes.
 
Storing and manipulating graphs in HBase
Storing and manipulating graphs in HBaseStoring and manipulating graphs in HBase
Storing and manipulating graphs in HBase
 
Storm: The Real-Time Layer - GlueCon 2012
Storm: The Real-Time Layer  - GlueCon 2012Storm: The Real-Time Layer  - GlueCon 2012
Storm: The Real-Time Layer - GlueCon 2012
 
When it rains: Prepare for scale with Amazon EC2
When it rains: Prepare for scale with Amazon EC2When it rains: Prepare for scale with Amazon EC2
When it rains: Prepare for scale with Amazon EC2
 

Último

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

Data decay and the illusion of the present