Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

Asynchronous Data Processing

1.189 visualizaciones

Publicado el

This presentation was delivered to a group of Data Wranglers that focus on data processing. It outlined the challenge of the current state of business and explains that asynchronous processing is the way to manage the growing sources and volume of business information.

Publicado en: Tecnología
  • Inicia sesión para ver los comentarios

Asynchronous Data Processing

  1. 1. www.anant.us | solutions@anant.us | 202.905.2818 1010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 Services & Messages Asynchronous Data Processing
  2. 2. What do we do? Streamline, Organize & Unify Business Information
  3. 3. Agenda • Challenge - Why does this matter? • Old vs. New - Async is the Future • Methods - Batch, Mic-Batch, Stream • Queue/Bus/Actors - What and how • Ideas - Open Discussion
  4. 4. Challenge – Why does this matter? Information Overload
  5. 5. Challenge – Why does this matter? Knowledge = Decisions
  6. 6. Old vs. New – Sync vs. Async The current thinking is that the state of the systems in an enterprise are synchronous and that analysis must be done sequentially, iteratively from beginning to end in batch.
  7. 7. Old vs. New – Sync vs. Async The new thinking is that the state of the systems in an enterprise are dynamically asynchronous and that there is no “state” at a particular time but rather a stream of events.
  8. 8. Current - Processing Technologies Batch processing , micro-batch processing, and stream processing are different ways to do things. BATCH ● Has all the Data ● Throughput ● Latent ● Complexity is crushed by computing power ● Synchronous ● Computing is King MICRO ● Computes on small samples ● Has Access to Data ● Halfway ● Semi- Synchronous ● Computing + Workflow STREAM ● Computes one thing at a time ● Or small sample ● Near Real Time ● Independent Operations ● Asynchronous ● Workflow is King STREAM PROCESSINGMICRO BATCHINGBATCHING
  9. 9. Queue / Bus / Actor – What / How Let’s talk about what these technologies offer us.
  10. 10. Ideas – Open Discussion
  11. 11. Questions & Contact www.anant.us | solutions@anant.us | 202.905.2818 1010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 @anantcorp facebook.com/anantCorp linkedin.com/company/anant rahul@anant.us linkedin.com/in/xingh Rahul Singh CEO & Founder Questions & Contact • Brown Bag Session or Meetup? • Modern Enterprise • Mastering Services in the Service of Others • Hybrid Agile Project Management • Building Search Engines • CICD / DevOps • Connecting Internet Software
  12. 12. www.anant.us | solutions@anant.us | 202.905.2818 1010 Wisconsin Ave, NW | Suite 250 | Washington, DC 20007 Streamlined Data Integration / Data Pipelines Organized Knowledge Search / Data Warehouses Unified Interfaces Portals / Dashboards / Mobile

×