![Scalable Stream Processing and Map-Reduce ,[object Object],[object Object],eBay Research Labs](https://image.slidesharecdn.com/hw09-analyticsandreporting-091025150802-phpapp02/85/Hw09-Analytics-And-Reporting-1-320.jpg)
![About eBay Research Labs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],eBay Inc. Confidential](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recomendados
Recomendados
Más contenido relacionado
Similar a Hw09 Analytics And Reporting
Similar a Hw09 Analytics And Reporting (20)
Más de Cloudera, Inc.
Más de Cloudera, Inc. (20)
Último
Último (20)
Hw09 Analytics And Reporting
- 4. Listings eBay Inc. Confidential 546.4 Million 1999 2000 2001 2002 2003 1998 2004 2005
- 5. Registered Users eBay Inc. Confidential 180.6 Million 1999 2000 2001 2002 2003 1998 2004 2005
- 10. Architecture - Mobius eBay Inc. Confidential Log Processing API NFS/HDFS Web Interface Java M/R Template Click stream Visualizer Logs Log Query Language Application Layer Data Source Layer Cluster Layer Extension (mapper/reducer plugin) Hadoop Hybrid Hadoop Cluster Solaris Servers Solaris Servers Solaris Servers Windows Desktop Windows Desktop Windows Desktop
- 11. eBay Inc. Confidential ?% ?% ?% ?% ?% start search exit exit view purchase View through rate Buy rate
- 14. Mobius Query Language (MQL) - Structure of a Query eBay Inc. Confidential SELECT * FROM source WHERE where_condition PATTERN pattern WITH condition START start_condition END end_condition FROM START END FILTER PATTERN SELECT Input stream
- 16. Simple Example Contd… eBay Inc. Confidential SELECT size(A), B FROM inputStream WHERE $0 > 0 PATTERN ( ($0 < 5) + AS A[ ] // $0 > 5 AS B ) WITH A[0].time + 5 min > B.time && size(A) < 3 START $1 > 11:01AM END $0 < 0 FROM START END FILTER PATTERN SELECT Input Stream (1,11:00AM) (5,11:01AM) (2,11:02AM) (6,11:04AM) (10,11:05AM) (3,11:06AM) (7,11:07AM) (2,11:08AM) (-1,11:10AM) . . . (1,11:00AM) (5,11:01AM) (2,11:02AM) (6,11:04AM) (10,11:05AM) (3,11:06AM) (7,11:07AM) (2,11:08AM) (-1,11:10AM) . . . (5,11:01AM) (2,11:02AM) (6,11:04AM) (10,11:05AM) (3,11:06AM) (7,11:07AM) (2,11:08AM) (-1,11:10AM) . . . (5,11:01AM) (2,11:02AM) (6,11:04AM) (10,11:05AM) (3,11:06AM) (7,11:07AM) (2,11:08AM) (-1,11:10AM) ({(2,11:02AM)}, (6,11:04AM)) ({(3,11:06AM)},(7,11:07AM) ) (1, (6,11:04AM)) (1, (7,11:07AM) ) Output: Start-end Sub-stream Filter Pattern Tuple in a bag
- 20. Sessionized Analysis 1 eBay Inc. Confidential X % Y % X1 % X2 % X3 % X4 % Y1 % Y2 % Y3 % Y4 % Start Algo1 Algo2 At least one view Left eBay w/o View Left eBay w/o View At least one view At least one purchase no purchase were made no purchase were made At least one purchase View through rate Buy rate
Notas del editor
- Diversity collapse, dot com collapse, and how the stock survived
- Grew 28% sequentially and 346% annually (Q299 vs. Q298)
- Economics Professor at Stanford
- In PIG need 2 functions (1) to check a session contains a search event. (2) to find view event for a search event.
- Need to write down schema of the data. Explain pattern. Also explain {}
- GROUP is like PIG Group
- GROUP is like PIG Group
- GROUP is like PIG Group