The Cloud is a great source for Big Data: social data, geo-local data, mobile communications, web logs, monitoring, etc. Most of that data is taken out of the cloud and processed off-line for business intelligence. But what happens when you want to use big data in real-time? What are the use cases and challenges? Join us as four entreprenuers share thier journey into the world of collecting & processing big data for use in real time cloud scale applications. You are sure to be impressed!
Speakers:
Chase McMichael, Founder of Infinigraph
Chase McMichael has over 15 years of senior level product development and management experience in consumer messaging and marketing technologies, including social media, advertising software and collaboration. While at UNBOUND created the world’s largest social marketing database, obtained US Patent 6,941,339, received the Marketing Sherpa Viral Hall of Fame award in 08 and deploying advanced social campaigns for Vibe Magazine, BET, SAAVN (Bollywood), Ford, HP, HBO, BOSCH, MTV, FritoLay - Doritos, Klondike, Travel Channel, Prima Games - HALO, Sony BMG and Jive Music.
Paul Baclace of MetaZeta
Veteran Software Engineer of 9+ startups over the past 20 years as architect, project lead, director of engineering, and founder. Focused on the fine art of careful design and development of robust software systems in spite of limited resources and time. Especially interested in leveraging collaborative intelligence and making dumb systems slightly smarter.
Aparajeeta Das of Third Eye
Founder of BigDataCloud University & ClustersToGo.com and Chief Delivery Officer at Third Eye CSS, a Big Data Analytic focused consulting company. 15+ years of BI Analytic experience at Microsoft, eBay, LG, Hortonworks, Cisco amongst others. Aparajeet will discuss Online Retail Analytics in a heterogeneous technical platform.
Agenda:
6:30 - 7:00 p.m. Registration / Networking / Refreshments / Pizza sponsored by CloudStack
7:00 - 8:20 p.m. Presentations
- Chase McMichael of Infinigraph
- Paul Baclace of MetaZeta
- Aparajeeta Das of Third Eye
8:20 - 8:30 p.m. Discussion
Boost Fertility New Invention Ups Success Rates.pdf
Big Data @ Cloud Scale
1. Big Data @ Cloud Scale
Tuesday, June 26, 2012
SVForum
Silicon Valley Cloud Center
Chase McMichael CEO
@chasemcmichael @infinigraph
2.
3. InfiniGraph solves a problem for marketers
drowning in data by enabling them to identify what's
relevant to their customers.
We simplify trend identification empowering brands
to create resonating content marketing campaigns.
4. We’re drinking from the social media fire hose.
Content insight involves a staggering amount of data:
3.2 billion pieces of content are shared each week
between a billion + consumers.
How do you make sense of all this data?
Big Data is Big Opportunity
5. Large Scale Industry Insights
Who is driving the greatest engagement in your business.
What content is working and why?
7. Trend Identification - Hypercuration™
Example: Real-Time trending content from 25 retail brands in one view. Know
what your audience is resonating around.
7
8. Our Biggest Challenges
1. Data Store Scale (I/O &
Performance)
2. Distributed Data Gathering
(Drone / Broker Mesh)
3. Changing Landscape of Data
(Changing API / Changing Data
"Types" & Sources)
4. Categorization / Taxonomy
Handling (Dealing with lots of
disparate data)
Scale, Scale, Scale
12. “It’s not information overload. It’s
filter failure.” ― Clay Shirky
@chasemcmichel @infinigraph
13. Big Data Requires People
People with:
• Deep expertise in statistics
• Machine learning
• Managers
• Analysts who know how to
operate companies by using
insights from Big Data,
Big Data is more than just technology
13
14. Data Scientist Must Have Four Key Skills
• They can take a data set and
model it mathematically and
• Understand the math required
to build those models; they
• Can actually do that, which
means they have the
engineering skills…
Someone who can find insights and tell stories
from their data. Able to ask the right
questions, and that is usually the hardest piece.
14
16. Data can be a blessing or a curse
• Need the systems to monitor at
a whole new level,
• Looking at usage patterns and
• Predicting future trouble before
the trouble even happens
• Know a server pool needs
tuning
• Need to provision additional
services
The future of monitoring is about automation
and prevention
17. Big Data and Real-time
• Big Data is a fact of life and needs to be addressed. Big Process is old wine in new
bottles. Tightly couple processes and data to stay competitive.
17
18. Killer Apps Needed
Business need a killer app
Let companies
‣ analyze,
‣ visualize and
‣ act on
All this without hiring a team of Stanford Ph.Ds,
OR
Let developers write big-data apps without having to
reinvent the wheel.
18
19. Take Away
• What problem are you attempting to
solve - stop thinking about tech
• Plan collection / storage carefully
• Plan for both batch and real time
• Have a people plan
“The world is one big data problem. There’s a bit of
arrogance in that, and a bit of truth as well.”
–Andrew McAfee
19