This document discusses automation in marketing and market intelligence. It describes how Moore's Law has driven innovation and reduced costs over time. Automation is now being applied to digital advertising and product advertising. Specifically, automation can be used for deep web crawling, analyzing competitor data, contents behind forms/logins and PDFs/CSVs. It also provides an example of how automation was used to automatically scrape data from 17 sources daily and alert clients to anomalies in battery/vehicle production data in key regions. Automation also allows for technology tracking across millions of websites.
2. Who we are:
● Marketing Intelligence company with offices in UK and US.
● 7 years developing automation technologies
● Clients in North America, Europe, and Asia
barrie@red-volcano.com
@baj
21. Thought experiment
You have 10,000 people working for you
Each have laptops
They don’t require sleep
You don’t have to pay them
barrie@red-volcano.com
@baj
22. What do you ask them to do?
barrie@red-volcano.com
@baj
25. Automation in market intelligence:
Deep Web Crawling includes analysing:
● Competitor data signals
● Content behind forms/logins
● PDFs/ CSV’s
barrie@red-volcano.com
@baj
26. Automation in market intelligence:
Problem analysis - Anglo American needs to be informed of major fluctuations in battery / vehicle
production in China, North America, and South America
Barriers to problem:
● Too many data sources to check daily
● Not economically viable to check manually
● Data only viewed manually once every 3 months
● Opportunities missed by not viewing sites/data each day
barrie@red-volcano.com
@baj
27. Automation in market intelligence:
Solution provided:
● Automated scraping of data from 17 sources
● Sources checked daily
● Data checked by standard distribution for anomalies
● Client instantly informed when data peaks or drop outside normal behaviour
● UI built to allow analysts a central place to review all data and set up alerts
barrie@red-volcano.com
@baj
28. Automation in market intelligence:
Technology Tracking - Magma
● Tracks usage for technology across 10 million websites
● 2500+ technologies tracked
● Informs users when websites add or remove competitor technology
barrie@red-volcano.com
@baj
29. Automation in market intelligence:
What data is important to your business?
barrie@red-volcano.com
@baj