My #BrightonSEO talk on the best way to refine your crawl bloat and prune your remaining content effectively. Follow me at @WhitworthSEO for more tech seo nonsense.
7. Crawl budget – determined by rate & demand
What Google can & wants to crawl
@WhitworthSEO bancmedia.com
• Empty pages
• No valued added
• Dupe
• Soft 404
• SPAM
• Hacked content
8. crawl budget
“Prioritizing what to crawl, when, and how much resource the
server hosting the site can allocate to crawling is more important
for bigger sites, or those that auto-generate pages based on URL
parameters”
Gary Ilyes
bancmedia.com@WhitworthSEO
33. stage two: the prune
NoIndex
Will be crawled less over time ensures a high quality SER
P
For duplicate content, cannibalisation and API style pages
@WhitworthSEO bancmedia.com
34. stage two: canonical
For duplicate content, cannibalisation and API style pages
@WhitworthSEO bancmedia.com
canonical
35. stage three: content repurposing/enhancement
@WhitworthSEO bancmedia.com
Evergreen
Seasonal
Long form
Research
37. stage four: the finishing touch
Link Profile Analysis
Links pointing at excluded
pages
Usual disavow request
@WhitworthSEO bancmedia.com
Don’t ruin all your hard work with a crap link profile
38. crawl bloat and pruning checklist
Does your site have crawl bloat?
Choose the appropriate fixes for your site
Prune your remaining content
Continually improve and enhance
@WhitworthSEO bancmedia.com
39. final tips: thanks for coming
@WhitworthSEO bancmedia.com
Thanks for Listening!
2 Tips