This document contains notes from a presentation or tutorial on web scraping. It discusses scraping basics like libraries, functions, variables, loops and following data through HTML. It also provides examples of scraping jobs listings and Twitter and links to scraping resources and the presenter's online profiles.
15. Things to know
• Libraries
• Functions
• Variables
• Lists or arrays [‘Bob’, ‘Jane’]
• Index
• String, integer, float
• If/Else
• For loops
• Operators
Friday, 13 July 2012
16. Following the data
• From String (URL) ->
• Variable (html) ->
• Variable (root) ->
• Variable containing a list (tds) ->
• Variable (td)
Friday, 13 July 2012
17. Looping through a list
• Tds = [‘Duarte’, ‘Sihl’, ‘Franzi’, ‘Paul’]
• For td in tds
• The first time, td = Duarte
• The second time, td = Sihl
• Then td = Franzi
• Then td = Paul
• Then it has finished the loop!
Friday, 13 July 2012