The document discusses topic modeling and natural language processing techniques. It describes latent Dirichlet allocation, which divides a corpus into topics represented by distributions of term probabilities. It also outlines the processing steps, including tokenizing, stopword removal, dictionary generation, and storing results in MongoDB. The goal is to perform topic modeling on articles and tweets to discover hidden themes.

1. What the
# ?Brand Media Monitor
Alejandro Giacometti

2. Popularity
http://…

3. Hidden Stories

4. #brand
http://…
Storage Cleaning LDA
Bacon ipsum dolor amet pa
ncetta filet mignon short loin pork fatback meatloaf ham
boudin capicola kielbasa short ribs pare ribs flank leberkas.
Frankfurter short loin porchetta cupim. Turkey ham hock pork
boudin. Bacon pork loin venison kielbasa fatback capicola
swine beef tenderloin pork chop. Tri-tip landjaeger bacon beef
ribs, meatball short ribs tenderloin jowl beef brisket spare ribs
turkey ham hock. T-bone andouille cow ground round
meatloaf.
Pastrami cow prosciutto, chuck pork pig flank shank pancetta
chicken short ribs tri-tip salami. Capicola bacon doner, turkey
shank beef ribs pork jerky kielbasa pig filet mignon ground
round pastrami. Alcatra biltong pork t-bone filet mignon tri-tip
pig strip steak porchetta hamburger. Bresaola corned beef
shank venison ham meatball.
Frankfurter jerky tri-tip short ribs turkey boudin rump,
meatball fatback capicola picanha shoulder landjaeger cupim.
Flank sausage tail pork loin beef ribs, corned beef frankfurter
strip steak. Chuck alcatra swine jerky ham. Tri-tip strip steak
filet mignon landjaeger corned beef pork belly swine flank
sirloin bresaola beef. Beef ribs boudin tongue pork belly
landjaeger. Salami cow beef ribs, sausage shoulder fatback
drumstick ham beef rump. Beef ribs tri-tip sausage kielbasa
ham pork jowl, corned beef hamburger short loin tongue
cupim biltong strip steak.
Bacon ipsum dolor amet pa
ncetta filet mignon short loin pork fatback meatloaf ham
boudin capicola kielbasa short ribs pare ribs flank leberkas.
Frankfurter short loin porchetta cupim. Turkey ham hock pork
boudin. Bacon pork loin venison kielbasa fatback capicola
swine beef tenderloin pork chop. Tri-tip landjaeger bacon beef
ribs, meatball short ribs tenderloin jowl beef brisket spare ribs
turkey ham hock. T-bone andouille cow ground round
meatloaf.
Pastrami cow prosciutto, chuck pork pig flank shank pancetta
chicken short ribs tri-tip salami. Capicola bacon doner, turkey
shank beef ribs pork jerky kielbasa pig filet mignon ground
round pastrami. Alcatra biltong pork t-bone filet mignon tri-tip
pig strip steak porchetta hamburger. Bresaola corned beef
shank venison ham meatball.
Frankfurter jerky tri-tip short ribs turkey boudin rump,
meatball fatback capicola picanha shoulder landjaeger cupim.
Flank sausage tail pork loin beef ribs, corned beef frankfurter
strip steak. Chuck alcatra swine jerky ham. Tri-tip strip steak
filet mignon landjaeger corned beef pork belly swine flank
sirloin bresaola beef. Beef ribs boudin tongue pork belly
landjaeger. Salami cow beef ribs, sausage shoulder fatback
drumstick ham beef rump. Beef ribs tri-tip sausage kielbasa
ham pork jowl, corned beef hamburger short loin tongue
cupim biltong strip steak.
Bacon ipsum dolor amet pa
ncetta filet mignon short loin pork fatback meatloaf ham
boudin capicola kielbasa short ribs pare ribs flank leberkas.
Frankfurter short loin porchetta cupim. Turkey ham hock pork
boudin. Bacon pork loin venison kielbasa fatback capicola
swine beef tenderloin pork chop. Tri-tip landjaeger bacon beef
ribs, meatball short ribs tenderloin jowl beef brisket spare ribs
turkey ham hock. T-bone andouille cow ground round
meatloaf.
Pastrami cow prosciutto, chuck pork pig flank shank pancetta
chicken short ribs tri-tip salami. Capicola bacon doner, turkey
shank beef ribs pork jerky kielbasa pig filet mignon ground
round pastrami. Alcatra biltong pork t-bone filet mignon tri-tip
pig strip steak porchetta hamburger. Bresaola corned beef
shank venison ham meatball.
Frankfurter jerky tri-tip short ribs turkey boudin rump,
meatball fatback capicola picanha shoulder landjaeger cupim.
Flank sausage tail pork loin beef ribs, corned beef frankfurter
strip steak. Chuck alcatra swine jerky ham. Tri-tip strip steak
filet mignon landjaeger corned beef pork belly swine flank
sirloin bresaola beef. Beef ribs boudin tongue pork belly
landjaeger. Salami cow beef ribs, sausage shoulder fatback
drumstick ham beef rump. Beef ribs tri-tip sausage kielbasa
ham pork jowl, corned beef hamburger short loin tongue
cupim biltong strip steak.
Bacon ipsum dolor amet pa
ncetta filet mignon short loin pork fatback meatloaf ham
boudin capicola kielbasa short ribs pare ribs flank leberkas.
Frankfurter short loin porchetta cupim. Turkey ham hock pork
boudin. Bacon pork loin venison kielbasa fatback capicola
swine beef tenderloin pork chop. Tri-tip landjaeger bacon beef
ribs, meatball short ribs tenderloin jowl beef brisket spare ribs
turkey ham hock. T-bone andouille cow ground round
meatloaf.
Pastrami cow prosciutto, chuck pork pig flank shank pancetta
chicken short ribs tri-tip salami. Capicola bacon doner, turkey
shank beef ribs pork jerky kielbasa pig filet mignon ground
round pastrami. Alcatra biltong pork t-bone filet mignon tri-tip
pig strip steak porchetta hamburger. Bresaola corned beef
shank venison ham meatball.
Frankfurter jerky tri-tip short ribs turkey boudin rump,
meatball fatback capicola picanha shoulder landjaeger cupim.
Flank sausage tail pork loin beef ribs, corned beef frankfurter
strip steak. Chuck alcatra swine jerky ham. Tri-tip strip steak
filet mignon landjaeger corned beef pork belly swine flank
sirloin bresaola beef. Beef ribs boudin tongue pork belly
landjaeger. Salami cow beef ribs, sausage shoulder fatback
drumstick ham beef rump. Beef ribs tri-tip sausage kielbasa
ham pork jowl, corned beef hamburger short loin tongue
cupim biltong strip steak.
Report
Tokenize
Detect language
Remove stopwords
Lemmatize
MongoDB
Generate bi-grams
Remove uncommon
Remove too common
Scrape
Detect TextBlock
Select articles
corpus dictionary article vector
articles in topic
& relevance
topics
rank by popularity
rank by relevance
select by topic

5. Alejandro Giacometti

6. Storage Cleaning LDA
Topic Modelling
Latent Dirichlet Allocation
Generative Model
Divides the corpus into a series of
topics, each topic is represented by
the distribution of probabilities of a
series of terms.
No topic themes
Distributed, batched processed
Tokenizing
Divide each article into individual
tokens
Stopword removal
Detect language
Remove stopwords
remove the hashtag
Dictionary
Generate a list of unique words
and bigrams which appear at least
twice in the corpus.
MongoDB
Unstructured data storage in JSON
Aggregation querying
Tweets with links
Articles linked more than once, which
have text longer than a 1000
characters
Terms present in the corpus more
than once

7. Topics

8. Topic term distribution

9. Term Frequency

16. NLTK