Its started off as a part of Artificial intelligence. NLP is challenging , but its been widely researched for future application which will have human touch.
2. Outline
What is NLP?
Why Study NLP?
Why are language technologies needed?
Future expectation
Application areas
How NLP works?
Interesting processes by NLP
Tools we need
3. What is Natural Language Processing?
Natural Language Processing
Processing of Human generated language.
Also known as Computational Linguistics (CL), Human
Language Technology (HLT), Natural Language
Engineering (NLE)
Can machines understand human language?
Define ‘understand’
Understanding is the ultimate goal. However, one
doesn’t need to fully understand to be useful.
4. What does it need?
Analyze, understand and generate human languages
just like humans do.
Applying computational techniques to language
domain.
Started off as a branch of Artificial Intelligence..
Borrows from Linguistics, Psycholinguistics, Cognitive
Science & Statistics.
Make computers learn our language rather than we
learn theirs.
5. Why Study NLP?
A hallmark of human intelligence.
Text is the largest repository of human knowledge
and is growing quickly.
emails, news articles, web pages, IM, scientific articles,
insurance claims, customer complaint letters,
transcripts of phone calls, technical documents,
government documents, patent portfolios, court
decisions, contracts, ……
Are we reading any faster than before?
6. Why are language technologies needed?
Many companies would make a lot of money if they
could use computer programmes that understood text or
speech. Just imagine if a computer could be used for:
answering the phone, and replying to a question
understanding the text on a Web page to decide who it
might be of interest to
translating a daily newspaper from Japanese to English (an
attempt is made to do this already)
understanding text in journals / books and building an
expert systems based on that understanding
7. Future Expectations
Show me Star Trek..?? (Talk to your TV set)
Will my computer talk to me like another human ??
Will the search engine get me exactly what I am looking for??
Can my PC read the whole newspaper and tell me the important
news only..??
Can my palmtop translate what that Japanese lady is telling me..
??
Ahhh.. Can my PC do my English homework ??
Do you know how our brain processes language ??
11. NLP Processes
Part –of-speech(POS)
Part –of-speech(POS)
ADJ - NOUN- VERB- ADV
Excellent-Team-To train-Testing
Named entity recognition (NER)
Named entity recognition (NER)
PERSON
ORG
LOC
Raj from TCS applied for Pune Java position
12. Sentimental Analysis
Sentimental Analysis
Candidate has good technical knowledge
Poor communication skills
Word sense disambiguation (WSD)
Word sense disambiguation (WSD)
I need new batteries for my
mouse
Information Extraction (IE)
Information Extraction (IE)
You have been shortlisted for F2F round
13. Challenging issues
Question Asking ??
Question Asking
What is a hiring strategy of IT firms for
2014?
Why HR ask question like Tell me about your self?
Paraphrase
Paraphrase
ABC acquired by XYZ yesterday
ABC Has been taken over by XYZ
Summarization
Summarization
Good stability
Experience in core technology
Immediate joining
Roll out
an offer
15. Tools we need
Knowledge about language
Knowledge about the world
A way to combine knowledge sources
Probabilistic model built from natural language.