SlideShare a Scribd company logo
1 of 27
A WEB BASED BILINGUAL
QUESTION ANSWERING SYSTEM
USING MACHINE LEARNING
APPROACH
BY: GARIMA NANDA
Agenda
 Introduction
 Applications
 Motivation
 Problem Statement
 How QA is different from SE
 Architecture
 Implementation
 Experimental Results
 Conclusion and Future Work
 References
Introduction
 Natural Language Processing (NLP) is a field of computer science and
computational linguistics concerned with the Interaction between computer
systems and human being.
 A Question Answering System is fairly an IR system in which a query is
stated to the system and it relocates the correct or closest results to the
specific query asked in Natural Language.
 It is one of the consequences of Natural Language Interface to Database (NLIDB).
 The main aim of QA is to present the user with a short answer to a question rather than
a list of possibly relevant documents.
User interaction with QAS
Applications
Applications of Natural Language Processing:
 Speech recognition.
 Artificial intelligence and Expert System.
 Natural language interface to database.
Fields in which QAS is employed:
 Agriculture: Interface for providing agriculture field related information to the
farmers
 Sports: Can be used at school level for students.
 Railways: For providing automated information regarding the railways or flights.
Some existing QA systems in specific domains-
 BASEBALL
 LUNAR
 START
 SHRDLU
Motivation
As it becomes more and more difficult to find answers on the WWW using standard search
engines, question answering technology will become increasingly important.
 Greater relevance to find correct answer.
 Potentially allows everyone to participate in today’s information revolution.
 Benefit to people not knowing formal query language.
 Find answer to General Knowledge type of questions.
 The accuracy of QA system can be found.
 Finds answers to such types of questions: Who? What? Where? How? and
क्या, कब, कौन, कै से etc.
Problem Statement
 To design a Graphical User Interface that can generate Bilingual Natural Language
output.
 To design a QAS using General Knowledge Database.
 To develop a system which automatically predict the misspelled words and jumbled
phrases with their actual word related to the query
 To develop a system which gives correct and concise result related to the questions.
 Evaluate the performance and accuracy of the overall system.
 Apply the best similarity measure in the system to handle the queries in many ways.
How QAS is different from SE
QA System Search Engine
Query in Natural Language(Question) Queries based on keywords
Present answers to users Users find answers from retrieved results
Some NL process used to determine results Mostly keywords and ranking to retrieve results
Architecture
of
QAS
Architecture contd…
 Three main phases of Architecture-
 Along with the Knowledge Base (SWD + Entities +
Trained Data).
Accessing
Natural
Query Phase
Phase I
Feature
Extraction
Phase
Phase II
Classification
Phase
Phase III
Architecture contd…
 Identify the nature or type of query.
 Query statement is read, processed and tokenized.
 Removal of Bag-of-words from the query, resulting into tokens.
Accessing NL Query
phase
Architecture contd…
 Feature extraction; to extract features (i.e. known
keywords are extracted using similarity).
 Data gets trained here resulting into feature vector
Feature Extraction
Phase
Architecture contd…
 In Classification phase, FV is compared to the Feature Space(i.e
Trained Data) resulting in Labels.
 Labels will be directly represent the answer of the query.
 Finally in this way the answer is predicted after comparison and result
is displayed.
Classification Phase
Implementation
 Web Based Graphical User Interface has been implemented into the
system so as increase its scope and portability.
 Auto complete feature along with the query input text box has been
implemented.
 Queries with misspelled words and jumbled phrases accepted by the
implemented system.
 The Machine Learning Approach has been used so as to train the system
as a result of which the accuracy as well as the efficiency of the system
has been increased.
Implementation contd…
The Web based Graphical User Interface for QAS has been shown below with the
help of a snapshot.
Language Selection Screen
Implementation contd…
 Main Screen
Implementation contd…
 Question Input Screen in Hindi Language
Implementation contd…
 Auto Complete feature has been illustrated below with the help of a
snapshot
Implementation contd…
 Result of the executed query snapshot is shown below.
Question Input Screen with Autocomplete feature for query in
English Language
Result screen with specific output to the query in English
Experimental Results
Test Set Total Correct Overall Accuracy %
TS1 25 23 92
TS2 50 44 88
 TS1, TS2- test sets
 TS1 carries those questions which are queried by a known user and TS2 are those
questions which are given by that user who is unaware about the domain
 Overall accuracy is computed when a complete test set is given as input to the QA
system.
Experimental Results contd…
86
87
88
89
90
91
92
TS1 TS2
Overall Acc. %
Overall Acc. %
The accuracy percentage is itself reflecting that which of
the two test set is performing better
CONCLUSION AND FUTURE WORK
 The Question answering system for Hindi Natural Language gives a vast
idea of QA System with Overall accuracy of 92% and threshold of 0.9.
 The concepts of Overall Accuracy and similarity are used here.
 This is far better than the concepts being used in earlier systems.
 The system has been made Web Based and has been provided with the
functionality of AutoComplete feature to increase the scope and make it
more user friendly respectively.
 Our system removes the limitation of existing work.
 Making the system Multilingual by incorporating other languages such as
English, French, Spanish languages along with these two languages.
 Further different Classifiers can be tested on our system
References
 Sunil A. Khillare, Bharat A. Shelke, and C. Namrata Mahender, "Comparitive Study on Question
Answering Systems and Techniques," International Journal of Advanced Research in Computer
Science and Software Engineering, vol. 4, pp. 775-778, November 2014.
 Jovita, Linda, Andrei Hartawan, DerwinSuhartono," Using Vector Space Model in Question
Answering System,"International Conference on Computer Science and Computational
Intelligence (ICCSCI 2015), ScienceDirect, pp. 305-311.
 Show-Jane Yen, Yu-ChiehWu, Jie-Chi Yang, Yue-Shi Lee, Chung-Jung Lee, Jui-Jung Liu," A
support vector machine-based context-ranking model for question answering," Information
Sciences, ScienceDirect, pp. 77-87, 2013.
 Asma Ben Abacha a, Pierre Zweigenbaum," MEANS: A medical questionanswering system
combining NLP techniques and semantic Web technologies," Information Processing and
Management, ScienceDirect, pp. 570-594, 2015.
 Sneha Bagde, Mohit Dua, and Zorawar Singh Virk, " Comparison of Different Similarity
Functions on Hindi QA System," International conference on ICT for Sustainable Development
(ICT4SD), Springer, pp. 657-663, vol. 408, February 2016.
 Smith Mahboob Alam Khalid, Valentin Jijkoun and Maarten de Rijke, “ Machine
Learning for Question Answering from Tabular Data, “ 18th International Workshop
on Database and Expert Systems Applications, IEEE, 2007.
 Sanjay K Dwivedi, Vaishali Singh, “Research and Reviews in Question answering
system,” International Conference on Computational Intelligence: Modelling
Techniques and Applications, ScienceDirect, pp. 417-424, 2013.
 Er. Amit Chaudhary, Er. Annu Battan," Natural Language Interface to Databases-
An Introduction," International Journal of Advanced Research in Computer
Science and Software Engineering, Vol. 4, Issue 7, July 2014.
 Rajender Kumar, Mohit Dua, Shivani Jindal," D-HIRD: DomainIndependent Hindi
Language Interface to Relational Database," International Conference on
Computation of Power, Energy, Information and Communication (ICCPEIC), IEEE,
2014.
 Mohit Dua, Sandeep Kumar, Zorawar Singh Virk, “ Hindi Language Graphical User
Interface to Database Management System,” International Conference on
Machine Learning and Applications, IEEE, 2013.
THANK YOU…

More Related Content

What's hot

Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processinggulshan kumar
 
Natural Language Processing (NLP) - Introduction
Natural Language Processing (NLP) - IntroductionNatural Language Processing (NLP) - Introduction
Natural Language Processing (NLP) - IntroductionAritra Mukherjee
 
Natural language processing (NLP) introduction
Natural language processing (NLP) introductionNatural language processing (NLP) introduction
Natural language processing (NLP) introductionRobert Lujo
 
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingMinh Pham
 
Natural language processing (nlp)
Natural language processing (nlp)Natural language processing (nlp)
Natural language processing (nlp)Kuppusamy P
 
Natural language procssing
Natural language procssing Natural language procssing
Natural language procssing Rajnish Raj
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Simplilearn
 
Natural Language Processing: Parsing
Natural Language Processing: ParsingNatural Language Processing: Parsing
Natural Language Processing: ParsingRushdi Shams
 
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU
Natural Language Processing in Artificial Intelligence  - Codeup #5 - PayU Natural Language Processing in Artificial Intelligence  - Codeup #5 - PayU
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU Artivatic.ai
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTSuman Debnath
 
natural language processing help at myassignmenthelp.net
natural language processing  help at myassignmenthelp.netnatural language processing  help at myassignmenthelp.net
natural language processing help at myassignmenthelp.netwww.myassignmenthelp.net
 
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...Edureka!
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)VenkateshMurugadas
 

What's hot (20)

NLP
NLPNLP
NLP
 
Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processing
 
Natural Language Processing (NLP) - Introduction
Natural Language Processing (NLP) - IntroductionNatural Language Processing (NLP) - Introduction
Natural Language Processing (NLP) - Introduction
 
Natural language processing (NLP) introduction
Natural language processing (NLP) introductionNatural language processing (NLP) introduction
Natural language processing (NLP) introduction
 
NAMED ENTITY RECOGNITION
NAMED ENTITY RECOGNITIONNAMED ENTITY RECOGNITION
NAMED ENTITY RECOGNITION
 
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
 
Nlp
NlpNlp
Nlp
 
Natural language processing (nlp)
Natural language processing (nlp)Natural language processing (nlp)
Natural language processing (nlp)
 
Word embedding
Word embedding Word embedding
Word embedding
 
Natural language procssing
Natural language procssing Natural language procssing
Natural language procssing
 
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
Recurrent Neural Network (RNN) | RNN LSTM Tutorial | Deep Learning Course | S...
 
Natural Language Processing: Parsing
Natural Language Processing: ParsingNatural Language Processing: Parsing
Natural Language Processing: Parsing
 
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU
Natural Language Processing in Artificial Intelligence  - Codeup #5 - PayU Natural Language Processing in Artificial Intelligence  - Codeup #5 - PayU
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERT
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
natural language processing help at myassignmenthelp.net
natural language processing  help at myassignmenthelp.netnatural language processing  help at myassignmenthelp.net
natural language processing help at myassignmenthelp.net
 
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Tra...
 
Text Classification
Text ClassificationText Classification
Text Classification
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)
 
AI: Logic in AI
AI: Logic in AIAI: Logic in AI
AI: Logic in AI
 

Similar to Question Answering System using machine learning approach

Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...
Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...
Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...IRJET Journal
 
Open domain question answering system using semantic role labeling
Open domain question answering system using semantic role labelingOpen domain question answering system using semantic role labeling
Open domain question answering system using semantic role labelingeSAT Publishing House
 
IRJET- Factoid Question and Answering System
IRJET-  	  Factoid Question and Answering SystemIRJET-  	  Factoid Question and Answering System
IRJET- Factoid Question and Answering SystemIRJET Journal
 
IRJET- Semantic Question Matching
IRJET- Semantic Question MatchingIRJET- Semantic Question Matching
IRJET- Semantic Question MatchingIRJET Journal
 
Application of hidden markov model in question answering systems
Application of hidden markov model in question answering systemsApplication of hidden markov model in question answering systems
Application of hidden markov model in question answering systemsijcsa
 
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...ijcsit
 
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...AIRCC Publishing Corporation
 
Different Methodologies For Testing Web Application Testing
Different Methodologies For Testing Web Application TestingDifferent Methodologies For Testing Web Application Testing
Different Methodologies For Testing Web Application TestingRachel Davis
 
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSQUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSijnlc
 
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSQUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSkevig
 
IRJET- Automated Exam Question Generator using Genetic Algorithm
IRJET-  	  Automated Exam Question Generator using Genetic AlgorithmIRJET-  	  Automated Exam Question Generator using Genetic Algorithm
IRJET- Automated Exam Question Generator using Genetic AlgorithmIRJET Journal
 
Online Examination and Evaluation System
Online Examination and Evaluation SystemOnline Examination and Evaluation System
Online Examination and Evaluation SystemIRJET Journal
 
professional fuzzy type-ahead rummage around in xml type-ahead search techni...
professional fuzzy type-ahead rummage around in xml  type-ahead search techni...professional fuzzy type-ahead rummage around in xml  type-ahead search techni...
professional fuzzy type-ahead rummage around in xml type-ahead search techni...Kumar Goud
 
Online examination management system..pdf
Online examination management system..pdfOnline examination management system..pdf
Online examination management system..pdfKamal Acharya
 
Answer extraction and passage retrieval for
Answer extraction and passage retrieval forAnswer extraction and passage retrieval for
Answer extraction and passage retrieval forWaheeb Ahmed
 
IRJET- Analysis of Question and Answering Recommendation System
IRJET-  	  Analysis of Question and Answering Recommendation SystemIRJET-  	  Analysis of Question and Answering Recommendation System
IRJET- Analysis of Question and Answering Recommendation SystemIRJET Journal
 
Convolutional recurrent neural network with template based representation for...
Convolutional recurrent neural network with template based representation for...Convolutional recurrent neural network with template based representation for...
Convolutional recurrent neural network with template based representation for...IJECEIAES
 
Varalakhmi_Suresh_1
Varalakhmi_Suresh_1Varalakhmi_Suresh_1
Varalakhmi_Suresh_1varu suresh
 
Major File On web Development
Major File On web Development Major File On web Development
Major File On web Development Love Kothari
 

Similar to Question Answering System using machine learning approach (20)

Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...
Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...
Question Retrieval in Community Question Answering via NON-Negative Matrix Fa...
 
Open domain question answering system using semantic role labeling
Open domain question answering system using semantic role labelingOpen domain question answering system using semantic role labeling
Open domain question answering system using semantic role labeling
 
IRJET- Factoid Question and Answering System
IRJET-  	  Factoid Question and Answering SystemIRJET-  	  Factoid Question and Answering System
IRJET- Factoid Question and Answering System
 
IRJET- Semantic Question Matching
IRJET- Semantic Question MatchingIRJET- Semantic Question Matching
IRJET- Semantic Question Matching
 
Application of hidden markov model in question answering systems
Application of hidden markov model in question answering systemsApplication of hidden markov model in question answering systems
Application of hidden markov model in question answering systems
 
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
 
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
DEVELOPING A FRAMEWORK FOR ONLINE PRACTICE EXAMINATION AND AUTOMATED SCORE GE...
 
Different Methodologies For Testing Web Application Testing
Different Methodologies For Testing Web Application TestingDifferent Methodologies For Testing Web Application Testing
Different Methodologies For Testing Web Application Testing
 
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSQUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
 
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETSQUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
QUESTION ANSWERING MODULE LEVERAGING HETEROGENEOUS DATASETS
 
IRJET- Automated Exam Question Generator using Genetic Algorithm
IRJET-  	  Automated Exam Question Generator using Genetic AlgorithmIRJET-  	  Automated Exam Question Generator using Genetic Algorithm
IRJET- Automated Exam Question Generator using Genetic Algorithm
 
Online Examination and Evaluation System
Online Examination and Evaluation SystemOnline Examination and Evaluation System
Online Examination and Evaluation System
 
professional fuzzy type-ahead rummage around in xml type-ahead search techni...
professional fuzzy type-ahead rummage around in xml  type-ahead search techni...professional fuzzy type-ahead rummage around in xml  type-ahead search techni...
professional fuzzy type-ahead rummage around in xml type-ahead search techni...
 
Online examination management system..pdf
Online examination management system..pdfOnline examination management system..pdf
Online examination management system..pdf
 
Minor
MinorMinor
Minor
 
Answer extraction and passage retrieval for
Answer extraction and passage retrieval forAnswer extraction and passage retrieval for
Answer extraction and passage retrieval for
 
IRJET- Analysis of Question and Answering Recommendation System
IRJET-  	  Analysis of Question and Answering Recommendation SystemIRJET-  	  Analysis of Question and Answering Recommendation System
IRJET- Analysis of Question and Answering Recommendation System
 
Convolutional recurrent neural network with template based representation for...
Convolutional recurrent neural network with template based representation for...Convolutional recurrent neural network with template based representation for...
Convolutional recurrent neural network with template based representation for...
 
Varalakhmi_Suresh_1
Varalakhmi_Suresh_1Varalakhmi_Suresh_1
Varalakhmi_Suresh_1
 
Major File On web Development
Major File On web Development Major File On web Development
Major File On web Development
 

Recently uploaded

VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayEpec Engineered Technologies
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfRagavanV2
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXssuser89054b
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlysanyuktamishra911
 
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...Arindam Chakraborty, Ph.D., P.E. (CA, TX)
 
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...soginsider
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.Kamal Acharya
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationBhangaleSonal
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityMorshed Ahmed Rahath
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxJuliansyahHarahap1
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueBhangaleSonal
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698
 
22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf203318pmpc
 

Recently uploaded (20)

Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Netaji Nagar, Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced LoadsFEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
 
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
 
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
A Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna MunicipalityA Study of Urban Area Plan for Pabna Municipality
A Study of Urban Area Plan for Pabna Municipality
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf22-prompt engineering noted slide shown.pdf
22-prompt engineering noted slide shown.pdf
 

Question Answering System using machine learning approach

  • 1. A WEB BASED BILINGUAL QUESTION ANSWERING SYSTEM USING MACHINE LEARNING APPROACH BY: GARIMA NANDA
  • 2. Agenda  Introduction  Applications  Motivation  Problem Statement  How QA is different from SE  Architecture  Implementation  Experimental Results  Conclusion and Future Work  References
  • 3. Introduction  Natural Language Processing (NLP) is a field of computer science and computational linguistics concerned with the Interaction between computer systems and human being.  A Question Answering System is fairly an IR system in which a query is stated to the system and it relocates the correct or closest results to the specific query asked in Natural Language.  It is one of the consequences of Natural Language Interface to Database (NLIDB).  The main aim of QA is to present the user with a short answer to a question rather than a list of possibly relevant documents.
  • 5. Applications Applications of Natural Language Processing:  Speech recognition.  Artificial intelligence and Expert System.  Natural language interface to database. Fields in which QAS is employed:  Agriculture: Interface for providing agriculture field related information to the farmers  Sports: Can be used at school level for students.  Railways: For providing automated information regarding the railways or flights. Some existing QA systems in specific domains-  BASEBALL  LUNAR  START  SHRDLU
  • 6. Motivation As it becomes more and more difficult to find answers on the WWW using standard search engines, question answering technology will become increasingly important.  Greater relevance to find correct answer.  Potentially allows everyone to participate in today’s information revolution.  Benefit to people not knowing formal query language.  Find answer to General Knowledge type of questions.  The accuracy of QA system can be found.  Finds answers to such types of questions: Who? What? Where? How? and क्या, कब, कौन, कै से etc.
  • 7. Problem Statement  To design a Graphical User Interface that can generate Bilingual Natural Language output.  To design a QAS using General Knowledge Database.  To develop a system which automatically predict the misspelled words and jumbled phrases with their actual word related to the query  To develop a system which gives correct and concise result related to the questions.  Evaluate the performance and accuracy of the overall system.  Apply the best similarity measure in the system to handle the queries in many ways.
  • 8. How QAS is different from SE QA System Search Engine Query in Natural Language(Question) Queries based on keywords Present answers to users Users find answers from retrieved results Some NL process used to determine results Mostly keywords and ranking to retrieve results
  • 10. Architecture contd…  Three main phases of Architecture-  Along with the Knowledge Base (SWD + Entities + Trained Data). Accessing Natural Query Phase Phase I Feature Extraction Phase Phase II Classification Phase Phase III
  • 11. Architecture contd…  Identify the nature or type of query.  Query statement is read, processed and tokenized.  Removal of Bag-of-words from the query, resulting into tokens. Accessing NL Query phase
  • 12. Architecture contd…  Feature extraction; to extract features (i.e. known keywords are extracted using similarity).  Data gets trained here resulting into feature vector Feature Extraction Phase
  • 13. Architecture contd…  In Classification phase, FV is compared to the Feature Space(i.e Trained Data) resulting in Labels.  Labels will be directly represent the answer of the query.  Finally in this way the answer is predicted after comparison and result is displayed. Classification Phase
  • 14. Implementation  Web Based Graphical User Interface has been implemented into the system so as increase its scope and portability.  Auto complete feature along with the query input text box has been implemented.  Queries with misspelled words and jumbled phrases accepted by the implemented system.  The Machine Learning Approach has been used so as to train the system as a result of which the accuracy as well as the efficiency of the system has been increased.
  • 15. Implementation contd… The Web based Graphical User Interface for QAS has been shown below with the help of a snapshot. Language Selection Screen
  • 17. Implementation contd…  Question Input Screen in Hindi Language
  • 18. Implementation contd…  Auto Complete feature has been illustrated below with the help of a snapshot
  • 19. Implementation contd…  Result of the executed query snapshot is shown below.
  • 20. Question Input Screen with Autocomplete feature for query in English Language
  • 21. Result screen with specific output to the query in English
  • 22. Experimental Results Test Set Total Correct Overall Accuracy % TS1 25 23 92 TS2 50 44 88  TS1, TS2- test sets  TS1 carries those questions which are queried by a known user and TS2 are those questions which are given by that user who is unaware about the domain  Overall accuracy is computed when a complete test set is given as input to the QA system.
  • 23. Experimental Results contd… 86 87 88 89 90 91 92 TS1 TS2 Overall Acc. % Overall Acc. % The accuracy percentage is itself reflecting that which of the two test set is performing better
  • 24. CONCLUSION AND FUTURE WORK  The Question answering system for Hindi Natural Language gives a vast idea of QA System with Overall accuracy of 92% and threshold of 0.9.  The concepts of Overall Accuracy and similarity are used here.  This is far better than the concepts being used in earlier systems.  The system has been made Web Based and has been provided with the functionality of AutoComplete feature to increase the scope and make it more user friendly respectively.  Our system removes the limitation of existing work.  Making the system Multilingual by incorporating other languages such as English, French, Spanish languages along with these two languages.  Further different Classifiers can be tested on our system
  • 25. References  Sunil A. Khillare, Bharat A. Shelke, and C. Namrata Mahender, "Comparitive Study on Question Answering Systems and Techniques," International Journal of Advanced Research in Computer Science and Software Engineering, vol. 4, pp. 775-778, November 2014.  Jovita, Linda, Andrei Hartawan, DerwinSuhartono," Using Vector Space Model in Question Answering System,"International Conference on Computer Science and Computational Intelligence (ICCSCI 2015), ScienceDirect, pp. 305-311.  Show-Jane Yen, Yu-ChiehWu, Jie-Chi Yang, Yue-Shi Lee, Chung-Jung Lee, Jui-Jung Liu," A support vector machine-based context-ranking model for question answering," Information Sciences, ScienceDirect, pp. 77-87, 2013.  Asma Ben Abacha a, Pierre Zweigenbaum," MEANS: A medical questionanswering system combining NLP techniques and semantic Web technologies," Information Processing and Management, ScienceDirect, pp. 570-594, 2015.  Sneha Bagde, Mohit Dua, and Zorawar Singh Virk, " Comparison of Different Similarity Functions on Hindi QA System," International conference on ICT for Sustainable Development (ICT4SD), Springer, pp. 657-663, vol. 408, February 2016.
  • 26.  Smith Mahboob Alam Khalid, Valentin Jijkoun and Maarten de Rijke, “ Machine Learning for Question Answering from Tabular Data, “ 18th International Workshop on Database and Expert Systems Applications, IEEE, 2007.  Sanjay K Dwivedi, Vaishali Singh, “Research and Reviews in Question answering system,” International Conference on Computational Intelligence: Modelling Techniques and Applications, ScienceDirect, pp. 417-424, 2013.  Er. Amit Chaudhary, Er. Annu Battan," Natural Language Interface to Databases- An Introduction," International Journal of Advanced Research in Computer Science and Software Engineering, Vol. 4, Issue 7, July 2014.  Rajender Kumar, Mohit Dua, Shivani Jindal," D-HIRD: DomainIndependent Hindi Language Interface to Relational Database," International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC), IEEE, 2014.  Mohit Dua, Sandeep Kumar, Zorawar Singh Virk, “ Hindi Language Graphical User Interface to Database Management System,” International Conference on Machine Learning and Applications, IEEE, 2013.