SlideShare una empresa de Scribd logo
1 de 15
Descargar para leer sin conexión
EMNLP 2011
Improved Transliteration Mining Using Graph
Reinforcement (D11-1128)
Ali El-Kahky, Kareem Darwish, Ahmed Saad Aldein, Mohamed Adb El-Wahab,
Ahmed Hefny, Waleed Ammar

                    http://aclweb.org/anthology-new/D/D11/D11-1128.pdf




           : @machy
•  microsoft   …
transliteration          
•            



     George Wasington
               




                             
          potato
transliteration mining                                        

transliteration
              




                                               http://aclweb.org/anthology/W/W10/W10-2403.pdf

                             transliteration
                                                                                ”Oxford”
           transliteration                ”University”       transliteration
transliteration mining   
• 
•  cross language
     (               )
     (                       )
NEWS2010 Transliteration Shared Task
•  NEWS = Named Entity Workshop Shared task
 ACL workshop. transliteration shared task
 shared task 1

                Wikipedia                                              

                                  
           
               
    
       
                                                      
    
                   
                                   
                              
    
        
                            Wikipedia-                                 
    
           
           Inter-Link
           
    
               
                     
           
   Wikipedia-
                                                          Inter-Link
NEWS2010 Transliteration Shared Task
•      




                   http://aclweb.org/anthology/W/W10/W10-2403.pdf
•  Using Word Dependent Transition Models in HMM based Word
 Alighment for Statistical Machine Translation
 Xiaodong He, ACL-07 2nd SMT workshop

                                                                  HMM
                                      
  P Oxford                  ) = max(
          P(O| ) * P(x|       ) * P(fo|        ) * P(rd|    ),
          P(Ox| ) * P(f|       ) * P(o|        ) * P(rd|    ),
          P(O|   ) * P(x|     ) * P(fo|        ) * P(rd|    ),
          P(Ox|    ) * P(f|    ) * P(fo|        ) * P(rd|    ),
          ...
  )
                                                                        
  source language       character sequence         1    3
transliteration mining                             
• 
     “University of Oxford”, “                       ”
• 



     score(“Oxford”, “                  ”) = -0.123
     ----
     score(“University”, “                  ”) = -1.567
     score(“of”, “                ”) = -2.100
     score(“University”, “     ”) = -2.321
     score(“Oxford”, “     ”) = -2.400
     score(“of”, “   ”) = -2.543
• 
     •    character sequence

          recall
     • 

             precision
graph reinforcement (1/2)
• 
•  2
graph reinforcement (2/2)
•                                 


                                                       

                                                    


                                                

                                               

     s source language(       )
     t target language(   )
     m(s|t), m(t|s)                   p(s|t), p(t|s)
Link Reweighting
graph reinforcement


                               



s source language(         )
t target language(     )

graph reinforcement                m(t|s)
                 s t
graph reinforcement




link reweighting     
      link reweighting   
graph reinforcement              F
link reweighting    F
•  shared task  best
•            graph reinforcement   10

Más contenido relacionado

Último

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Último (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 

Destacado

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Destacado (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

emnlp2011

  • 1. EMNLP 2011 Improved Transliteration Mining Using Graph Reinforcement (D11-1128) Ali El-Kahky, Kareem Darwish, Ahmed Saad Aldein, Mohamed Adb El-Wahab, Ahmed Hefny, Waleed Ammar http://aclweb.org/anthology-new/D/D11/D11-1128.pdf : @machy
  • 3. transliteration •  George Wasington potato
  • 4. transliteration mining transliteration http://aclweb.org/anthology/W/W10/W10-2403.pdf transliteration ”Oxford” transliteration ”University” transliteration
  • 5. transliteration mining •  •  cross language ( ) ( )
  • 6. NEWS2010 Transliteration Shared Task •  NEWS = Named Entity Workshop Shared task ACL workshop. transliteration shared task shared task 1 Wikipedia Wikipedia- Inter-Link Wikipedia- Inter-Link
  • 7. NEWS2010 Transliteration Shared Task •  http://aclweb.org/anthology/W/W10/W10-2403.pdf
  • 8. •  Using Word Dependent Transition Models in HMM based Word Alighment for Statistical Machine Translation Xiaodong He, ACL-07 2nd SMT workshop HMM P Oxford ) = max( P(O| ) * P(x| ) * P(fo| ) * P(rd| ), P(Ox| ) * P(f| ) * P(o| ) * P(rd| ), P(O| ) * P(x| ) * P(fo| ) * P(rd| ), P(Ox| ) * P(f| ) * P(fo| ) * P(rd| ), ... ) source language character sequence 1 3
  • 9. transliteration mining •  “University of Oxford”, “ ” •  score(“Oxford”, “ ”) = -0.123 ---- score(“University”, “ ”) = -1.567 score(“of”, “ ”) = -2.100 score(“University”, “ ”) = -2.321 score(“Oxford”, “ ”) = -2.400 score(“of”, “ ”) = -2.543
  • 10. •  •  character sequence recall •  precision
  • 12. graph reinforcement (2/2) •  s source language( ) t target language( ) m(s|t), m(t|s) p(s|t), p(t|s)
  • 13. Link Reweighting graph reinforcement s source language( ) t target language( ) graph reinforcement m(t|s) s t
  • 14. graph reinforcement link reweighting link reweighting graph reinforcement F link reweighting F
  • 15. •  shared task best •  graph reinforcement 10