The SAWA Corpus - A parallel Corpus English - Swahili

•Descargar como PPT, PDF•

1 recomendación•1,003 vistas

Guy De Pauw

by Guy De Pauw, Peter Waiganjo Wagacha and Gilles-Maurice de Schryver

Tecnología

The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

Resource-scarceness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data-driven approaches ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Machine Translation ,[object Object],[object Object],[object Object],[object Object],data-driven Learn translation from examples: !! Parallel corpus !!

Parallel Corpus ,[object Object],[object Object],[object Object]

Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

3 phases ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Word alignment ,[object Object],No she ‘ s uh , , up north La , , , yuko , aa juu kaskazini

Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

Word alignment ,[object Object],[object Object]

Current results ,[object Object],Precision Recall F (  =1) 39.4% 44.5% 41.79%

Alignment problems nimemkatalia have turned him down I

Morphological decomposition have turned him down I ni+ me+ m+ katalia

Current results ,[object Object],[object Object],Precision Recall F (  =1) 50.2% 64.5% 55.8%

Future work ,[object Object],[object Object],[object Object]

Future work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object]

Más contenido relacionado

Similar a The SAWA Corpus - A parallel Corpus English - Swahili

Writing Template With Drawing Box. Online assignment writing service.Jeanne Hall

CASL Report1TEDxBaltimore

Essay On Down Syndrome.pdfChristina Morgan

Essay On Down Syndrome.pdfJenn Cooper

How To Write An Essay On Your Ipad. Online assignment writing service.Amy Cruz

Doc106Dr Lendy Spires

Writing To Inform - Poverty - GCSE English - Marked By Teachers.ComNicole Gomez

Examples Of Informal Essay. Fantastic Informal Essay ThatsnotusHeidi Marshall

Essay Writers Online.pdfVictoria Coleman

Essay Writers Online. College essay: Professional essay writers onlineYngris Seino

Essay On ReligionRobin Ortiz

Community Health and Social Services Network: Improving Access to Health and ...CMA Medeiros

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docxlorileemcclatchie

Similar a The SAWA Corpus - A parallel Corpus English - Swahili (13)

Writing Template With Drawing Box. Online assignment writing service.

CASL Report1

Essay On Down Syndrome.pdf

How To Write An Essay On Your Ipad. Online assignment writing service.

Doc106

Writing To Inform - Poverty - GCSE English - Marked By Teachers.Com

Examples Of Informal Essay. Fantastic Informal Essay Thatsnotus

Essay Writers Online.pdf

Essay Writers Online. College essay: Professional essay writers online

Essay On Religion

Community Health and Social Services Network: Improving Access to Health and ...

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docx

Más de Guy De Pauw

Technological Tools for Dictionary and Corpora Building for Minority Language...Guy De Pauw

Semi-automated extraction of morphological grammars for Nguni with special re...Guy De Pauw

Resource-Light Bantu Part-of-Speech TaggingGuy De Pauw

Natural Language Processing for Amazigh LanguageGuy De Pauw

POS Annotated 50m Corpus of Tajik LanguageGuy De Pauw

The Tagged Icelandic Corpus (MÍM)Guy De Pauw

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...Guy De Pauw

Tagging and Verifying an Amharic News CorpusGuy De Pauw

A Corpus of SantomeGuy De Pauw

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...Guy De Pauw

Compiling Apertium Dictionaries with HFSTGuy De Pauw

The Database of Modern Icelandic InflectionGuy De Pauw

Learning Morphological Rules for Amharic Verbs Using Inductive Logic ProgrammingGuy De Pauw

Issues in Designing a Corpus of Spoken IrishGuy De Pauw

How to build language technology resources for the next 100 yearsGuy De Pauw

Towards Standardizing Evaluation Test Sets for Compound AnalysersGuy De Pauw

The PALDO Concept - New Paradigms for African Language Resource DevelopmentGuy De Pauw

A System for the Recognition of Handwritten Yorùbá CharactersGuy De Pauw

IFE-MT: An English-to-Yorùbá Machine Translation SystemGuy De Pauw

A Number to Yorùbá Text Transcription SystemGuy De Pauw

Más de Guy De Pauw (20)

Technological Tools for Dictionary and Corpora Building for Minority Language...

Semi-automated extraction of morphological grammars for Nguni with special re...

Resource-Light Bantu Part-of-Speech Tagging

Natural Language Processing for Amazigh Language

POS Annotated 50m Corpus of Tajik Language

The Tagged Icelandic Corpus (MÍM)

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...

Tagging and Verifying an Amharic News Corpus

A Corpus of Santome

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...

Compiling Apertium Dictionaries with HFST

The Database of Modern Icelandic Inflection

Learning Morphological Rules for Amharic Verbs Using Inductive Logic Programming

Issues in Designing a Corpus of Spoken Irish

How to build language technology resources for the next 100 years

Towards Standardizing Evaluation Test Sets for Compound Analysers

The PALDO Concept - New Paradigms for African Language Resource Development

A System for the Recognition of Handwritten Yorùbá Characters

IFE-MT: An English-to-Yorùbá Machine Translation System

A Number to Yorùbá Text Transcription System

Último

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

A Call to Action for Generative AI in 2024Results

WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

Salesforce Community Group Quito, Salesforce 101Paola De la Torre

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745

Histor y of HAM Radio presentation slidevu2urc

Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j

Boost PC performance: How more available memory can improve productivityPrincipled Technologies

Partners Life - Insurer Innovation Award 2024The Digital Insurer

The SAWA Corpus - A parallel Corpus English - Swahili

1. The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

10.

11.

12. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

13. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

14. Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

15. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

16. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

17. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

18. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

19. Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

20. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

21.

22. Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

23.

24.

25.

26. Alignment problems nimemkatalia have turned him down I

27. Morphological decomposition have turned him down I ni+ me+ m+ katalia

28.

29.

30.

31.

32.

The SAWA Corpus - A parallel Corpus English - Swahili

Recomendados

Recomendados

Más contenido relacionado

Similar a The SAWA Corpus - A parallel Corpus English - Swahili

Similar a The SAWA Corpus - A parallel Corpus English - Swahili (13)

Más de Guy De Pauw

Más de Guy De Pauw (20)

Último

Último (20)

The SAWA Corpus - A parallel Corpus English - Swahili