The SAWA Corpus - A parallel Corpus English - Swahili

•Descargar como PPT, PDF•

1 recomendación•1,003 vistas

Guy De Pauw

by Guy De Pauw, Peter Waiganjo Wagacha and Gilles-Maurice de Schryver

Tecnología

The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

Resource-scarceness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data-driven approaches ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Machine Translation ,[object Object],[object Object],[object Object],[object Object],data-driven Learn translation from examples: !! Parallel corpus !!

Parallel Corpus ,[object Object],[object Object],[object Object]

Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

3 phases ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data Collection ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

Word alignment ,[object Object],No she ‘ s uh , , up north La , , , yuko , aa juu kaskazini

Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

Word alignment ,[object Object],[object Object]

Current results ,[object Object],Precision Recall F (  =1) 39.4% 44.5% 41.79%

Alignment problems nimemkatalia have turned him down I

Morphological decomposition have turned him down I ni+ me+ m+ katalia

Current results ,[object Object],[object Object],Precision Recall F (  =1) 50.2% 64.5% 55.8%

Future work ,[object Object],[object Object],[object Object]

Future work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object]

Más contenido relacionado

Similar a The SAWA Corpus - A parallel Corpus English - Swahili

Writing Template With Drawing Box. Online assignment writing service.Jeanne Hall

CASL Report1TEDxBaltimore

Essay On Down Syndrome.pdfChristina Morgan

Essay On Down Syndrome.pdfJenn Cooper

How To Write An Essay On Your Ipad. Online assignment writing service.Amy Cruz

Doc106Dr Lendy Spires

Writing To Inform - Poverty - GCSE English - Marked By Teachers.ComNicole Gomez

Essay Writers Online.pdfVictoria Coleman

Essay Writers Online. College essay: Professional essay writers onlineYngris Seino

Essay On ReligionRobin Ortiz

Community Health and Social Services Network: Improving Access to Health and ...CMA Medeiros

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docxlorileemcclatchie

Similar a The SAWA Corpus - A parallel Corpus English - Swahili (12)

Writing Template With Drawing Box. Online assignment writing service.

CASL Report1

Essay On Down Syndrome.pdf

How To Write An Essay On Your Ipad. Online assignment writing service.

Doc106

Writing To Inform - Poverty - GCSE English - Marked By Teachers.Com

Essay Writers Online.pdf

Essay Writers Online. College essay: Professional essay writers online

Essay On Religion

Community Health and Social Services Network: Improving Access to Health and ...

SEND HANDHAKES I WILL PICK3POINTSWhat do you consider the .docx

Más de Guy De Pauw

Technological Tools for Dictionary and Corpora Building for Minority Language...Guy De Pauw

Semi-automated extraction of morphological grammars for Nguni with special re...Guy De Pauw

Resource-Light Bantu Part-of-Speech TaggingGuy De Pauw

Natural Language Processing for Amazigh LanguageGuy De Pauw

POS Annotated 50m Corpus of Tajik LanguageGuy De Pauw

The Tagged Icelandic Corpus (MÍM)Guy De Pauw

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...Guy De Pauw

Tagging and Verifying an Amharic News CorpusGuy De Pauw

A Corpus of SantomeGuy De Pauw

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...Guy De Pauw

Compiling Apertium Dictionaries with HFSTGuy De Pauw

The Database of Modern Icelandic InflectionGuy De Pauw

Learning Morphological Rules for Amharic Verbs Using Inductive Logic ProgrammingGuy De Pauw

Issues in Designing a Corpus of Spoken IrishGuy De Pauw

How to build language technology resources for the next 100 yearsGuy De Pauw

Towards Standardizing Evaluation Test Sets for Compound AnalysersGuy De Pauw

The PALDO Concept - New Paradigms for African Language Resource DevelopmentGuy De Pauw

A System for the Recognition of Handwritten Yorùbá CharactersGuy De Pauw

IFE-MT: An English-to-Yorùbá Machine Translation SystemGuy De Pauw

A Number to Yorùbá Text Transcription SystemGuy De Pauw

Más de Guy De Pauw (20)

Technological Tools for Dictionary and Corpora Building for Minority Language...

Semi-automated extraction of morphological grammars for Nguni with special re...

Resource-Light Bantu Part-of-Speech Tagging

Natural Language Processing for Amazigh Language

POS Annotated 50m Corpus of Tajik Language

The Tagged Icelandic Corpus (MÍM)

Describing Morphologically Rich Languages Using Metagrammars a Look at Verbs ...

Tagging and Verifying an Amharic News Corpus

A Corpus of Santome

Automatic Structuring and Correction Suggestion System for Hungarian Clinical...

Compiling Apertium Dictionaries with HFST

The Database of Modern Icelandic Inflection

Learning Morphological Rules for Amharic Verbs Using Inductive Logic Programming

Issues in Designing a Corpus of Spoken Irish

How to build language technology resources for the next 100 years

Towards Standardizing Evaluation Test Sets for Compound Analysers

The PALDO Concept - New Paradigms for African Language Resource Development

A System for the Recognition of Handwritten Yorùbá Characters

IFE-MT: An English-to-Yorùbá Machine Translation System

A Number to Yorùbá Text Transcription System

Último

Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

Time Series Foundation Models - current state and future directionsNathaniel Shimoni

DevEX - reference for building teams, processes, and platformsSergiu Bodiu

WordPress Websites for Engineers: Elevate Your Brandgvaughan

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

Training state-of-the-art general text embeddingZilliz

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos

Gen AI in Business - Global Trends Report 2024.pdfAddepto

TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey

Take control of your SAP testing with UiPath Test SuiteDianaGray10

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays

Artificial intelligence in cctv survelliance.pptxhariprasad279825

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

How to write a Business Continuity PlanDatabarracks

What is Artificial Intelligence?????????blackmambaettijean

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada

Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan

Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB

The SAWA Corpus - A parallel Corpus English - Swahili

1. The SAWA Corpus A Parallel Corpus English - Swahili Guy De Pauw (guy.depauw@aflat.org) Peter Waiganjo Wagacha (waiganjo@aflat.org) Gilles-Maurice de Schryver (gillesmaurice.deschryver@aflat.org)

10.

11.

12. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

13. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

14. Available data in SAWA Corpus All manually sentence aligned! Thanks to Mahmoud Shokrollahi-Far University College of Nabiye Akram (Iran) English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

15. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

16. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

17. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

18. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

19. Available data in SAWA Corpus All manually sentence aligned! Thanks to Dr. James Omboga Zaja University of Nairobi English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

20. Available data in SAWA Corpus All manually sentence aligned! English Sentences Kiswahili Sentences English Words Kiswahili Words New Testament 16.4k 16.3k 189.2k 151.1k Quran 14.3k 14.5k 165.5k 124.3k Declaration of HR 0.2k 1.8k 1.8k Kamusi.org 5.6k 35.5k 26.7k Movie Subtitles 9.0k 72.2k 58.4k Investment Reports 3.2k 3.1k 52.9k 54.9k Local Translator 1.5k 1.6k 25.0k 25.7k Total 50.2k 50.3k 542.1k 442.9k

21.

22. Word alignment You caught me skiving , I ‘ m afraid . Samahani , umenidaka nikihepa .

23.

24.

25.

26. Alignment problems nimemkatalia have turned him down I

27. Morphological decomposition have turned him down I ni+ me+ m+ katalia

28.

29.

30.

31.

32.

The SAWA Corpus - A parallel Corpus English - Swahili

Recomendados

Recomendados

Más contenido relacionado

Similar a The SAWA Corpus - A parallel Corpus English - Swahili

Similar a The SAWA Corpus - A parallel Corpus English - Swahili (12)

Más de Guy De Pauw

Más de Guy De Pauw (20)

Último

Último (20)

The SAWA Corpus - A parallel Corpus English - Swahili