SlideShare una empresa de Scribd logo
1 de 13
Issues, Challenges and
perspectives of digitization: the
       NLP experience
A Presentation for 12th SEAPAVAA Conference
“Digital debates on archives, museums and libraries”
Meeting Rooms 5-6, SMX Convention Center, SM Mall of Asia
Manila, Philippines
Sep 17, 2009

                                        By Edgardo Quiros
                                          Chief, IT Division
                                  National Library of the Philippines
Background

Digitization of Filipiniana books under
 copyright registration
Digitization of Copyright registration
 documents
Philippine eLibrary
Now a program covering Filipiniana
 materials
The Digitization Experience
Phase 1: Outsourced
 25 million pages target was achieved in less
  than 1 year in 2004
 By 2007, re-work is still ongoing to correct
  unreadable pages. It was stopped because it
  will take longer to perform quality control
  compared to re-scanning by our staff.
 Some originals sustained damages
 Output file size is large
Phase 2: In-house
1 million pages target was achieved in 1
 year in 2007 (Equivalent to 3-year
 productivity of another outsourced
 project of similar staffing)
Non-destructive techniques were used to
 prevent damages
Output file size is smaller
Quality is better than phase 1
Our Gains from In-house
        Digitization
Digitized document as output (in
 outsourcing this is the only
 output)
Ability to digitized materials with
 limited budget including
 materials with few pages.
 Outsourcing requires a minimum
 volume of materials.
Better quality of digitized
Our Gains from In-house
         Digitization
 Minimal damage/loss, if none at all, to
  delicate materials
 Procured equipment, computer
  hardware and software can be used
  to digitize more materials (new
  materials are added each year)
 Procured equipment, computer
  hardware and software is useful in
  post-digitization services such as
  information repackaging and delivery
Comparison
Phase 1 PDF file size Phase 1 PDF file size
  of a page             of a page
218 KB               41 KB
*see sample page      *see sample page
Phase 1 sample page
Phase 2 sample page
Our Gains from In-house
         Digitization
 Staff gained skills, experience and
  knowledge
 Achieved faster delivery of digitized
  materials due to very minimal time
  spent in training, selection,
  organization, and quality control
 Reports, guides, and papers from the
  digitization activity now serves as
  reference materials
 Developed appropriate workflows for
  each material
eLibrary URL


  Visit us at:

www.elib.gov.ph
Thank you and
  Mabuhay!

Más contenido relacionado

Destacado

Open nlp presentationss
Open nlp presentationssOpen nlp presentationss
Open nlp presentationssChandan Deb
 
Natural Language Processing Tools for the Digital Humanities
Natural Language Processing Tools for the Digital HumanitiesNatural Language Processing Tools for the Digital Humanities
Natural Language Processing Tools for the Digital HumanitiesXiang Li
 
Speech recognition techniques
Speech recognition techniquesSpeech recognition techniques
Speech recognition techniquessonukumar142
 
Pitts Library Digitization Initiatives
Pitts Library Digitization InitiativesPitts Library Digitization Initiatives
Pitts Library Digitization Initiativesjbweave
 
Michael Hausenblas- Scalable time series and stream processing for IoT applic...
Michael Hausenblas- Scalable time series and stream processing for IoT applic...Michael Hausenblas- Scalable time series and stream processing for IoT applic...
Michael Hausenblas- Scalable time series and stream processing for IoT applic...WithTheBest
 
Personal Assistant Application Using Android
Personal Assistant Application Using AndroidPersonal Assistant Application Using Android
Personal Assistant Application Using AndroidAhmar Ansari
 
Machine Intelligence Applications for IoT Slam Dec 1st 2016
Machine Intelligence Applications for IoT Slam Dec 1st 2016Machine Intelligence Applications for IoT Slam Dec 1st 2016
Machine Intelligence Applications for IoT Slam Dec 1st 2016Sudha Jamthe
 
Watson Internet of Things Hexamite
Watson Internet of Things HexamiteWatson Internet of Things Hexamite
Watson Internet of Things HexamiteJason Lu
 

Destacado (16)

The Current State of the National Museum of the Philippines and its Role in P...
The Current State of the National Museum of the Philippines and its Role in P...The Current State of the National Museum of the Philippines and its Role in P...
The Current State of the National Museum of the Philippines and its Role in P...
 
Open nlp presentationss
Open nlp presentationssOpen nlp presentationss
Open nlp presentationss
 
Google voice
Google voice Google voice
Google voice
 
Natural Language Processing Tools for the Digital Humanities
Natural Language Processing Tools for the Digital HumanitiesNatural Language Processing Tools for the Digital Humanities
Natural Language Processing Tools for the Digital Humanities
 
Speech recognition techniques
Speech recognition techniquesSpeech recognition techniques
Speech recognition techniques
 
Pitts Library Digitization Initiatives
Pitts Library Digitization InitiativesPitts Library Digitization Initiatives
Pitts Library Digitization Initiatives
 
Michael Hausenblas- Scalable time series and stream processing for IoT applic...
Michael Hausenblas- Scalable time series and stream processing for IoT applic...Michael Hausenblas- Scalable time series and stream processing for IoT applic...
Michael Hausenblas- Scalable time series and stream processing for IoT applic...
 
Personal Assistant Application Using Android
Personal Assistant Application Using AndroidPersonal Assistant Application Using Android
Personal Assistant Application Using Android
 
Google voice
Google voice Google voice
Google voice
 
Internet of Things (IoT) and Google
Internet of Things (IoT) and GoogleInternet of Things (IoT) and Google
Internet of Things (IoT) and Google
 
Machine Intelligence Applications for IoT Slam Dec 1st 2016
Machine Intelligence Applications for IoT Slam Dec 1st 2016Machine Intelligence Applications for IoT Slam Dec 1st 2016
Machine Intelligence Applications for IoT Slam Dec 1st 2016
 
Seminar
SeminarSeminar
Seminar
 
Watson Internet of Things Hexamite
Watson Internet of Things HexamiteWatson Internet of Things Hexamite
Watson Internet of Things Hexamite
 
Digital archives
Digital archivesDigital archives
Digital archives
 
Why Learn NLP or go on an NLP Training : Webinair
 Why Learn NLP or go on an NLP Training : Webinair Why Learn NLP or go on an NLP Training : Webinair
Why Learn NLP or go on an NLP Training : Webinair
 
SIRI: Future of Search
SIRI: Future of SearchSIRI: Future of Search
SIRI: Future of Search
 

Similar a Issues, Challenges and Perspectives of Digitization: the NLP Experience

publishing production
publishing productionpublishing production
publishing productionEssam Obaid
 
From Project to Program: Building Sustainable Digital Collections
From Project to Program: Building Sustainable Digital CollectionsFrom Project to Program: Building Sustainable Digital Collections
From Project to Program: Building Sustainable Digital Collectionsegore
 
Presentation Australia
Presentation AustraliaPresentation Australia
Presentation AustraliaGreg Lennon
 
Digitization of Physical Assets
Digitization of Physical AssetsDigitization of Physical Assets
Digitization of Physical AssetsDaniel Novak
 
5 technologies that shorten the document lifecycle & increase productivity
5 technologies that shorten the document lifecycle & increase productivity5 technologies that shorten the document lifecycle & increase productivity
5 technologies that shorten the document lifecycle & increase productivityNikec Solutions
 
Digital Excellence Program -- Success, Challenges, and The Future -- Business...
Digital Excellence Program -- Success, Challenges, and The Future -- Business...Digital Excellence Program -- Success, Challenges, and The Future -- Business...
Digital Excellence Program -- Success, Challenges, and The Future -- Business...robinphua
 
Dlspowerpoint
DlspowerpointDlspowerpoint
Dlspowerpointlhumes7
 
Preparation, Proceed and Review of preservation of Digital Library
Preparation, Proceed and Review of preservation of Digital Library Preparation, Proceed and Review of preservation of Digital Library
Preparation, Proceed and Review of preservation of Digital Library Asheesh Kamal
 
Next Steps for Highlander Center Archives by ITRL student Susan Williams
Next Steps for Highlander Center Archives by ITRL student Susan WilliamsNext Steps for Highlander Center Archives by ITRL student Susan Williams
Next Steps for Highlander Center Archives by ITRL student Susan Williamscmitch41
 
NeoLibre for the Latvian Society of the Blind
NeoLibre for the Latvian Society of the BlindNeoLibre for the Latvian Society of the Blind
NeoLibre for the Latvian Society of the BlindNeoLibre
 
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...Effectively Capturing Paper and Digital Documents in your Existing Applicatio...
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...J. Kevin Parker, CIP
 
digital preservation infrastructure: providing new of opportunities for prese...
digital preservation infrastructure: providing new of opportunities for prese...digital preservation infrastructure: providing new of opportunities for prese...
digital preservation infrastructure: providing new of opportunities for prese...FIAT/IFTA
 
AMIA Presentation 2013 -- Richmond, VA
AMIA Presentation 2013 -- Richmond, VAAMIA Presentation 2013 -- Richmond, VA
AMIA Presentation 2013 -- Richmond, VAmiwayokoyama
 
Anil Patel - Do You Feel Technology Is a Source of Frustration or Creativity...
Anil Patel -  Do You Feel Technology Is a Source of Frustration or Creativity...Anil Patel -  Do You Feel Technology Is a Source of Frustration or Creativity...
Anil Patel - Do You Feel Technology Is a Source of Frustration or Creativity...CanadaHelps / MyCharityConnects
 
National Digital Library and LLD
National Digital Library and LLDNational Digital Library and LLD
National Digital Library and LLDHansung University
 

Similar a Issues, Challenges and Perspectives of Digitization: the NLP Experience (20)

publishing production
publishing productionpublishing production
publishing production
 
From Project to Program: Building Sustainable Digital Collections
From Project to Program: Building Sustainable Digital CollectionsFrom Project to Program: Building Sustainable Digital Collections
From Project to Program: Building Sustainable Digital Collections
 
Namande
NamandeNamande
Namande
 
Namande
NamandeNamande
Namande
 
Hamooya
HamooyaHamooya
Hamooya
 
Presentation Australia
Presentation AustraliaPresentation Australia
Presentation Australia
 
Digitization of Physical Assets
Digitization of Physical AssetsDigitization of Physical Assets
Digitization of Physical Assets
 
5 technologies that shorten the document lifecycle & increase productivity
5 technologies that shorten the document lifecycle & increase productivity5 technologies that shorten the document lifecycle & increase productivity
5 technologies that shorten the document lifecycle & increase productivity
 
Digital Excellence Program -- Success, Challenges, and The Future -- Business...
Digital Excellence Program -- Success, Challenges, and The Future -- Business...Digital Excellence Program -- Success, Challenges, and The Future -- Business...
Digital Excellence Program -- Success, Challenges, and The Future -- Business...
 
Dlspowerpoint
DlspowerpointDlspowerpoint
Dlspowerpoint
 
Preparation, Proceed and Review of preservation of Digital Library
Preparation, Proceed and Review of preservation of Digital Library Preparation, Proceed and Review of preservation of Digital Library
Preparation, Proceed and Review of preservation of Digital Library
 
Electronic Envelope - 2009 Document Strategy Forum
Electronic Envelope - 2009 Document Strategy ForumElectronic Envelope - 2009 Document Strategy Forum
Electronic Envelope - 2009 Document Strategy Forum
 
Next Steps for Highlander Center Archives by ITRL student Susan Williams
Next Steps for Highlander Center Archives by ITRL student Susan WilliamsNext Steps for Highlander Center Archives by ITRL student Susan Williams
Next Steps for Highlander Center Archives by ITRL student Susan Williams
 
NeoLibre for the Latvian Society of the Blind
NeoLibre for the Latvian Society of the BlindNeoLibre for the Latvian Society of the Blind
NeoLibre for the Latvian Society of the Blind
 
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...Effectively Capturing Paper and Digital Documents in your Existing Applicatio...
Effectively Capturing Paper and Digital Documents in your Existing Applicatio...
 
digital preservation infrastructure: providing new of opportunities for prese...
digital preservation infrastructure: providing new of opportunities for prese...digital preservation infrastructure: providing new of opportunities for prese...
digital preservation infrastructure: providing new of opportunities for prese...
 
Recordsdotgo
RecordsdotgoRecordsdotgo
Recordsdotgo
 
AMIA Presentation 2013 -- Richmond, VA
AMIA Presentation 2013 -- Richmond, VAAMIA Presentation 2013 -- Richmond, VA
AMIA Presentation 2013 -- Richmond, VA
 
Anil Patel - Do You Feel Technology Is a Source of Frustration or Creativity...
Anil Patel -  Do You Feel Technology Is a Source of Frustration or Creativity...Anil Patel -  Do You Feel Technology Is a Source of Frustration or Creativity...
Anil Patel - Do You Feel Technology Is a Source of Frustration or Creativity...
 
National Digital Library and LLD
National Digital Library and LLDNational Digital Library and LLD
National Digital Library and LLD
 

Último

microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Shubhangi Sonawane
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfChris Hunter
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 

Último (20)

microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 

Issues, Challenges and Perspectives of Digitization: the NLP Experience

  • 1. Issues, Challenges and perspectives of digitization: the NLP experience A Presentation for 12th SEAPAVAA Conference “Digital debates on archives, museums and libraries” Meeting Rooms 5-6, SMX Convention Center, SM Mall of Asia Manila, Philippines Sep 17, 2009 By Edgardo Quiros Chief, IT Division National Library of the Philippines
  • 2. Background Digitization of Filipiniana books under copyright registration Digitization of Copyright registration documents Philippine eLibrary Now a program covering Filipiniana materials
  • 4. Phase 1: Outsourced  25 million pages target was achieved in less than 1 year in 2004  By 2007, re-work is still ongoing to correct unreadable pages. It was stopped because it will take longer to perform quality control compared to re-scanning by our staff.  Some originals sustained damages  Output file size is large
  • 5. Phase 2: In-house 1 million pages target was achieved in 1 year in 2007 (Equivalent to 3-year productivity of another outsourced project of similar staffing) Non-destructive techniques were used to prevent damages Output file size is smaller Quality is better than phase 1
  • 6. Our Gains from In-house Digitization Digitized document as output (in outsourcing this is the only output) Ability to digitized materials with limited budget including materials with few pages. Outsourcing requires a minimum volume of materials. Better quality of digitized
  • 7. Our Gains from In-house Digitization  Minimal damage/loss, if none at all, to delicate materials  Procured equipment, computer hardware and software can be used to digitize more materials (new materials are added each year)  Procured equipment, computer hardware and software is useful in post-digitization services such as information repackaging and delivery
  • 8. Comparison Phase 1 PDF file size Phase 1 PDF file size of a page of a page 218 KB 41 KB *see sample page *see sample page
  • 11. Our Gains from In-house Digitization  Staff gained skills, experience and knowledge  Achieved faster delivery of digitized materials due to very minimal time spent in training, selection, organization, and quality control  Reports, guides, and papers from the digitization activity now serves as reference materials  Developed appropriate workflows for each material
  • 12. eLibrary URL Visit us at: www.elib.gov.ph
  • 13. Thank you and Mabuhay!