Descripción del sistema de archivado web en la Biblioteca Nacional de España

1. Título de la presentación
NetarchiveSuite
at the BNE
Juan Carlos García Arratia – Chief of IT Development Service, NLS
Mar Pérez Morillo – Chief of Web Service, NLS
IIPC GA Paris 2014, 22nd May
1

2. Título de la presentación
Table of contents
1. Starting point
2. Non-print Legal Deposit regulation
3. Agreement with Red.es
4. Why NAS?
5. Installation of test environment
6. First test crawls
7. Specifications and needs
8. What we expect
2

3. Título de la presentación
1. Starting point
With Internet Archive (2009-2013):
o 8 domain crawls
o 2 selective crawls:
• General Elections 2011
• Humanities
o Total: ± 100 TB
Collection delivery (Red.es)
3

4. Título de la presentación
Allegations answered
• Ministery of Education and Culture
• Stakeholders (publishers and content
providers)
• Public information
Last step of the process
Enactment expected by the end of the year
4
2. Non-print Legal Deposit Regulation

5. Título de la presentación
Strong investment:
Network
Storage
Servers
5
3. Red.es

6. Título de la presentación
4. Why Netarchive Suite?
 Other tools considered
 Whole lifecycle covered
 First workshop on NAS at Vienna
 BnF, as a model:
o Legal deposit law
o Similar starting point with IA
o National domain
o Size of the French web
 Ability of sharing tools and experiences
 Community of users and developers (Denmark, Austria)
 Modularity
6

7. Título de la presentación
5. Installation of test environment
Summer 2013: pilot installation  6 servers
1st crawl: internal administrative network
Lack of documentation
Problems understanding configuration profiles
Need of strong network security
7

8. Título de la presentación
6. First test crawls
 Mining Historical Archive (Archivo Histórico Minero)
Death of Adolfo Suárez
 Death of Gabriel García Márquez
8
URL únicas Tamaño GB
ADOLFO SUAREZ 322.722 37,66
ADOLFO ESPECIALES 344.418 9,65
ADOLFO INTERNACIONAL 19.509 0,25
ADOLFO QA 32.326 1,86
TOTAL 718.975 49,42
URL únicas Tamaño GB
García Márquez 455.581 7,38

9. Título de la presentación
6.1 Archivo Historico Minero
www.archivohistoricominero.org
9

10. Título de la presentación 10
6.2. Death of Adolfo Suárez

11. Título de la presentación
6.3. Ongoing crawls
 Regional Governments proposals
 European Elections
11

12. Título de la presentación
http://bns08.bne.local/HarvestDefinition/Definitions-selective-harvests.jsp
12
NAS at the BNE

13. Título de la presentación
7. Specifications
and needs
13

14. Título de la presentación
7.1. National cooperation
 Designing a workflow in a collaborative
environment
 Legal deposit purposes
 Using administrative Network
 Need of common interface for proposals
14

15. Título de la presentación
7.2. Web content curators at the Library
 Internal and external curators
 Interface to share
 Easier to use for librarians
New reason to choose NAS…
15

16. Título de la presentación 16
BCWeb

17. Título de la presentación
8. What we expect
17
Better understanding of templates and
configuration
Dashboard for Quality Assurance:
o to show big figures to monitor crawl status
Modularity
o Fine tuning