SlideShare a Scribd company logo
1 of 41
Emily
Pfotenhauer
June 24, 2014
BEST PRACTICES FOR MANAGING
BORN DIGITAL CONTENT
 Emily Pfotenhauer
Recollection Wisconsin Program Manager, WiLS
emily@wils.org
608-616-9756
 Slides and links:
http://recollectionwisconsin.org/borndigital
BEST PRACTICES FOR MANAGING
BORN DIGITAL CONTENT
http://oclc.org/research/activities/bor
al.html
The mission of the DPOE program of the Library of
Congress is to encourage individuals and
organizations to actively preserve their digital
content, building on a collaborative network of
instructors, contributors, and institutional partners.
http://www.digitalpreservation.gov/education/
DIGITAL PRESERVATION
OUTREACH AND EDUCATION
identify
select
store
protect
manage
provide
DPOE Modules for Managing
Digital Content Over Time
WHAT IS DIGITAL CONTENT?
 Digital content is any material that is published or
distributed in a digital form, including text, data, sound
recordings, photographs and images, motion pictures,
and software.
 Digital materials created from analog sources
 Born-digital materials
 Digital materials you currently have or create – or expect
to have – that you want to preserve.
 Born-digital resources are items created and managed in
digital form.
 Digital photographs
 Digital documents
 Digital manuscripts
 Harvested web content
 Electronic records
 Data sets
 Digital art
 Digital media publications
 Defining “Born Digital,” Ricky Erway, OCLC Research
http://oclc.org/content/dam/research/activities/hiddencollectio
ns/borndigital.pdf
DEFINING “BORN DIGITAL”
 Everyone is
 creating digital content
 distributing digital content
 using digital content
 And we are responsible for managing digital content
DIGITAL REALITY IN 2014
http://digitalbevaring.dk
WHAT’S THE PROBLEM?
 Increasing amounts of digital assets are arriving on our
doorstep
 The digital assets arrive in all formats and on all formats
 Time sensitive -- the longer we wait or the longer our
donors wait, the increased chance that something will be
unreadable
Who takes the lead?
What can I do?
Where do I start?
Too technical
(I don’t understand...)
Too daunting
(I don’t have time...)
WHAT ARE THE CHALLENGES?
http://digitalbevaring.dk
Digital preservation combines policies, strategies and
actions to ensure access to reformatted and born digital
content regardless of the challenges of media failure and
technological change. The goal of digital preservation is
the accurate rendering of authenticated content over time.
Working group on Defining Digital Preservation
ALA Annual Conference, 6/24/2007
http://www.ala.org/alcts/resources/preserv/defdigpres0408
DIGITAL PRESERVATION
Digital materials on
physical media (CDs,
flash drives, floppy
disks, etc.) have been
stored along with
other collection
materials without
having been copied,
preserved, or made
accessible.
A TYPICAL SCENARIO
WHAT COULD POSSIBLY GO WRONG?
 Do no harm
 Don’t do anything that
prevents future action and use
 Take action
 Document what you do
FIRST STEPS:
FOUR ESSENTIAL PRINCIPLES
Identifying content is a first step to planning for current
and future preservation needs
Ask: what content
do I have,
will I have,
might I have,
must I have?
An inventory is the best way to identify
what content you have now –
and raise awareness in your institution.
DPOE MODULE 1: IDENTIFY
http://digitalbevaring.dk
 Good preservation decisions are based on an
understanding of the possible content to be preserved
 Not all digital content can or should be preserved
 Preservation requires an explicit commitment of
resources
WHY DO WE IDENTIFY CONTENT?
1. Identify and locate existing holdings.
2. Count and describe digital media within each
collection.
3. Remove media from collection (retain order with
photographs or separator sheets).
4. Assign inventory number to each physical piece.
5. Record anything that is known about the hardware,
operating systems, and software used to create the
files.
6. Calculate total amount of data (estimate).
7. Re-house physical media in suitable storage.
FIRST STEPS: CREATE AN INVENTORY
 Medium (6 CDs, 1 hard drive)
 Format (pdfs, docs)
 File Size (be consistent - MB, GB or TB)
 Identifying information found on labels such as creator,
title, description of contents and dates
 Expected future growth, if any
COUNT AND DESCRIBE
Prioritize for further processing based on:
 Significance and use of overall collection
 Danger of loss of content (degradation) due to age
or type of media
 Uniqueness – not replicated elsewhere
 Quantity of digital content
DPOE MODULE 2: SELECT
 Cost: storage may be
cheap, management is
not…especially over
time
 Not all digital content
may be appropriate for
your organization to
preserve.
 Matching mission to
content
 Keeping delivery and
access manageable and
sustainable
WHY SELECT CONTENT TO PRESERVE?
Log jam on the St. Croix River, 1886
Wisconsin Historical Society WHi-2364
Ask yourself which digital content is
 most significant to your organization?
 most extensive?
 most requested/used?
 easiest?
 oldest?
 newest?
 mandated?
 at risk?
SETTING PRIORITIES
Postal workers sorting mail, 1955
Wisconsin Historical Society WHi-36392
 Communication is key, particularly when content
comes from external creators
 Keep content creators in the conversation
Arrange a convenient time for them to talk about
your preservation plans
Identify list of materials to review with them
Document the results and send them a copy
 Sample policy: Minds@UW
http://uwdcc.library.wisc.edu/minds/faq.shtml
INCLUDE CONTENT CREATORS
THEN WHAT?
Steps for transferring born-digital content from media you can
read in-house:
1. Use a “clean” computer.
2. Use a write blocker.
3. Insert source media.
4. Create a disk directory.
5. Copy files from media to the directory.
6. Generate a copy of the directory.
7. Generate and record a checksum.
8. Create a readme file.
9. Copy the directory to trustworthy archival storage.
10. Return the original physical media to storage.
11. Create or update any associated descriptive tool(s).
 Dedicated computer
 Regularly scanned with up-
to-date antivirus software
 Non-networked
STEP 1: CLEAN WORKSTATION
UW-Madison Archives
 Prevents the computer
from altering file content
and metadata (i.e. date,
creator)
 Do not open files until
after transfer
STEP 2: WRITE BLOCKER
https://www.flickr.com/photos/joncrel/6285946610/
 Do not attempt to open any
files.
 Examine media for cracks,
breaks, etc.
 Remove any sticky notes or
anything else that could
become loose.
STEP 3: INSERT SOURCE MEDIA
bitcurator.net
 Create a directory on the clean machine for the
current project.
 Within the directory, create sub-directories:
 Master Folder (to hold the master copy of the file)
 Working Folder (to hold working copies of the master
copy)
 Documentation Folder (to hold metadata and other
information associated with the project)
STEP 4: CREATE A DISK DIRECTORY
 Copy files from the source media to the master folder
 Copy files individually or in groups
-OR-
 Create a disk image
 Disk image = single file containing an authentic copy of a
disk’s contents, retaining original metadata and file
system structure
 After transfer from source media, make a second working
copy – ok to open these files
STEP 5: COPY FILES
 Generate a copy of the disk directory information
 File names
 File sizes
 File extensions
 Dates
 Store a digital copy in the project documentation folder
 Print a copy to keep with the physical collection
STEP 6: COPY THE DISK DIRECTORY INFO
 Checksums (aka “hash sums”) are created by programs
running an algorithm against the contents of a file.
(There are many free utilities that will perform this
function for you.)
 The resulting checksum
is a short sequence of letters
and/or numbers that uniquely
identifies that file.
(think “electronic fingerprint”)
STEP 7: RUN CHECKSUMS
Unix cksum utility
 Checksums help maintain the INTEGRITY of your
collections because they will tell you if things change
over time.
 If two files are exactly the same, the checksums of those
files will also be exactly the same (generally speaking).
 If a file becomes corrupted, degraded or is changed in
some way, the next time you run the utility on it, the
checksum will change.
WHY IS THIS A GOOD THING?
 Things that will NOT affect checksums
 Moving items from one place to another
 Changing the file name
 Run on the master files when a collection is completed
 Set up a schedule to run “verify checks” periodically
CHECKSUMS: THINGS TO REMEMBER
 Leave yourself (and others) some breadcrumbs
 Brief description of contents, any retention
schedule, naming conventions, steps taken in
transfer
 Store the file in the project documentation folder
and store a printout of the readme file with the
physical collection materials
STEP 8: CREATE A README FILE
 Copy the directories containing the master files and
project documentation to trustworthy archival storage
 Store a second copy of the files in a different physical
location
 May delete working files at this time
STEP 9 : TRANSFER TO SECURE LOCATION
STEP 10: RETURN ORIGINAL TO STORAGE
 Return original source media to appropriate storage
- OR –
 Destroy the originals using a secure method
 Inventory as well as any
finding aid, collection-level
record and/or accession
record
 Include steps taken during
transfer and the current
location(s) of the files
STEP 11: CREATE OR UPDATE ANY
ASSOCIATED DESCRIPTIVE TOOL(S)
http://digitalbevaring.dk
 Do no harm
 Don’t do anything that
prevents future action and use
 Take action
 Document what you do
REVIEW:
FOUR ESSENTIAL PRINCIPLES
 The Signal: Library of Congress digital preservation blog
http://blogs.loc.gov/digitalpreservation/
 Minnesota State Archives – Electronic Records
Management
Resourceshttp://www.mnhs.org/preserve/records/electr
onicrecords.php
 Practical E-Records blog
http://e-records.chrisprom.com
 Digital Curation Exchange
http://digitalcurationexchange.org
 Digital Curation Bibliography
http://digital-scholarship.org/dcbw/dcb.htm
FURTHER RESOURCES
 Emily Pfotenhauer
Recollection Wisconsin Program Manager, WiLS
emily@wils.org
608-616-9756
 Slides and links:
http://recollectionwisconsin.org/borndigital
THANK YOU!

More Related Content

Similar to Best Practices for Managing Born Digital Content

Saa Session 502 Born Digital Archives in Collecting Repositories
Saa Session 502 Born Digital Archives in Collecting RepositoriesSaa Session 502 Born Digital Archives in Collecting Repositories
Saa Session 502 Born Digital Archives in Collecting RepositoriesAIMS_Archives
 
Keep Calm and Curate
Keep Calm and CurateKeep Calm and Curate
Keep Calm and CurateGarethKnight
 
The state of global research data initiatives: observations from a life on th...
The state of global research data initiatives: observations from a life on th...The state of global research data initiatives: observations from a life on th...
The state of global research data initiatives: observations from a life on th...Projeto RCAAP
 
Introduction to digital curation
Introduction to digital curationIntroduction to digital curation
Introduction to digital curationGarethKnight
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectRecollection Wisconsin
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectRecollection Wisconsin
 
Research Data Management Fundamentals for MSU Engineering Students
Research Data Management Fundamentals for MSU Engineering StudentsResearch Data Management Fundamentals for MSU Engineering Students
Research Data Management Fundamentals for MSU Engineering StudentsAaron Collie
 
Data management for TA's
Data management for TA'sData management for TA's
Data management for TA'saaroncollie
 
Research Data Management: An Introduction to the Basics
Research Data Management: An Introduction to the BasicsResearch Data Management: An Introduction to the Basics
Research Data Management: An Introduction to the BasicsOpenExeter
 
Data Management for Undergraduate Researchers
Data Management for Undergraduate ResearchersData Management for Undergraduate Researchers
Data Management for Undergraduate ResearchersRebekah Cummings
 
Starting a Digital Preservation Program
Starting a Digital Preservation ProgramStarting a Digital Preservation Program
Starting a Digital Preservation ProgramSarah Shreeves
 
Digital preservation and curation of information.presentation
Digital preservation and curation of information.presentationDigital preservation and curation of information.presentation
Digital preservation and curation of information.presentationPrince Sterling
 
Getting to grips with Research Data Management
Getting to grips with Research Data ManagementGetting to grips with Research Data Management
Getting to grips with Research Data ManagementIzzyChad
 
Setting a Course for Success: Getting Started with Digital Preservation in Yo...
Setting a Course for Success: Getting Started with Digital Preservation in Yo...Setting a Course for Success: Getting Started with Digital Preservation in Yo...
Setting a Course for Success: Getting Started with Digital Preservation in Yo...WiLS
 

Similar to Best Practices for Managing Born Digital Content (20)

Saa Session 502 Born Digital Archives in Collecting Repositories
Saa Session 502 Born Digital Archives in Collecting RepositoriesSaa Session 502 Born Digital Archives in Collecting Repositories
Saa Session 502 Born Digital Archives in Collecting Repositories
 
Keep Calm and Curate
Keep Calm and CurateKeep Calm and Curate
Keep Calm and Curate
 
Managing your research data
Managing your research dataManaging your research data
Managing your research data
 
The state of global research data initiatives: observations from a life on th...
The state of global research data initiatives: observations from a life on th...The state of global research data initiatives: observations from a life on th...
The state of global research data initiatives: observations from a life on th...
 
Introduction to digital curation
Introduction to digital curationIntroduction to digital curation
Introduction to digital curation
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and Select
 
Managing Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and SelectManaging Digital Content Over Time: Identify and Select
Managing Digital Content Over Time: Identify and Select
 
An Introduction to Digital Preservation
An Introduction to Digital PreservationAn Introduction to Digital Preservation
An Introduction to Digital Preservation
 
Research Data Management Fundamentals for MSU Engineering Students
Research Data Management Fundamentals for MSU Engineering StudentsResearch Data Management Fundamentals for MSU Engineering Students
Research Data Management Fundamentals for MSU Engineering Students
 
Introduction to RDM for trainee physicians
Introduction to RDM for trainee physiciansIntroduction to RDM for trainee physicians
Introduction to RDM for trainee physicians
 
Digital Preservation with Archivematica
Digital Preservation with ArchivematicaDigital Preservation with Archivematica
Digital Preservation with Archivematica
 
Data management for TA's
Data management for TA'sData management for TA's
Data management for TA's
 
Research Data Management: An Introduction to the Basics
Research Data Management: An Introduction to the BasicsResearch Data Management: An Introduction to the Basics
Research Data Management: An Introduction to the Basics
 
Data Management for Undergraduate Researchers
Data Management for Undergraduate ResearchersData Management for Undergraduate Researchers
Data Management for Undergraduate Researchers
 
SHAREmodule2
SHAREmodule2SHAREmodule2
SHAREmodule2
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
 
Starting a Digital Preservation Program
Starting a Digital Preservation ProgramStarting a Digital Preservation Program
Starting a Digital Preservation Program
 
Digital preservation and curation of information.presentation
Digital preservation and curation of information.presentationDigital preservation and curation of information.presentation
Digital preservation and curation of information.presentation
 
Getting to grips with Research Data Management
Getting to grips with Research Data ManagementGetting to grips with Research Data Management
Getting to grips with Research Data Management
 
Setting a Course for Success: Getting Started with Digital Preservation in Yo...
Setting a Course for Success: Getting Started with Digital Preservation in Yo...Setting a Course for Success: Getting Started with Digital Preservation in Yo...
Setting a Course for Success: Getting Started with Digital Preservation in Yo...
 

More from Recollection Wisconsin

Building the Community: A Digital Preservation Symposium
Building the Community: A Digital Preservation Symposium Building the Community: A Digital Preservation Symposium
Building the Community: A Digital Preservation Symposium Recollection Wisconsin
 
Curating Community Digital Collections: Collaborating to Build Digital Capacity
Curating Community Digital Collections: Collaborating to Build Digital CapacityCurating Community Digital Collections: Collaborating to Build Digital Capacity
Curating Community Digital Collections: Collaborating to Build Digital CapacityRecollection Wisconsin
 
DPLA and Wisconsin: What's new, what's next
DPLA and Wisconsin: What's new, what's nextDPLA and Wisconsin: What's new, what's next
DPLA and Wisconsin: What's new, what's nextRecollection Wisconsin
 
Online resources for researching historic properties and interiors
Online resources for researching historic properties and interiorsOnline resources for researching historic properties and interiors
Online resources for researching historic properties and interiorsRecollection Wisconsin
 
From Local Collection to Global Community: Recollection Wisconsin and the Di...
 From Local Collection to Global Community: Recollection Wisconsin and the Di... From Local Collection to Global Community: Recollection Wisconsin and the Di...
From Local Collection to Global Community: Recollection Wisconsin and the Di...Recollection Wisconsin
 
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)Recollection Wisconsin
 
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)Recollection Wisconsin
 
Reading historical photographs with Recollection Wisconsin
Reading historical photographs with Recollection WisconsinReading historical photographs with Recollection Wisconsin
Reading historical photographs with Recollection WisconsinRecollection Wisconsin
 
Eastern Shores Library System digitization project
Eastern Shores Library System digitization projectEastern Shores Library System digitization project
Eastern Shores Library System digitization projectRecollection Wisconsin
 
Exploring Cultural History Online -- Winding Rivers Library System Kickoff Event
Exploring Cultural History Online -- Winding Rivers Library System Kickoff EventExploring Cultural History Online -- Winding Rivers Library System Kickoff Event
Exploring Cultural History Online -- Winding Rivers Library System Kickoff EventRecollection Wisconsin
 
Building Digital Collections: Managing and Sharing
Building Digital Collections: Managing and SharingBuilding Digital Collections: Managing and Sharing
Building Digital Collections: Managing and SharingRecollection Wisconsin
 
Building Digital Collections: Planning and Creating
Building Digital Collections: Planning and CreatingBuilding Digital Collections: Planning and Creating
Building Digital Collections: Planning and CreatingRecollection Wisconsin
 
Recollection Wisconsin presentation for WAPL 2013
Recollection Wisconsin presentation for WAPL 2013Recollection Wisconsin presentation for WAPL 2013
Recollection Wisconsin presentation for WAPL 2013Recollection Wisconsin
 
Recollection Wisconsin presentation for WEMTA 2013
Recollection Wisconsin presentation for WEMTA 2013Recollection Wisconsin presentation for WEMTA 2013
Recollection Wisconsin presentation for WEMTA 2013Recollection Wisconsin
 
Building a Shared Digital Collection: A Case Study
Building a Shared Digital Collection: A Case StudyBuilding a Shared Digital Collection: A Case Study
Building a Shared Digital Collection: A Case StudyRecollection Wisconsin
 

More from Recollection Wisconsin (19)

Building the Community: A Digital Preservation Symposium
Building the Community: A Digital Preservation Symposium Building the Community: A Digital Preservation Symposium
Building the Community: A Digital Preservation Symposium
 
Curating Community Digital Collections: Collaborating to Build Digital Capacity
Curating Community Digital Collections: Collaborating to Build Digital CapacityCurating Community Digital Collections: Collaborating to Build Digital Capacity
Curating Community Digital Collections: Collaborating to Build Digital Capacity
 
Digitization and public libraries
Digitization and public librariesDigitization and public libraries
Digitization and public libraries
 
DPLA and Wisconsin: What's new, what's next
DPLA and Wisconsin: What's new, what's nextDPLA and Wisconsin: What's new, what's next
DPLA and Wisconsin: What's new, what's next
 
Online resources for researching historic properties and interiors
Online resources for researching historic properties and interiorsOnline resources for researching historic properties and interiors
Online resources for researching historic properties and interiors
 
From Local Collection to Global Community: Recollection Wisconsin and the Di...
 From Local Collection to Global Community: Recollection Wisconsin and the Di... From Local Collection to Global Community: Recollection Wisconsin and the Di...
From Local Collection to Global Community: Recollection Wisconsin and the Di...
 
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAPL Conference)
 
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)
DPLA + WI: Building a DPLA Service Hub in Wisconsin (WAAL Conference)
 
Reading historical photographs with Recollection Wisconsin
Reading historical photographs with Recollection WisconsinReading historical photographs with Recollection Wisconsin
Reading historical photographs with Recollection Wisconsin
 
Eastern Shores Library System digitization project
Eastern Shores Library System digitization projectEastern Shores Library System digitization project
Eastern Shores Library System digitization project
 
Bringing Local History Online
Bringing Local History OnlineBringing Local History Online
Bringing Local History Online
 
Exploring Cultural History Online -- Winding Rivers Library System Kickoff Event
Exploring Cultural History Online -- Winding Rivers Library System Kickoff EventExploring Cultural History Online -- Winding Rivers Library System Kickoff Event
Exploring Cultural History Online -- Winding Rivers Library System Kickoff Event
 
Planning a Successful Digital Project
Planning a Successful Digital ProjectPlanning a Successful Digital Project
Planning a Successful Digital Project
 
Building Digital Collections: Managing and Sharing
Building Digital Collections: Managing and SharingBuilding Digital Collections: Managing and Sharing
Building Digital Collections: Managing and Sharing
 
Building Digital Collections: Planning and Creating
Building Digital Collections: Planning and CreatingBuilding Digital Collections: Planning and Creating
Building Digital Collections: Planning and Creating
 
Recollection Wisconsin presentation for WAPL 2013
Recollection Wisconsin presentation for WAPL 2013Recollection Wisconsin presentation for WAPL 2013
Recollection Wisconsin presentation for WAPL 2013
 
Recollection Wisconsin presentation for WEMTA 2013
Recollection Wisconsin presentation for WEMTA 2013Recollection Wisconsin presentation for WEMTA 2013
Recollection Wisconsin presentation for WEMTA 2013
 
Building a Shared Digital Collection: A Case Study
Building a Shared Digital Collection: A Case StudyBuilding a Shared Digital Collection: A Case Study
Building a Shared Digital Collection: A Case Study
 
Basics of Digital Projects
Basics of Digital ProjectsBasics of Digital Projects
Basics of Digital Projects
 

Recently uploaded

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 

Recently uploaded (20)

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 

Best Practices for Managing Born Digital Content

  • 1. Emily Pfotenhauer June 24, 2014 BEST PRACTICES FOR MANAGING BORN DIGITAL CONTENT
  • 2.  Emily Pfotenhauer Recollection Wisconsin Program Manager, WiLS emily@wils.org 608-616-9756  Slides and links: http://recollectionwisconsin.org/borndigital BEST PRACTICES FOR MANAGING BORN DIGITAL CONTENT
  • 4. The mission of the DPOE program of the Library of Congress is to encourage individuals and organizations to actively preserve their digital content, building on a collaborative network of instructors, contributors, and institutional partners. http://www.digitalpreservation.gov/education/ DIGITAL PRESERVATION OUTREACH AND EDUCATION
  • 6. WHAT IS DIGITAL CONTENT?  Digital content is any material that is published or distributed in a digital form, including text, data, sound recordings, photographs and images, motion pictures, and software.  Digital materials created from analog sources  Born-digital materials  Digital materials you currently have or create – or expect to have – that you want to preserve.
  • 7.  Born-digital resources are items created and managed in digital form.  Digital photographs  Digital documents  Digital manuscripts  Harvested web content  Electronic records  Data sets  Digital art  Digital media publications  Defining “Born Digital,” Ricky Erway, OCLC Research http://oclc.org/content/dam/research/activities/hiddencollectio ns/borndigital.pdf DEFINING “BORN DIGITAL”
  • 8.  Everyone is  creating digital content  distributing digital content  using digital content  And we are responsible for managing digital content DIGITAL REALITY IN 2014 http://digitalbevaring.dk
  • 9. WHAT’S THE PROBLEM?  Increasing amounts of digital assets are arriving on our doorstep  The digital assets arrive in all formats and on all formats  Time sensitive -- the longer we wait or the longer our donors wait, the increased chance that something will be unreadable
  • 10. Who takes the lead? What can I do? Where do I start? Too technical (I don’t understand...) Too daunting (I don’t have time...) WHAT ARE THE CHALLENGES? http://digitalbevaring.dk
  • 11. Digital preservation combines policies, strategies and actions to ensure access to reformatted and born digital content regardless of the challenges of media failure and technological change. The goal of digital preservation is the accurate rendering of authenticated content over time. Working group on Defining Digital Preservation ALA Annual Conference, 6/24/2007 http://www.ala.org/alcts/resources/preserv/defdigpres0408 DIGITAL PRESERVATION
  • 12. Digital materials on physical media (CDs, flash drives, floppy disks, etc.) have been stored along with other collection materials without having been copied, preserved, or made accessible. A TYPICAL SCENARIO
  • 13. WHAT COULD POSSIBLY GO WRONG?
  • 14.  Do no harm  Don’t do anything that prevents future action and use  Take action  Document what you do FIRST STEPS: FOUR ESSENTIAL PRINCIPLES
  • 15. Identifying content is a first step to planning for current and future preservation needs Ask: what content do I have, will I have, might I have, must I have? An inventory is the best way to identify what content you have now – and raise awareness in your institution. DPOE MODULE 1: IDENTIFY http://digitalbevaring.dk
  • 16.  Good preservation decisions are based on an understanding of the possible content to be preserved  Not all digital content can or should be preserved  Preservation requires an explicit commitment of resources WHY DO WE IDENTIFY CONTENT?
  • 17. 1. Identify and locate existing holdings. 2. Count and describe digital media within each collection. 3. Remove media from collection (retain order with photographs or separator sheets). 4. Assign inventory number to each physical piece. 5. Record anything that is known about the hardware, operating systems, and software used to create the files. 6. Calculate total amount of data (estimate). 7. Re-house physical media in suitable storage. FIRST STEPS: CREATE AN INVENTORY
  • 18.  Medium (6 CDs, 1 hard drive)  Format (pdfs, docs)  File Size (be consistent - MB, GB or TB)  Identifying information found on labels such as creator, title, description of contents and dates  Expected future growth, if any COUNT AND DESCRIBE
  • 19. Prioritize for further processing based on:  Significance and use of overall collection  Danger of loss of content (degradation) due to age or type of media  Uniqueness – not replicated elsewhere  Quantity of digital content DPOE MODULE 2: SELECT
  • 20.  Cost: storage may be cheap, management is not…especially over time  Not all digital content may be appropriate for your organization to preserve.  Matching mission to content  Keeping delivery and access manageable and sustainable WHY SELECT CONTENT TO PRESERVE? Log jam on the St. Croix River, 1886 Wisconsin Historical Society WHi-2364
  • 21. Ask yourself which digital content is  most significant to your organization?  most extensive?  most requested/used?  easiest?  oldest?  newest?  mandated?  at risk? SETTING PRIORITIES Postal workers sorting mail, 1955 Wisconsin Historical Society WHi-36392
  • 22.  Communication is key, particularly when content comes from external creators  Keep content creators in the conversation Arrange a convenient time for them to talk about your preservation plans Identify list of materials to review with them Document the results and send them a copy  Sample policy: Minds@UW http://uwdcc.library.wisc.edu/minds/faq.shtml INCLUDE CONTENT CREATORS
  • 23. THEN WHAT? Steps for transferring born-digital content from media you can read in-house: 1. Use a “clean” computer. 2. Use a write blocker. 3. Insert source media. 4. Create a disk directory. 5. Copy files from media to the directory. 6. Generate a copy of the directory. 7. Generate and record a checksum. 8. Create a readme file. 9. Copy the directory to trustworthy archival storage. 10. Return the original physical media to storage. 11. Create or update any associated descriptive tool(s).
  • 24.  Dedicated computer  Regularly scanned with up- to-date antivirus software  Non-networked STEP 1: CLEAN WORKSTATION UW-Madison Archives
  • 25.  Prevents the computer from altering file content and metadata (i.e. date, creator)  Do not open files until after transfer STEP 2: WRITE BLOCKER https://www.flickr.com/photos/joncrel/6285946610/
  • 26.  Do not attempt to open any files.  Examine media for cracks, breaks, etc.  Remove any sticky notes or anything else that could become loose. STEP 3: INSERT SOURCE MEDIA bitcurator.net
  • 27.  Create a directory on the clean machine for the current project.  Within the directory, create sub-directories:  Master Folder (to hold the master copy of the file)  Working Folder (to hold working copies of the master copy)  Documentation Folder (to hold metadata and other information associated with the project) STEP 4: CREATE A DISK DIRECTORY
  • 28.
  • 29.  Copy files from the source media to the master folder  Copy files individually or in groups -OR-  Create a disk image  Disk image = single file containing an authentic copy of a disk’s contents, retaining original metadata and file system structure  After transfer from source media, make a second working copy – ok to open these files STEP 5: COPY FILES
  • 30.  Generate a copy of the disk directory information  File names  File sizes  File extensions  Dates  Store a digital copy in the project documentation folder  Print a copy to keep with the physical collection STEP 6: COPY THE DISK DIRECTORY INFO
  • 31.  Checksums (aka “hash sums”) are created by programs running an algorithm against the contents of a file. (There are many free utilities that will perform this function for you.)  The resulting checksum is a short sequence of letters and/or numbers that uniquely identifies that file. (think “electronic fingerprint”) STEP 7: RUN CHECKSUMS Unix cksum utility
  • 32.  Checksums help maintain the INTEGRITY of your collections because they will tell you if things change over time.  If two files are exactly the same, the checksums of those files will also be exactly the same (generally speaking).  If a file becomes corrupted, degraded or is changed in some way, the next time you run the utility on it, the checksum will change. WHY IS THIS A GOOD THING?
  • 33.  Things that will NOT affect checksums  Moving items from one place to another  Changing the file name  Run on the master files when a collection is completed  Set up a schedule to run “verify checks” periodically CHECKSUMS: THINGS TO REMEMBER
  • 34.  Leave yourself (and others) some breadcrumbs  Brief description of contents, any retention schedule, naming conventions, steps taken in transfer  Store the file in the project documentation folder and store a printout of the readme file with the physical collection materials STEP 8: CREATE A README FILE
  • 35.  Copy the directories containing the master files and project documentation to trustworthy archival storage  Store a second copy of the files in a different physical location  May delete working files at this time STEP 9 : TRANSFER TO SECURE LOCATION
  • 36. STEP 10: RETURN ORIGINAL TO STORAGE  Return original source media to appropriate storage - OR –  Destroy the originals using a secure method
  • 37.  Inventory as well as any finding aid, collection-level record and/or accession record  Include steps taken during transfer and the current location(s) of the files STEP 11: CREATE OR UPDATE ANY ASSOCIATED DESCRIPTIVE TOOL(S) http://digitalbevaring.dk
  • 38.  Do no harm  Don’t do anything that prevents future action and use  Take action  Document what you do REVIEW: FOUR ESSENTIAL PRINCIPLES
  • 39.
  • 40.  The Signal: Library of Congress digital preservation blog http://blogs.loc.gov/digitalpreservation/  Minnesota State Archives – Electronic Records Management Resourceshttp://www.mnhs.org/preserve/records/electr onicrecords.php  Practical E-Records blog http://e-records.chrisprom.com  Digital Curation Exchange http://digitalcurationexchange.org  Digital Curation Bibliography http://digital-scholarship.org/dcbw/dcb.htm FURTHER RESOURCES
  • 41.  Emily Pfotenhauer Recollection Wisconsin Program Manager, WiLS emily@wils.org 608-616-9756  Slides and links: http://recollectionwisconsin.org/borndigital THANK YOU!