LOC Novel High-Density Optical Data Storage

The Library of Congress, hereinafter referred to as the “Library” or “LOC”,” is exploring innovative preservation methods for its digital collections. The LOC is seeking to determine the feasibility of utilizing ultra-high density optical data storage designed for the long-term preservation of a subset of the Library’s digital collections. Currently, the Library manages over 1 billion unique objects of digital preservation data (~33 petabytes) via traditional storage methods. For longevity and reduced migration intervals, it may be reasonable for this portion of data to be permanently stored on a novel medium. The focus would be on a solution that exhibits high areal density, a long lifespan, reduced maintenance/migration cycles, is immutable, and displays a high level of durability. The Library aims to demonstrate the feasibility of an innovative optical data storage solution as a high-density, scalable, and durable medium for storing its preservation collection.

The Library wishes to examine the feasibility of this method on a small subset of its digital collections. To be successful, a variety of data formats—including video, audio, text, and images— must be encoded onto the media, errors must be detected/recorded, preservation techniques must be validated and select data must be recalled/read with high fidelity. This work will contribute to the boundary pushing field of high-density optical data storage while pushing the boundaries of access and preservation.

The desired outcomes of this requirement are as follows:

• The successful writing of 1TB of the Library’s digital data in various formats (video, audio, images, text) onto a robust high-density optical media designed to outlast legacy storage solutions at a higher areal density.
• The determination of the accuracy of the writing process by demonstrating early-stage error detection and ultimate 100% recovery of data.
• The documentation of successful processes, shortcomings, error rates, timelines, potential solutions to issues, risks, trends, and technological improvements throughout the period of performance as they pertain to the media of choice.
• Proof of concept for the potential indefinite storage approach of the Library’s data on a novel optical storage medium.
• The successful recall and reading of all Library-furnished digital files that have been encoded on the media of choice.
• The isolation of a subset of the data will be carefully curated and stored for the purposes of an educational and artistic display. This will used for educational and display purposes for Library visitors.