This poster presentation is intended to provide a recommendation for standards implementation and best practices for a viable, cost effective, and reliable long term archiving storage system. This solution is based on a combination of storage technologies to provide long-term viability.We will examine operating system platforms and filesystems for archive storage systems. We will examine the performance and archive capabilities of the filesystems including ZFS, Lustre, and SAM/QFS. We will also discuss the Hierarchical Storage System, or HSM, as a key software element of the archive. The HSM provides one of the key components that contributes to reliability by through data integrity checks and automated file migration. The HSM provides the ability to automate making multiples copies of files, auditing files for errors based on checksum, rejecting bad copies of files and making new copies based on the results of those audits. The HSM also provides the ability to read in an older file format and write-out a new file format thus migrating the format and application information required to ensure archival integrity of the stored content. The automation of these functions provides for improved performance and reduced operating costs.Oracle's Sun StorageTek Storage Archive Manager (SAM) software provides the core functionality of the recommended Archive Storage Architecture. SAM provides policy based data classification and placement across a multitude of storage devices from high speed disk, low cost disk, or tape. SAM also simplifies data management by providing centralized meta-data. SAM is a self-protecting file system with continuous file integrity checks.The digital content archive provides the content repository (or digital vault) within Sun's award winning Digital Asset Management Reference Architecture (DAM RA). DAM RA enables digital workflow and the content archive provides permanent access to digital content files. With SAM software, the files are stored, tracked, and retrieved based on the archival requirements. Files are seamlessly and transparently available to other services. SAM software creates virtually limitless capacity. Its scalability allows for continual growth throughout the archive with support for all data types. The policy based SAM software stores and manages data for compliance and noncompliance archives using a tiered storage approach with integrated disk and tape into a seamless storage solution, SAM software simplifies the archive storage. Allows you to automate data management policies based on file attributes. You can manage data according to the storage and access requirements of each user on the system and decide how data is grouped, copied, and accessed based on the needs of the application and the users. Helps you maximize return on investments by storing data on the media type appropriate for the life cycle of the data and simplifying system administration.
Keith Rajecki, "Preservation Archiving Storage Technologies" in Proc. IS&T Archiving 2010, 2010, pp 148 - 151, https://doi.org/10.2352/issn.2168-3204.2010.7.1.art00027