Storage Management

Project WBS Element Title

Storage Management

Project WBS Element Definition

This element includes design and implementation of the mass storage system and its software. Included are the systems to provide the management of the storage of raw and processed data and retrieval of this data for reconstruction and analysis.

Project Scope and Deliverables:

The storage of and access to the large volumes of raw and processed data will require the use of robotic devices in the computing center, and possibly elsewhere. The scope of this project includes provision for archiving of data to tape from the various input streams: Level 3, Production Farms, Derived datasets from Processing and Analysis. It also provides for reading of the data by Data Access, Production Computing and other systems, as well as the hierarchical storage management software needed to migrate data among shelf storage, robotic storage and disk.

Tracking and cataloging of data at all stages of the process via one or more mechanisms is required and software which optimizes access to the data is desired. The project is expected to consider and plan for more than one method of data storage and organization and to accommodate various stages of data processing and access requirements.

The project includes:

• A system to allow data to be written to and read from the Mass Storage Hardware at Run II rates and access patterns.
• A system to allocate the available tape access bandwidth in a prioritized fashion to support critical data taking application from the Experiment Online or Level 3 system.
• A system that provides for robust operation under a variety of error conditions.
• Efficient and effective software and hardware integration that provides a flexible and robust system allowing the Run II physics goals to be met.
• Software that allows users to see the ongoing status of their pending and completed requests.
• Software that provides status for all individual system components and the overall system.

Project Status

Operations of existing storage management systems, tests of these systems for the Run II requirements, requirements gathering and feasibility studies and prototyping of options are will underway.

Project Manager

Jon Bakken

Project Liaisons

Stephan Lammel (CDF), Lee Lueking (D0)

Procurement Profile

Procurements handled as part of the Hardware projects.