Conference Paper

MySRB and SRB - components of a Data Grid

San Diego Supercomput. Center, California Univ., San Diego, CA
DOI: 10.1109/HPDC.2002.1029930 Conference: High Performance Distributed Computing, 2002. HPDC-11 2002. Proceedings. 11th IEEE International Symposium on
Source: IEEE Xplore


Data Grids are becoming increasingly important in scientific communities for sharing large data collections and for archiving and disseminating them in a digital library framework. The Storage Resource Broker (SRB) provides transparent virtualized middleware for sharing data across distributed, heterogeneous data resources separated by different administrative and security domains. The MySRB is a Web-based interface to the SRB that provides a user-friendly interface to distributed collections brokered by the SRB. In this paper we briefly describe the use of the SRB infrastructure as tools in the data grid architecture for building distributed data collections, digital libraries, and persistent archives. We also provide details about the MySRB and its functionalities.

Download full-text


Available from: Reagan Wentworth Moore, Oct 04, 2015
169 Reads
  • Source
    • "There are repository trading and synchronization provisions (e.g., [10]), but most are specific to a particular repository architecture. Cooperative File Systems (CFS) [11], Internet Backplane Protocol (IBP) [2], Storage Resource Broker (SRB) [27] and OceanStore [31] are among several generic network storage systems and APIs that have also been proposed. CFS and OceanStore rely on distributed hash tables and an overlay network to locate content in the Internet. "
    [Show abstract] [Hide abstract]
    ABSTRACT: We investigate how different preservation policies ranging from least aggressive to Most aggressive affect the level of preservation achieved by autonomic processes used by smart digital objects (DOs). The mechanisms used to support preservation across different hosts can be used for automatic link generation and support preservation activities by moving data preservation from an archive centric perspective to a data centric preservation. Based on simulations of small-world graphs of DOs created using the Unsupervised Small-World algorithm, we report quantitative and qualitative results for graphs ranging in size from 10 to 5000 DOs. Our results show that a Most aggressive preservation policy makes the best use of distributed host resources while using one half of the number of messages of a Moderately aggressive preservation policy.
  • Source
    • "SRB is being used by a broad array of scientific organizations [28] (including the International Virtual Observatory Alliance, BIRN, NASA, the Grid Physics Network and the US National Science Digital Library). Each of these organizations have implemented their own unique domain-specific user-defined metadata schemas that are extensions to the core MCAT metadata scheme. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Information discovery is looming as a major challenge with the growth of tera-byte size datagrids. In order to manage their distributed data collections, many scientific organizations are adopting San Diego SuperComputer's Storage Resource Broker (SRB). Indexing and retrieval of data stored in SRB is via SRB's Metadata Catalogue (MCAT). MCAT focuses primarily on system or administrative metadata but supports domain-specific metadata through user-defined extensions. Although this approach provides maximum flexibility, it will lead to interoperability problems when searching across distributed collections described using different user-defined metadata schemas. The aim of the work described in this paper is to semantically augment SRB through an ontology and Resource Description Framework (RDF) descriptions in order to support arbitrary metadata schemata and to enhance the system's search capabilities. In particular we describe a semantic search engine and interface built on top of an OWL ontology, RDF instance data and a Jena reasoning engine that enables easier and more sophisticated searching of heterogeneous data stored using SRB.
  • Source
    • "One of these storage mechanisms is the Storage Resource Broker (SRB) system. The SRB provides transparent virtualized middleware for sharing data across distributed, heterogeneous data resources separated by different administrative and security domains (Rajasekar et al. 2002). This storage system is superseded by the Globus GridFTP 10 system in BIRN. "
    [Show abstract] [Hide abstract]
    ABSTRACT: Managing vast datasets collected throughout multiple clinical imaging communities has become critical with the ever increasing and diverse nature of datasets. Development of data management infrastructure is further complicated by technical and experimental advances that drive modifications to existing protocols and acquisition of new types of research data to be incorporated into existing data management systems. In this paper, an extensible data management system for clinical neuroimaging studies is introduced: The Human Clinical Imaging Database (HID) and Toolkit. The database schema is constructed to support the storage of new data types without changes to the underlying schema. The complex infrastructure allows management of experiment data, such as image protocol and behavioral task parameters, as well as subject-specific data, including demographics, clinical assessments, and behavioral task performance metrics. Of significant interest, embedded clinical data entry and management tools enhance both consistency of data reporting and automatic entry of data into the database. The Clinical Assessment Layout Manager (CALM) allows users to create on-line data entry forms for use within and across sites, through which data is pulled into the underlying database via the generic clinical assessment management engine (GAME). Importantly, the system is designed to operate in a distributed environment, serving both human users and client applications in a service-oriented manner. Querying capabilities use a built-in multi-database parallel query builder/result combiner, allowing web-accessible queries within and across multiple federated databases. The system along with its documentation is open-source and available from the Neuroimaging Informatics Tools and Resource Clearinghouse (NITRC) site.
    Neuroinformatics 12/2010; 8(4):231-49. DOI:10.1007/s12021-010-9078-6 · 2.83 Impact Factor
Show more