-
D N Williams,
R Ananthakrishnan,
D E Bernholdt,
S Bharathi,
D Brown,
M Chen,
A L Chervenak, L Cinquini,
R Drach,
I T Foster, [......],
D E Middleton,
J Schwidder,
R Schweitzer,
R Schuler,
A Shoshani,
F Siebenlist,
A Sim,
W G Strand,
N Wilhelmi,
M Su
-
D N Williams,
R Ananthakrishnan,
D E Bernholdt,
S Bharathi,
D Brown,
M Chen,
A L Chervenak, L Cinquini,
R Drach,
I T Foster, [......],
D E Middleton,
J Schwidder,
R Schweitzer,
R Schuler,
A Shoshani,
F Siebenlist,
A Sim,
W G Strand,
N Wilhelmi,
M Su
[show abstract]
[hide abstract]
ABSTRACT: The international climate community is expected to generate hundreds of petabytes of simulation data within the next five to seven years. This data must be accessed and analyzed by thousands of analysts worldwide in order to provide accurate and timely estimates of the likely impact of climate change on physical, biological, and human systems. Climate change is thus not only a scientific challenge of the first order but also a major technological challenge. In order to address this technological challenge, the Earth System Grid Center for Enabling Technologies (ESG-CET) has been established within the U.S. Department of Energy's Scientific Discovery through Advanced Computing (SciDAC)-2 program, with support from the offices of Advanced Scientific Computing Research and Biological and Environmental Research. ESG-CET's mission is to provide climate researchers worldwide with access to the data, information, models, analysis tools, and computational capabilities required to make sense of enormous climate simulation datasets. Its specific goals are to (1) make data more useful to climate researchers by developing Grid technology that enhances data usability; (2) meet specific distributed database, data access, and data movement needs of national and international climate projects; (3) provide a universal and secure web-based data access portal for broad multi-model data collections; and (4) provide a wide-range of Grid-enabled climate data analysis tools and diagnostic methods to international climate centers and U.S. government agencies. Building on the successes of the previous Earth System Grid (ESG) project, which has enabled thousands of researchers to access tens of terabytes of data from a small number of ESG sites, ESG-CET is working to integrate a far larger number of distributed data providers, high-bandwidth wide-area networks, and remote computers in a highly collaborative problem-solving environment.
Journal of Physics Conference Series 08/2008; 125(1):012072.
-
[show abstract]
[hide abstract]
ABSTRACT: This presentation will demonstrate how users and other data providers
can utilize the Virtual Solar-Terrestrial Observatory (VSTO) to find,
access and use diverse data holdings from the disciplines of solar,
solar-terrestrial and space physics. VSTO provides a web portal, web
services and a native applications programming interface for various
levels of users. Since these access methods are based on semantic web
technologies and refer to the VSTO ontology, users also have the option
of taking advantage of value added services when accessing and using the
data. We present example of both conventional use of VSTO as well as the
advanced semantics use. Finally, we present our future directions for
VSTO and semantic data frameworks in general.
AGU Spring Meeting Abstracts. 04/2008; -1:06.
-
[show abstract]
[hide abstract]
ABSTRACT: The scientific research community increasingly has complex, difficult
questions to ask of its observations and model results - questions that
will increasingly span disparate datasets, multiple disciplines, and
international boundaries. Our future information systems are going to
need to satisfy these growing demands. GEOSS, the Global Earth Observing
System of Systems, puts forth a compelling vision in this area. Solid
steps in the direction of this vision are already well underway, moving
us towards the next generation of global, federated environmental data
systems. For example, last year the World Meteorological Organization
demonstrated its first prototype for WIS, the WMO Information System.
WIS is a step in the direction of GEOSS, providing a federated system
that provides aggregation of environmental data and services at national
and regional levels, combined with a small number of redundant peer
systems that can service large-scale geographical regions. Forming a
foundational layer for efforts like WIS, the global community is in the
process of building other systems of systems that essentially aggregate
and integrate the output of data and modeling efforts, in areas such as
weather, climate, space physics, and many others. This encouraging trend
towards federation of new and existing systems is driven by scientific
needs and underpinned by shared technology, interfaces, protocols,
metadata standards, and the world of Grid computing. NCAR, working with
many partners, is contributing to a number of projects that are focused
upon some of these challenges. In this presentation we will describe a
suite of complimentary and interconnected efforts, including the Earth
System Grid (climate), the Community Data Portal (and WIS connections),
TIGGE (weather), the Virtual Solar Terrestrial Observatory, and related
metadata thrusts. The main emphasis here is the pursuit of systems of
systems as well as progress towards semantic integration, which will be
very important if we are to pursue our long-term scientific goals.
AGU Spring Meeting Abstracts. 04/2007; -1:05.
-
D E Middleton,
D E Bernholdt,
D Brown,
M Chen,
A L Chervenak, L Cinquini,
R Drach,
P Fox,
P Jones,
C Kesselman,
I T Foster,
V Nefedova,
A Shoshani,
A Sim,
W G Strand,
D Williams
[show abstract]
[hide abstract]
ABSTRACT: With support from the U.S. Department of Energy's Scientific Discover Through Advanced Computing (SciDAC) program, we have developed and deployed the Earth System Grid (ESG) to make climate simulation data easily accessible to the global climate modelling and analysis community. ESG currently has 2500 registered users and manages 160 TB of data in archives distributed around the nation. From this past year alone, more than 200 scientific journal articles have been published from analyses of data delivered by the ESG.
Journal of Physics Conference Series 09/2006; 46(1):510.
-
D. Bernholdt,
S. Bharathi,
D. Brown,
K. Chanchio,
M. Chen,
A. Chervenak, L. Cinquini,
B. Drach,
I. Foster,
P. Fox,
J. Garcia,
C. Kesselman,
R. Markel,
D. Middleton,
V. Nefedova,
L. Pouchard,
A. Shoshani,
A. Sim,
G. Strand,
D. Williams
[show abstract]
[hide abstract]
ABSTRACT: Understanding the Earth's climate system and how it might be changing is a preeminent scientific challenge. Global climate models are used to simulate past, present, and future climates, and experiments are executed continuously on an array of distributed supercomputers. The resulting data archive, spread over several sites, currently contains upwards of 100 TB of simulation data and is growing rapidly. Looking toward mid-decade and beyond, we must anticipate and prepare for distributed climate research data holdings of many petabytes. The Earth System Grid (ESG) is a collaborative interdisciplinary project aimed at addressing the challenge of enabling management, discovery, access, and analysis of these critically important datasets in a distributed and heterogeneous computational environment. The problem is fundamentally a Grid problem. Building upon the Globus toolkit and a variety of other technologies, ESG is developing an environment that addresses authentication, authorization for data access, large-scale data transport and management, services and abstractions for high-performance remote data access, mechanisms for scalable data replication, cataloging with rich semantic and syntactic information, data discovery, distributed monitoring, and Web-based portals for using the system.
Proceedings of the IEEE 04/2005; · 6.81 Impact Factor
-
L. Pouchard, L. Cinquini,
B. Drach,
D Middleton,
D. Bernholdt,
K. Chanchio,
I. Foster,
V. Nefedova,
D Brown,
P. Fox,
J Garcia,
G. Strand,
D Williams,
A. Chervenak,
C. Kesselman,
A. Shoshani,
A. Sim
[show abstract]
[hide abstract]
ABSTRACT: In the emerging world of Grid Computing, shared computational, data, other distributed resources are becoming available to enable scientific advancement through collaborative research and collaboratories. This paper describes the increasing role of ontologies in the context of Grid Computing for obtaining, comparing and analyzing data. We present ontology entities and a declarative model that provide the outline for an ontology of scientific information. Relationships between concepts are also given. The implementation of some concepts described in this ontology is discussed within the context of the Earth System Grid II (ESG)[1].
Cluster Computing and the Grid, 2003. Proceedings. CCGrid 2003. 3rd IEEE/ACM International Symposium on; 06/2003
-
R Ananthakrishnan,
D E Bernholdt,
S Bharathi,
D Brown,
M Chen,
A L Chervenak, L Cinquini,
R Drach,
I T Foster,
P Fox, [......],
J Schwidder,
R Schweitzer,
R Schuler,
A Shoshani,
F Siebenlist,
A Sim,
W G Strand,
N Wilhelmi,
M Su,
D N Williams
[show abstract]
[hide abstract]
ABSTRACT: The recent release of the Intergovernmental Panel on Climate Change (IPCC) 4th Assessment Report (AR4) has generated significant media attention. Much has been said about the U.S. role in this report, which included significant support from the Department of Energy through the Scientific Discovery through Advanced Computing (SciDAC) and other Department of Energy (DOE) programs for climate model development and the production execution of simulations. The SciDAC-supported Earth System Grid Center for Enabling Technologies (ESG-CET) also played a major role in the IPCC AR4: all of the simulation data that went into the report was made available to climate scientists worldwide exclusively via the ESG-CET. At the same time as the IPCC AR4 database was being developed, the National Center for Atmospheric Research (NCAR), a leading U.S. climate science laboratory and a ESG participant, began publishing model runs from the Community Climate System Model (CCSM), and its predecessor the Parallel Coupled Model (PCM) through ESG. In aggregate, ESG-CET provides seamless access to over 180 terabytes of distributed climate simulation data to over 6,000 registered users worldwide, who have taken delivery of more than 250 terabytes from the archive. Not only does this represent a substantial advance in scientific knowledge, it is also a major step forward in how we conduct the research process on a global scale. Moving forward, the next IPCC assessment report, AR5, will demand multi-site metadata federation for data discovery and cross-domain identity management for single sign-on of users in a more diverse federation enterprise environment. Towards this aim, ESG is leading the effort in the climate community towards standardization of material for the global federation of metadata, security, and data services required to standardize, analyze, and access data worldwide.
-
[show abstract]
[hide abstract]
ABSTRACT: In this paper, we discuss recent development and implementation efforts by the Earth System Grid (ESG) concerning its security infrastructure. ESG's requirements are to make user logon as easy as possible and to facilitate the integration of security services and Grid components for both developers and system administrators. To meet that goal, we leverage existing primary authentication mechanisms, deploy a "lightweight" but secure OpenID WebSSO, deploy a "lightweight" X.509-PKI, and use autoprovisioning to ease the burden of security configuration management. We are close to completing the associated development and deployment.
-
D. N. Williams,
R. Ananthakrishnan,
D. E. Bernholdt,
S. Bharathi,
D. Brown,
M. Chen,
A. L. Chervenak, L. Cinquini,
R. Drach,
I. T. Foster,
S. Hankin,
V. E. Henson
[show abstract]
[hide abstract]
ABSTRACT: The international climate community is expected to generate hundreds of petabytes of simulation data within the next five to seven years. This data must be accessed and analyzed by thousands of analysts worldwide in order to provide accurate and timely estimates of the likely impact of climate change on physical, biological, and human systems. Climate change is thus not only a scientific challenge of the first order but also a major technological challenge. To address this technological challenge, the Earth System Grid Center for Enabling Technologies (ESG-CET) has been established within the U.S. Department of Energy's Scientific Discovery through Advanced Computing (SciDAC)-2 program, with support from the offices of Advanced Scientific Computing Research and Biological and Environmental Research. ESG-CET's mission is to provide climate researchers worldwide with access to the data, information, models, analysis tools, and computational capabilities required to make sense of enormous climate simulation datasets. Its specific goals are to (1) make data more useful to climate researchers by developing Grid technology that enhances data usability; (2) meet specific distributed database, data access, and data movement needs of national and international climate projects; (3) provide a universal and secure web-based data access portal for broad multi-model data collections; and (4) provide a wide-range of Grid-enabled climate data analysis tools and diagnostic methods to international climate centers and U.S. government agencies. Building on the successes of the previous Earth System Grid (ESG) project, which has enabled thousands of researchers to access tens of terabytes of data from a small number of ESG sites, ESG-CET is working to integrate a far larger number of distributed data providers, high-bandwidth wide-area networks, and remote computers in a highly collaborative problem-solving environment.
