No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Bridging the gaps: Federation of Clouds using Grid services and standards
Abstract
Clouds have emerged as a new paradigm to access compute, storage, and networked resources in secure and cost effective manner. Their major benefits are seen in the commercial domain with its key features such as on-demand and more flexible resource provisioning, pay per use, and customized application environments. Also research communities such as High Energy Physics (HEP), Biology, and Neuroscience are investigating the applicability of Clouds, with their strengths and weaknesses in scientific environments. In this paper we will show that in scientific environments there are certain areas where cloud services should be exploited to support the challenging e-Science requirements. Among them are, support for virtual communities, dynamic service and resource discovery, identity and resource federation, and access to data catalogues. The Grid community has actively contributed to address some of these issues, thus we propose to reuse existing efforts to complement Cloud services with Grid computing best practices, production services, and experiences, including standardization. In this paper we will provide guidelines of how to realize multi-cloud federated deployments based on a survey of existing Grid technologies in context augmenting it with lessons learned gained in scientific environments. The contribution focuses on the areas of compute, data, information, and security. We will also show potential benefits that scientists can gain by adopting proposed solutions in cloud-based deployments.
ResearchGate has not been able to resolve any citations for this publication.
This document specifies the semantics and structure of the Job Submission Description Language (JSDL). JSDL is used to describe the requirements of computational jobs for submission to
resources, particularly in Grid environments, though not restricted to the latter. The document
includes the normative XML Schema for the JSDL, along with examples of JSDL documents
based on this schema.
Many existing Grid technologies and resource management systems lack a standardized job submission interface in Grid environments or e-Infrastructures. Even if the same language for job description is used, often the interface for job submission is also different in each of these technologies. The evolvement of the standardized Job Submission and Description Language (JSDL) as well as the OGSA - Basic Execution Services (OGSA-BES) pave the way to improve the interoperability of all these technologies enabling cross-Grid job submission and better resource management capabilities. In addition, the BytelO standards provide useful mechanisms for data access that can be used in conjunction with these improved resource management capabilities. This paper describes the integration of these standards into the recently released UNICORE 6 Grid middleware that is based on open standards such as the Web Services Resource Framework (WS-RF) and WS-Addressing (WS-A).
Cloud computing systems fundamentally provide ac- cess to large pools of data and computational resources through a variety of interfaces similar in spirit to exist- ing grid and HPC resource management and program- ming systems. These types of systems offer a new pro- gramming target for scalable application developers and have gained popularity over the past few years. However, most cloud computing systems in operation today are pro- prietary, rely upon infrastructure that is invisible to the research community, or are not explicitly designed to be instrumented and modified by systems researchers. In this work, we present EUCALYPTUS - an open- source software framework for cloud computing that im- plements what is commonly referred to as Infrastructure as a Service (IaaS); systems that give users the ability to run and control entire virtual machine instances deployed across a variety physical resources. We outline the ba- sic principles of the EUCALYPTUS design, detail impor- tant operational aspects of the system, and discuss archi- tectural trade-offs that we have made in order to allow Eucalyptus to be portable, modular and simple to use on infrastructure commonly found within academic settings. Finally, we provide evidence that EUCALYPTUS enables users familiar with existing Grid and HPC systems to ex- plore new cloud computing functionality while maintain- ing access to existing, familiar application development software and Grid middle-ware.
Cloud Computing has become another buzzword after Web 2.0. However, there are dozens of different definitions for Cloud Computing and there seems to be no consensus on what a Cloud is. On the other hand, Cloud Computing is not a completely new concept; it has intricate connection to the relatively new but thirteen-year established Grid Computing paradigm, and other relevant technologies such as utility computing, cluster computing, and distributed systems in general. This paper strives to compare and contrast Cloud Computing with Grid Computing from various angles and give insights into the essential characteristics of both.
High performance disk-storage solutions based on parallel file systems are becoming increasingly important to fulfill the large I/O throughput required by high-energy physics applications. Storage area networks (SAN) are commonly employed at the Large Hadron Collider data centres, and SAN-oriented parallel file systems such as GPFS and Lustre provide high scalability and availability by aggregating many data volumes served by multiple disk-servers into a single POSIX file system hierarchy. Since these file systems do not come with a storage resource manager (SRM) interface, necessary to access and manage the data volumes in a grid environment, a specific project called StoRM has been developed for providing them with the necessary SRM capabilities. In this paper we describe the deployment of a StoRM instance, configured to manage a GPFS file system. A software suite has been realized in order to perform stress tests of functionality and throughput on StoRM. We present the results of these tests.
The aim of the EU-funded EGEE (Enabling Grids for E-sciencE) project is to build on recent advances in grid technology and develop a grid service for scientific applications. This paper provides an overview of the EGEE project goals and structure and explains the work being performed in the areas of grid operations, middleware re-engineering and application deployment and support. We also give an overview of the collaborations EGEE is engaged in with other grid-related organisations and projects.