No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Performance assessment of network protocols and parallel programming tools for distributed computing systems
Abstract
Current advances in processor technology, networking technology, and software tools have made high-performance distributed computing over Local Area Networks (LANs) a promising alternative to traditional parallel and vector supercomputers. In this paper, we analyze the performance of two widely used distributed computing software tools, Express and PVM, on clusters of SUN workstations connected by an Ethernet and clusters of HP workstations connected by a Fiber Distributed Data Interface (FDDI) ring. Our goal is to assess the potential and pin-point the weaknesses of the various factors that affect the performance of these distributed computing environments. The major factors that are investigated in this paper are: networks, workstations, and distributed software tools. Extensive timing experiments, including one-to-one communications, exchange operations, and broadcast operations, have been performed in order to quantitatively determine the impact of these factors. Moreover, analytic models have been developed to analyze the behavior of the network protocols employed by the LAN-based platforms as well as to estimate the communication overhead for the distributed computing software tools.
ResearchGate has not been able to resolve any citations for this publication.
Concurrent computing on networks of heterogeneous machines has gained tremendous attention and popularity in recent months. This computing model encompasses a wide spectrum of environments, ranging from very coherent systems to loosely coupled workstations, but usually excludes distributed operating systems. Many such systems are operational (several more are under development) and have been used for an impressive range of applications. Heterogeneous network computing environments have the potential for multi-gigaflop performance, provide excellent support for applications with multifaceted requirements, enable straightforward provisions for fault-tolerance, and are easy to install, maintain, and use. These systems enhance the power, versatility, and usefulness of existing hardware, and support well-understood, pragmatic, programming models. In this paper, we will survey the state of the art in heterogeneous network computing, beginning with a description of representative systems and applications. We will also attempt to identify the most pressing needs as well as the foreseeable obstacles, and pose a sampling of the major challenges that face researchers and developers in heterogeneous network computing.
We describe some of the features of Express and the way that they were developed as a response to the needs of application programmers. We show how currently emerging computing platforms have led to new application needs and show how these are satisfied with Express features. We introduce a recently developed programming style which greatly simplifies programming as well as directly addressing complex issues such as dynamic load balancing and fault tolerance. Finally, we present a comparison of Express' features and motivation to the Message Passing Interface (MPI) standard currently being developed.
A comparison between two of the most promising environments, LINDA and PVM, used in parallel programming on homogeneous and heterogeneous networks, is presented. The tests consist in the implementation, by means of the above mentioned software system, of the most common types of data communication among the nodes of a cluster of RISC/6000. The results and the future improvements are discussed.
A majority of the MPP systems designed to date have been MIMD distributed memory systems. For almost all of these systems, message passing environments have provided the primary mechanism for programming multiprocessor applications. In this paper we provide an introduction to MPP systems in general. We then introduce current MPP message passing interfaces, by tracing their historical development over the last 10 years. In addition to their use within a single MPP architecture, we discuss the use of message passing systems to interconnect more loosely coupled processors in heterogeneous environments. Finally we review the development of ‘portability platforms’ — message passing systems that have been devised solely to allow portability of message passing programs between different systems.
The performance and proliferation of workstations continues to increase at a rapid rate. However, the practical utilization of workstation networks for parallel computing is still in its infancy. This is due to the relative immaturity of programming tools, low bandwidth networks such as Ethernet, and high message latencies. However, programming tools are becoming more mature and network bandwidths are increasing rapidly. Hence, networks of commodity workstations may prove to be practical for certain classes of parallel applications.
This paper describes our experiences with two applications parallelized on a network of Sun workstations. The first application is from Shell's petroleum engineering department. This program quantitatively derives rock and porefill composition from well-log data, using a compute-intensive iterative optimization procedure. The second application is time filtering, which is a fundamental operation performed on seismic traces.
Through our experiments we identify the limits of networked parallel computing based on the current state of network technology. We also provide a discussion on the possible impact of future high speed networks on networked parallel computing.