Conference Paper

Transparent Optimization of Grid Server Selection With Real-Time Passive Network Measurements

Coll. of William & Mary, Williamsburg
DOI: 10.1109/BROADNETS.2006.4374425 Conference: Broadband Communications, Networks and Systems, 2006. BROADNETS 2006. 3rd International Conference on
Source: DBLP

ABSTRACT Grid services have tremendously simplified the programming challenges in leveraging large-scale distributed computing. At the same time, the increased level of abstraction reduces the opportunities available to the application for optimizing its performance by monitoring the system. In this paper we introduce a monitoring grid services proxy, which transparently monitors network performance and selects between several replica service providers. This approach provides optimized server selection without any modification to or even awareness of the client application or service providers. We describe how we implement the proxy and monitor the available bandwidth to the service providers using the Wren monitoring toolkit. We present analysis indicating that our monitoring has negligible overhead. Finally, we demonstrate the practicality of our approach by optimizing the server selection for INCOGEN's VIBE, a bioinformatics workflow application that uploads gene sequences for analysis by remote service providers.

0 Bookmarks
 · 
50 Views
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Grids offer the potential to carry out difficult computing tasks and achieve superior aggregate performance. However, grids are highly complex systems. They consist of heterogeneous resources on disparate hosts from various virtual organizations interconnected via a mixture of communication standards. Monitoring grid resources allows grid schedulers to adapt to changes in the status of these remote resources and the network paths between them. This is crucial to ensuring optimum performance. In this paper we introduce a distributed solution, called GridMAP, to collect network and end-host resource measurements, analyze their performance and feed these statistics and predictions back to schedulers. At this stage, we present our implementation of a passive TCP-SYN-based technique to provide GridMAP with round trip time and throughput measurements and we evaluate our approach against ping and iperf.
    Proceedings of the 18th International Conference on Computer Communications and Networks, IEEE ICCCN 2009, San Francisco, California, August 3-6, 2009; 01/2009

Full-text

View
0 Downloads
Available from