Publications (5)0 Total impact
-
Article: Design and Implementation of GXP Make -- A Workflow System Based on Make
[show abstract] [hide abstract]
ABSTRACT: This paper describes the rational behind designing workflow systems based on the Unix make by showing a number of idioms useful for workflows comprising many tasks. It also demonstrates a specific design and implementation of such a workflow system called GXP make. GXP make supports all the features of GNU make and extends its platforms from single node systems to clusters, clouds, supercomputers, and distributed systems. Interestingly, it is achieved by a very small code base that does not modify GNU make implementation at all. While being not ideal for performance, it achieved a useful performance and scalability of dispatching one million tasks in approximately 16,000 seconds (60 tasks per second, including dependence analysis) on an 8 core Intel Nehalem node. For real applications, recognition and classification of protein-protein interactions from biomedical texts on a supercomputer with more than 8,000 cores are described.eScience, IEEE International Conference on. 12/2010; -
Conference Proceeding: File-access patterns of data-intensive workflow applications and their implications to distributed filesystems.
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, Chicago, Illinois, USA, June 21-25, 2010; 01/2010 -
Conference Proceeding: Design and Implementation of GXP Make - A Workflow System Based on Make.
Sixth International Conference on e-Science, e-Science 2010, 7-10 December 2010, Brisbane, QLD, Australia; 01/2010 -
Conference Proceeding: File-Access Characteristics of Data-Intensive Workflow Applications.
10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGrid 2010, 17-20 May 2010, Melbourne, Victoria, Australia; 01/2010 -
Article: InTrigger: A Multi-Site Distributed Computing Environment Supporting Flexible Configuration Changes
IPSJ SIG Technical Report 2007-HPC-111. 2007(80):237-242.
Institutions
-
2010
-
The University of Tokyo
Kashiwa, Chiba-ken, Japan
-