Takeshi Shibata

Publications (5)0 Total impact

• Article: Design and Implementation of GXP Make -- A Workflow System Based on Make

  Kenjiro Taura, Takuya Matsuzaki, Makoto Miwa, Yoshikazu Kamoshida, Daisaku Yokoyama, Nan Dun, Takeshi Shibata, Choi Sung Jun, Jun'ichi Tsujii
  [show abstract] [hide abstract]
  ABSTRACT: This paper describes the rational behind designing workflow systems based on the Unix make by showing a number of idioms useful for workflows comprising many tasks. It also demonstrates a specific design and implementation of such a workflow system called GXP make. GXP make supports all the features of GNU make and extends its platforms from single node systems to clusters, clouds, supercomputers, and distributed systems. Interestingly, it is achieved by a very small code base that does not modify GNU make implementation at all. While being not ideal for performance, it achieved a useful performance and scalability of dispatching one million tasks in approximately 16,000 seconds (60 tasks per second, including dependence analysis) on an 8 core Intel Nehalem node. For real applications, recognition and classification of protein-protein interactions from biomedical texts on a supercomputer with more than 8,000 cores are described.
  eScience, IEEE International Conference on. 12/2010;
• Source

  Available from: u-tokyo.ac.jp

  Conference Proceeding: File-access patterns of data-intensive workflow applications and their implications to distributed filesystems.

  Takeshi Shibata, SungJun Choi, Kenjiro Taura
  Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, Chicago, Illinois, USA, June 21-25, 2010; 01/2010
• Conference Proceeding: Design and Implementation of GXP Make - A Workflow System Based on Make.

  Kenjiro Taura, Takuya Matsuzaki, Makoto Miwa, Yoshikazu Kamoshida, Daisaku Yokoyama, Nan Dun, Takeshi Shibata, Choi Sung Jun, Jun-ichi Tsujii
  Sixth International Conference on e-Science, e-Science 2010, 7-10 December 2010, Brisbane, QLD, Australia; 01/2010
• Source

  Available from: u-tokyo.ac.jp

  Conference Proceeding: File-Access Characteristics of Data-Intensive Workflow Applications.

  Takeshi Shibata, SungJun Choi, Kenjiro Taura
  10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGrid 2010, 17-20 May 2010, Melbourne, Victoria, Australia; 01/2010
• Article: InTrigger: A Multi-Site Distributed Computing Environment Supporting Flexible Configuration Changes

  Hideo Saito, Yoshikazu Kamoshida, Shogo Sawai, Ken Hironaka, Kei Takahashi, Takeshi Sekiya, Nan Dun, Takeshi Shibata, Daisaku Yokoyama, Kenjiro Taura
  IPSJ SIG Technical Report 2007-HPC-111. 2007(80):237-242.