April 2013
·
75 Reads
·
12 Citations
Traditionally, remote memory accesses in cluster sys- tems are very expensive operations, which perform 20-100 times slower than local memory accesses. Modern RDMA capable networks such as InfiniBand and Quadrics provide low latency of a few microseconds and high bandwidth of up to 10 Gbps. This has made remote memory much closer to the local memory system. Using remote idle memory to enhance local memory hierarchy thus becomes an attractive choice, especially for data intensive applications in cluster environment. In this paper, we take the challenge to de- sign a remote paging system for remote memory utilization in InfiniBand clusters. We present the design and imple- mentation of a high performance networking block device (HPBD), which serves as a swap device of kernel Virtual Memory (VM) system for efficient page transfer to/from re- mote memory servers. Our experiments show that using HPBD, quick sort performs only 1.45 times slower than lo- cal memory system, and up to 21 times faster than local disk. And our design is completely transparent to user ap- plications. To the best of our knowledge, it is the first work of a remote pager design using InfiniBand for remote mem- ory utilization.