Figure 11 - uploaded by Anjus George
Content may be subject to copyright.
Source publication
Contexts in source publication
Context 1
... will come back to this callback handler later in the MGC life cycle process. The color coded blocks in Figure 11 were also part of mgc_setup() call graph shown in Figure 8 cfg_sub_clds; }; ...
Similar publications
A global, independent scientific assessment of Carbon Dioxide
Removal
Citations
... A well chosen default file system setup can ensure that newly created files get written to the performance tier and utilize that tier's superior performance. For instance, Lustre [2] allows storage with different characteristics to be configured into separate OST pools while allowing user files to be visible under as a single unified namespace. However, to distribute files to the appropriate tiers, users must make sure that the file's striping layout is set to use the correct pools. ...
... The scan agent in QuickSilver uses the lfs find [4] search utility implemented in Lustre [2] to gather metadata information on all files. Although the current implementation of QuickSilver relies on the NATS messaging system and lfs find, the code uses abstractions that provide flexibility for incorporating any messaging framework and file system search utility. ...
Large scale parallel file systems with multiple storage tiers require policy driven data management to facilitate efficient storage and access of large-scale data. However, management of data across the tiers is challenging due to the massive scale of data being stored. In this talk, we present our initial work on QuickSilver, a lightweight flexible distributed policy engine. QuickSilver is composed of many single-purpose agents that handle tasks such as gathering file metadata, enforcing policy decisions, and executing policy actions like purging or data migration. These agents are designed to communicate using distributed message queues, allowing the number of individual agents to be scaled up as needed. Additionally, QuickSilver is designed to function while maintaining minimal state information. We will discuss the architectural details of the policy engine and its use of message queues to enable scaling. Examples of the initial implementation will be shown along with preliminary performance numbers. Since this project is in its infancy, we will also discuss our plans for future work and areas of improvement.
... • Several resources exist to help deploy and configure Lustre Figure 4: Normal RAID0 file striping in Lustre [1] Overview of the Topics Documented Figure 6: Lustre I/O operation: Lustre client requesting file data [1] Overview of the Figure 11: Communication between ost and mdt server obd devices in Lustre [1] Overview of the Overview of the ...
... • Several resources exist to help deploy and configure Lustre Figure 4: Normal RAID0 file striping in Lustre [1] Overview of the Topics Documented Figure 6: Lustre I/O operation: Lustre client requesting file data [1] Overview of the Figure 11: Communication between ost and mdt server obd devices in Lustre [1] Overview of the Overview of the ...
... • Several resources exist to help deploy and configure Lustre Figure 4: Normal RAID0 file striping in Lustre [1] Overview of the Topics Documented Figure 6: Lustre I/O operation: Lustre client requesting file data [1] Overview of the Figure 11: Communication between ost and mdt server obd devices in Lustre [1] Overview of the Overview of the ...