Question
Asked 15th Aug, 2017

Artificial intelligence. Has someone used AI scripts running with MPI library for crunching info from large databases? Trying to use MPI with AI.

Dear All,
I am trying to run some some AI scripts using multi-cores, maybe via METIS lib. or any similar library that would do the job. Has anyone used a similar approach?
Thanks in advance.
F.

Popular answers (1)

Bisan Alsalibi
Monash University (Malaysia)
 Hi. As far as I understand, you want to use the Message Passing Interface (MPI) to perform parallel processing on large-scale databases. If your AI scripts are written with Matlab, you can use the parallel processing toolbox in Matlab where they have simple built in functions (e.g. parfor, parpool) to perform the parallel simulation.
3 Recommendations

All Answers (3)

Bisan Alsalibi
Monash University (Malaysia)
 Hi. As far as I understand, you want to use the Message Passing Interface (MPI) to perform parallel processing on large-scale databases. If your AI scripts are written with Matlab, you can use the parallel processing toolbox in Matlab where they have simple built in functions (e.g. parfor, parpool) to perform the parallel simulation.
3 Recommendations
Thanks a lot Bisan and Dibakar.
I am going through your suggestions and having quite a few more ideas to achieve what we need.
Ta
F.
2 Recommendations

Similar questions and discussions

Has the value of the library gone down?
Question
5 answers
  • Shamji D ParmarShamji D Parmar
Libraries have been around for 5,000 years. If they were not essential institutions, they would have died out long ago. (The first ones appeared in what’s known as the “fertile crescent” or “cradle of civilization” in Southwest Asia, according to The Library: An Illustrated History by Stuart A. P. Murray.  http://www.alastore.ala.org/detail.aspx?ID=2643 )

Related Publications

Article
Full-text available
A new approach to running complex, distributed MPI jobs using the MPICH-G2 library is described. This approach allows the user to switch between different versions of compilers, system libraries, MPI libraries, etc. via the "module" command. The key idea is a departure from the prescribed "(jobtype=mpi)" approach to running distributed MPI jobs. Th...
Conference Paper
Intel's Xeon Phi coprocessor, based on Many Integrated Core architecture, packs more than 1TFLOP of performance on a single chip and offers x86 compatibility. While MPI libraries can run out-of-the-box on the Xeon Phi coprocessors, it is critical to tune them for the new architecture and to redesign them using any new system level features offered...
Article
Full-text available
An MPI profiling library is a standard mechanism for intercepting MPI calls by applications. Profiling libraries are so named because they are commonly used to gather runtime information about performance characteristics. Here we present a profiling library whose purpose is to detect user errors in the use of MPI's collective operations. While some...
Got a technical question?
Get high-quality answers from experts.