Skip to main content

Run with MPI

Cylon executables can be run with MPI distributions as follows.


To run the cpp/src/examples/join_example.cpp, first compile cylon.

Then, run the executable,

mpirun -np <NUM_WORKERS> <CYLON_HOME>/bin/join_example /path/to/csv1 /path/to/csv2


To run the python/test/,

mpirun -np <NUM_WORKERS> <PYTHON_ENV>/bin/python3 <CYLON_HOME>/python/test/


To run the java/src/main/java/org/cylondata/cylon/examples/, first create a fat-jar with the executables

mvn clean package

Then run the fat-jar main class,

mpirun -np <NUM_WORKERS> java -cp <CYLON_HOME>/target/cylon-0.1.0-jar-with-dependencies.jar org.cylondata.cylon.examples.DistributedJoinExample /path/to/csv1 /path/to/csv2