- gameoflife the Conway's Game of Life Game.
- jacobi a simple Jacobi iteration.
- matrixmultiplication parallel matrix multiplication.
- nbody the n-body problem.
- pi compute in parallel an approximation of PI.
- wordscount compute the frequency of words in a set of files.
- only point-to-point MPI communication routines.
- only collective MPI communication routines.
- point-to-point and collective MPI communication routines.
- m4.large
- m4.xlarge
- StraCluster* toolkit use this script to setup an Amazon EC2 cluster supporting OpenMPI.
- Java application to setup an Amazon EC2 cluster supporting OpenMPI based on StarCLuster AMI. *it does not woek using Amazon AWS Educate [last check May 2018]
This method is based on the public StarCluster AMI ami-52a0c53b (Linux Ubuntu) available on us-east-1 AWS region. For other information visit the StarCLuster site page.
In this example is described how to execute and manually configure a cluster of two t2.micro instances using the AWS WebConsole.
- Create a new key-pair and store it on your local machine, suppose that the name of the key is kcluster.
- Start two new t2.micro instances using the StarCluster AMI (ami-52a0c53b) and select the kcluster key-pair, additionally rename it as master and slave0. Set a new rule to the default security group that allows to open all TCP ports (0-65535) from anywhere (you can do it in the Configure Security Group tab).
- Connect via SSH and execute these commands on the master instance to create a new user pcpc and generate a SSH key:
sudo useradd -s /bin/bash -m -d /home/pcpc -g root pcpc
sudo mkdir -p /home/pcpc/.ssh
sudo chown pcpc:root ../pcpc/.ssh
sudo passwd pcpc
sudo login pcpc
ssh-keygen -t rsa
- Set the SSH key for the user pcpc.
cat .ssh/id_rsa.pub >> .ssh/authorized_keys
ssh localhost
- Connect using SSH and execute these commands on a slave instance:
sudo useradd -s /bin/bash -m -d /home/pcpc -g root pcpc
sudo mkdir -p /home/pcpc/.ssh
sudo chown pcpc:root ../pcpc/.ssh
sudo passwd pcpc
sudo login pcpc
- Copy from your local machine the kcluster file (pem file) on the master node.
scp -i pcpkey.pem pcpkey.pem [email protected]:
- From the master node copy on each slave the files id_rsa and id_rsa.pub:
sudo scp -i pcpkey.pem ../pcpc/.ssh/id_rsa ubuntu@ip_slave_internal:
sudo scp -i pcpkey.pem ../pcpc/.ssh/id_rsa.pub ubuntu@ip_slave_internal:
- Connect on the slave and set the owner as the pcpc user for the files id_rsa and id_rsa.pub.
sudo chown pcpc:root id_rsa id_rsa.pub
- Connect on the slave and move the files id_rsa and id_rsa.pub on /home/pcpc/.ssh.
sudo mv id_rsa id_rsa.pub /home/pcpc/.ssh
- Login on the slave as pcpc user and set the SSH key.
cat .ssh/id_rsa.pub >> .ssh/authorized_keys
ssh localhost
In order to add a new slave you have to start new EC2 instance and repeat the steps 4 and from 6 to 9.
Follow these steps in order to create and test a Hello World MPI program. Consider that you are logged as pcpc user on the master node.
- Create a new MPI program
vim hello.c - HelloWorld MPI program
#include <mpi.h>
#include <stdio.h>
int main(int argc, char** argv) {
// Initialize the MPI environment
MPI_Init(NULL, NULL);
// Get the number of processes
int world_size;
MPI_Comm_size(MPI_COMM_WORLD, &world_size);
// Get the rank of the process
int world_rank;
MPI_Comm_rank(MPI_COMM_WORLD, &world_rank);
// Get the name of the processor
char processor_name[MPI_MAX_PROCESSOR_NAME];
int name_len;
MPI_Get_processor_name(processor_name, &name_len);
// Print off a hello world message
printf("Hello world from processor %s, rank %d"
" out of %d processors\n",
processor_name, world_rank, world_size);
// Finalize the MPI environment.
MPI_Finalize();
}
- Compile the MPI program
mpicc hello.c -o hello - Copy on all cluster machine the compiled program
scp hello IP_SLAVE: - Run the program on the cluster
mpirun -np 4 --host MASTER,IP_SLAVE1,IP_SLAVE2 hello
Each solution should be compliant with the problem project template. You can submit a solution via mail using the [PCPC-SOLUTION] object to [email protected] and [email protected]. The submitted file should be a compressed directory using tape archive.
Each solution folder must contain the C sources and a report Readme file (in Markdown format) describing all benchmarks (expressed in terms of strong and weak scalability) of the application. Solutions without the Readme file or that cannot easily compile using mpicc will be not considered.
In your home project directory archives your project:
tar -cvf solution.tar.gz *
Extract your project:
tar -xvf solution.tar.gz
Present the results of benchmarks varying the number of EC2 instances involved in the computation. The results should be presented in terms of strong and weak scalability.
Homeworks are evaluated on a range of 30 total points. The final score is diveded in four level:
- A [30-28]
- B [27-25]
- C [24-22]
- D [21-18]
- Correctness. 0 to 10 points. Measures the student's commitment to develop a solution that is compliant with the problem requirement (obviously!). But also solution that solve part of the problem can be evaluated, if it is clear that only minor part of the problem are not correctly solved.
- Style. 0 to 10 points. Measures the student's commitment to develop a solution styling it and exploiting all features of MPI and C language, paying attention to use arguments of the parallel and concurrent computing fundamental part.
- Problem evaluation and Benchamrks. 0 to 10 points. Measures the student's commitment to undestand the problem and give a good solution, moreover, mesures the student's commitment to presents benchamrks.
- Lateness. The total score is decreased by 5% each day, until a 40% eight days or more late. The homework must be subitted for review 8 days before the exam date.