Skip to content

IceyChiu/Big-Data-Project

Repository files navigation

Task 1

``It cost 22 seconds to run the mapreduce.

Task 2

chmod +x /home/uic/Big-Data-Project/task2/mapper.py /home/uic/Big-Data-Project/task2/reducer.py /home/uic/Big-Data-Project/task2/run.sh

sh /home/uic/Big-Data-Project/task2/run.sh

Task 3

Step 1:

chmod +x /home/uic/Big-Data-Project/task3/mapper1.py /home/uic/Big-Data-Project/task3/reducer1.py /home/uic/Big-Data-Project/task3/run1.sh

sh /home/uic/Big-Data-Project/task3/run1.sh
hadoop fs -cat /output/project/task3/1/part-00000

Step 2:

chmod +x /home/uic/Big-Data-Project/task3/mapper2.py /home/uic/Big-Data-Project/task3/reducer2.py /home/uic/Big-Data-Project/task3/run2.sh

sh /home/uic/Big-Data-Project/task3/run2.sh
hadoop fs -cat /output/project/task3/2/part-00000

Step 3:

chmod +x /home/uic/Big-Data-Project/task3/mapper3.py /home/uic/Big-Data-Project/task3/reducer3.py /home/uic/Big-Data-Project/task3/run3.sh

sh /home/uic/Big-Data-Project/task3/run3.sh
hadoop fs -cat /output/project/task3/3/part-00000

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published