Skip to content

Latest commit

 

History

History
47 lines (32 loc) · 1.13 KB

README.md

File metadata and controls

47 lines (32 loc) · 1.13 KB
Raw

Task 1

``It cost 22 seconds to run the mapreduce.

Task 2

chmod +x /home/uic/Big-Data-Project/task2/mapper.py /home/uic/Big-Data-Project/task2/reducer.py /home/uic/Big-Data-Project/task2/run.sh

sh /home/uic/Big-Data-Project/task2/run.sh

Task 3

Step 1:

chmod +x /home/uic/Big-Data-Project/task3/mapper1.py /home/uic/Big-Data-Project/task3/reducer1.py /home/uic/Big-Data-Project/task3/run1.sh

sh /home/uic/Big-Data-Project/task3/run1.sh
hadoop fs -cat /output/project/task3/1/part-00000

Step 2:

chmod +x /home/uic/Big-Data-Project/task3/mapper2.py /home/uic/Big-Data-Project/task3/reducer2.py /home/uic/Big-Data-Project/task3/run2.sh

sh /home/uic/Big-Data-Project/task3/run2.sh
hadoop fs -cat /output/project/task3/2/part-00000

Step 3:

chmod +x /home/uic/Big-Data-Project/task3/mapper3.py /home/uic/Big-Data-Project/task3/reducer3.py /home/uic/Big-Data-Project/task3/run3.sh

sh /home/uic/Big-Data-Project/task3/run3.sh
hadoop fs -cat /output/project/task3/3/part-00000