• YARN Resource Manager WebUI: http://dicvmc1.ie.cuhk.edu.hk:8088 View overall information for each (both ongoing and history) job

  • YARN Job History Service: http://dicvmc2.ie.cuhk.edu.hk:19888 View detailed information (incl. Program stderr & Hadoop System logs) for each history job and mapper/reducer task

  • Hadoop NameNode WebUI: http://dicvmc2.ie.cuhk.edu.hk:50070 View HDFS status

  • SSH Connection/ SFTP File Transfer:

    • Username is s+SID, e.g. s1155123456

    • Password is posted on CUHK Blackboard

    • Server Address is dicvmc4.ie.cuhk.edu.hk

  • Hadoop Streaming Jar: Located at /usr/lib/hadoop-mapreduce/hadoop-streaming-2.10.1.jar

  • Configuration Files: Located in /etc/hadoop/conf.empty/ (Only readable, no write permissions)