~ Home ~

Feed


Description

The course discusses data-intensive analytics, and automated processing of very large amount of structured and unstructured information. We focus on leveraging the MapReduce and other related paradigms to create parallel algorithms that can be scaled up to handle massive data sets such as those collected from the World Wide Web or other Internet systems and applications. We organize the course around a list of large-scale data analytic problems in practice. The required theories and methodologies for tackling each problem will be introduced. As such, the course only expects students to have solid knowledge in probability, statistics, linear algebra and computer programming skills. Topics to be covered include: the MapReduce computational model and its system architecture and realization in practice ; Finding Frequent Item-sets and Association Rules ; Finding Similar Items in high-dimensional data ; Dimensionality Reduction techniques ; Clustering ; Recommendation systems ; Analysis of Massive Graphs and its applications on the World Wide Web ; Large-scale supervised machine learning; Processing and mining of Data Streams and their applications on large-scale network/ online-activity monitoring. .

Course Information

Lecture time and venue:

  • MON 09:30 - 11:15, ERB 803
  • FRI 09:30 - 11:15, LSB LT2

Lecture time and venue(ESTR4300):

  • THU 16:30 - 17:15, ERB 406

Tutorial:

  • Time: FRI 08:30 - 09:15
  • Venue: LSB LT2

TA Office Hours: (If you want to ask TAs for help beyond those periods, please send an email to make reservations with the TA in advance.)

  • Liu Yang: WED 14:00 - 15:00, SHB 803
  • Xu Wenjie: FRI 14:00 - 15:00, SHB 832

Instructor:

  • Prof. Wing Cheong Lau. wclau [at] ie [dot] cuhk [dot] edu [dot] hk
  • Office hours: MON 13:00 - 14:00, SHB 818

Teaching Assistant:

  • Liu Yang ly016 [at] ie [dot] cuhk [dot] edu [dot] hk
  • Xu Wenjie xw018 [at] ie [dot] cuhk [dot] edu [dot] hk

Website account:

User: ierg4300
Password: fall2018ierg

Highly Recommended Textbooks

Tentative Timetable

Week Lecture Date Topic Period Recommended Readings Additional References
1 Sept 7 Course Admin; Era of Big Data Analytics; Computing as a Utility; Data-center Architecture F1-3 [Jlin]Ch1 ; [MMDS]Ch1 [DataCenter]
2 Sept 10, 14 MapReduce M2-3, F2-3 [MMDS]Ch2.1-2.4 ; [JLin]Ch2 -
3-4 Sept 17, 21, 24 MapReduce (cont'd) ; The Big Data Processing stack M2-3, F2-3, M2-3 [JLin]Ch3.1-3.4 [CloudData]
**Oct 1 Public holiday: National Day**
4-5 Sept 28, Oct 5 Frequent Item-Set Mining and Association Rules F2-3, F2-3 [MMDS]Ch6.1-6.4 -
6 Oct 8, 12 Finding Similar Items and LSH M2-3, F2-3 [MMDS]Ch3.1-3.5 [ZG]
7 Oct 15, 19 Clustering and GMM M2-3, F2-3 [MMDS] Ch7.1-7.4 [MMDS] Ch11, [CBishop] Ch.9, [MLE/MAP] -
**An in-class Mid-term will be held on Oct 26 (Fri)**
8 Oct 22, 26 Dimension Reduction M2-3, F2-3 [MMDS] Ch11 [PCA], [GuruswamiKannan]
9 Oct 29, Nov 2 Recommendation Systems M2-3, F2-3 [SVDPCA], [ANgCS229PCA], [ShaliziADAEPV]Ch17 ; -
10 Nov 5, 9 Recommendation Systems (cont'd) ; Regression and Gradient Descent M2-3, F2-3 [MMDS] Ch9 [Netflix09]; [KorenTalk]; [ANg]
11 Nov 12, 16 Data Stream Algorithms M2-3, F2-3 [MMDS] Ch4.1-4.5 ; -
12 Nov 19, 23 Data Stream Algorithms (cont'd) M2-3, F2-3 [ChakDataStream] Ch0,Ch1,Ch4.4,Ch6 ; -
13 Nov 26, 30 Backup/ Overflow M2-3, F2-3 - -

Course Assessment

Your grade will be based on the following components:

  • Homeworks & Programming assignments (5 sets in total): 50%
  • Mid-term: 10%
  • Final Exam: 40% (2-hour final examination)

Student/Faculty Expectations on Teaching and Learning

http://mobitec.ie.cuhk.edu.hk/StaffStudentExpectations.pdf

Academic Honesty

You are expected to do your own work and acknowledge the use of anyone else's words or ideas. You MUST put down in your submitted work the names of people with whom you have had discussions.

Refer to http://www.cuhk.edu.hk/policy/academichonesty for details

When scholastic dishonesty is suspected, the matter will be turned over to the University authority for action.

You MUST include the following signed statement in all of your submitted homework, project assignments and examinations. Submission without a signed statement will not be graded.

I declare that the assignment here submitted is original except for source material explicitly acknowledged, and that the same or related material has not been previously submitted for another course. I also acknowledge that I am aware of University policy and regulations on honesty in academic work, and of the disciplinary guidelines and procedures applicable to breaches of such policy and regulations, as contained in the website http://www.cuhk.edu.hk/policy/academichonesty/.

Course Collaborators