~ Home ~
Description
The course discusses data-intensive analytics, and automated processing of very large amount of structured and unstructured information. We focus on leveraging the MapReduce and other related paradigms to create parallel algorithms that can be scaled up to handle massive data sets such as those collected from the World Wide Web or other Internet systems and applications. We organize the course around a list of large-scale data analytic problems in practice. The required theories and methodologies for tackling each problem will be introduced. As such, the course only expects students to have solid knowledge in probability, statistics, linear algebra and computer programming skills. Topics to be covered include: the MapReduce computational model and its system architecture and realization in practice ; Finding Frequent Item-sets and Association Rules ; Finding Similar Items in high-dimensional data ; Dimensionality Reduction techniques ; Clustering ; Recommendation systems ; Analysis of Massive Graphs and its applications on the World Wide Web ; Large-scale supervised machine learning; Processing and mining of Data Streams and their applications on large-scale network/ online-activity monitoring.
Course Information
Lecture time and venue:
MON10:30 - 12:15, William M W Mong Bldg 710 (NOT ERB building !!)FRI9:30 - 11:15, William M W Mong Eng Bldg 407, i.e. ERB407
Lecture time and venue (ESTR 4300):
- Time:
FRI13:30 - 14:15 (From Sept 23 to Nov 25) - Venue: ERB406
Tutorial:
- Time:
Mon6:30 pm - 8:15 pm - Venue: ERB405
TA Office Hours: (If you want to ask TAs for help beyond those periods, please send an email to make reservations with the TA in advance.)
- Ronghai Yang:
Wed3:00 pm - 4:00 pm - Bowen Zhang:
Tue3:00 pm - 4:00 pm - Venue: HSH802
Instructor:
- Prof. Wing Cheong Lau.
wclau [at] ie [dot] cuhk [dot] edu [dot] hk - Office hours: Tue 3:30pm to 4:30pm or By Appointment (SHB 818)
Teaching Assistant:
- Ronghai Yang
yr013 [at] ie [dot] cuhk [dot] edu [dot] hk - Bowen Zhang
zb016 [at] ie [dot] cuhk [dot] edu [dot] hk
Website account:
User: engg4030
Password: fall2016engg
Highly Recommended Textbooks
[MMDS] Mining of Massive Datasets (Download version 1.3) by Anand Rajaraman, Jeff Ullman and Jure Leskovec, Cambridge University Press. Latest version can be downloaded from Mining of Massive Datasets.pdf
[JLin] Data-Intensive Text Processing with MapReduce by Jimmy Lin and Chris Dyer, Morgan and Claypool Publishers, 2010, can be freely downloaded from http://lintool.github.io/MapReduceAlgorithms/
[CBishop] Pattern Recognition and Machine Learning by Christopher M. Bishop, Published by Springer Science and Business, 2007.
[MLE/MAP] Estimating Probabilities: MLE and MAP http://www.cs.cmu.edu/~tom/mlbook/Joint_MLE_MAP.pdf
[HTF] Elements of Statistical Learning 2nd Edition by Trevor Hastie, Robert Tibshirani, Jerome H. Friedman, Published by Springer, 2009. Ebook version can be downloaded from: http://link.springer.com/book/10.1007/978-0-387-84858-7 via a CUHK IP address
[JWHT] An Introduction to Statistical Learning with Applications in R, by Gareth James, Daniela Witten, Trevor Hastie and Robert Tibshirani, Published by Springer, 2013. Ebook version can be downloaded from: http://link.springer.com/book/10.1007/978-1-4614-7138-7 via a CUHK IP address
[PCA] Principal Component Analysis, 2nd Edition, by I.T. Jolliffe, Published by Springer 2002, http://www.springerlink.com/content/h41v76/?p=e8e028e1c9ba414690c9179ee7c0e388&pi=3
[ShaliziADAEPV] Cosma Rohilla Shalizi, "Advanced Data Analysis from an Elementary Point of View", Cambridge University Press, 2014. Draft available for download from: http://www.stat.cmu.edu/~cshalizi/ADAfaEPoV/
[ShaprioStockman] Shaprio and Stockman, Computer Vision, 2000, Chapter 4.2-4.9, https://courses.cs.washington.edu/courses/cse576/book/ch4.pdf
[Blum] Blum, Avrim, John Hopcroft, and Ravindran Kannan. "Foundations of Data Science." (2016): http://www.cs.cornell.edu/jeh/bookJan25_2016.pdf
Tentative Timetable
| Week | Lecture Date | Topic | Period | Recommended Readings | Additional References |
|---|---|---|---|---|---|
| 1 | Sept 9 | Course Admin ; Era of Big Data Analytics | F2-3 | [Jlin]Ch1 ; [MMDS]Ch1 | - |
| 2 | Sept 12 | Computing as a Utility ; Data-center Architecture | M3-4 | - | [DataCenter] |
| **Sep 16: Public holiday: The day following the Chinese Mid-Autumn Festival (Fri)** | |||||
| 3 | Sept 19, 23 | MapReduce | M3-4, F2-3 | [MMDS]Ch2.1-2.4 ; [JLin]Ch2 | - |
| 4-5 | Sept 26, 30, Oct 2 | MapReduce (cont'd) ; The Big Data Processing stack | M3-4, F2-3, M3-4 | [JLin]Ch3.1-3.4 | [CloudData] |
| 5-6 | Oct 7, 14 | Frequent Item-Set Mining and Association Rules | F2-3, F2-3 | [MMDS]Ch6.1-6.4 | - |
| **Oct 10 Public holiday: The day following the Chung Yeung Festival (Mon)** | |||||
| 7 | Oct 17, 21 | Finding Similar Items and LSH | M3-4, F2-3 | [MMDS]Ch3.1-3.5 | [ZG] |
| 8 | Oct 24, 28 | Clustering and GMM | M3-4, F2-3 | [MMDS] Ch7.1-7.4, [CBishop] Ch.9, [MLE/MAP] | - | 9 | Oct 31, Nov 4 | Dimension Reduction; | M3-4, F2-3 | [MMDS] Ch11 | [PCA], [GuruswamiKannan] |
| **An in-class Mid-term will be held on Nov 4 (Fri)** | 10 | Nov 7, 11 | Recommendation Systems | M3-4, F2-3 | [SVDPCA], [ANgCS229PCA], [ShaliziADAEPV]Ch17 | - |
| **Instructor out of town for conference ; No Class for Week 11 (Nov 14-18) ; ** | |||||
| 12 | Nov 21 | Recommendation Systems (cont'd) ; Regression and Gradient Descent | M3-4 | [MMDS] Ch9 | [Netflix09]; [KorenTalk]; [ANg] |
| 12-13 | Nov. 25, 28, Dec 2 | Data Stream Algorithms | F2-3, M3-4, F2-3 | [MMDS] Ch4.1-4.5 ; | - |
| 14 | Dec 5 | Backup/ Overflow NOTE the Change of Venue to SHB 833 | M 2-4 | - | - |
Course Assessment
Your grade will be based on the following components:
- Homeworks & Programming assignments (4 sets in total): 50%
- Mid-term: 10%
- Final Exam: 40% (2-hour final examination)
Student/Faculty Expectations on Teaching and Learning
http://mobitec.ie.cuhk.edu.hk/StaffStudentExpectations.pdf
Academic Honesty
You are expected to do your own work and acknowledge the use of anyone else's words or ideas. You MUST put down in your submitted work the names of people with whom you have had discussions.
Refer to http://www.cuhk.edu.hk/policy/academichonesty for details
When scholastic dishonesty is suspected, the matter will be turned over to the University authority for action.
You MUST include the following signed statement in all of your submitted homework, project assignments and examinations. Submission without a signed statement will not be graded.
I declare that the assignment here submitted is original except for source material explicitly acknowledged, and that the same or related material has not been previously submitted for another course. I also acknowledge that I am aware of University policy and regulations on honesty in academic work, and of the disciplinary guidelines and procedures applicable to breaches of such policy and regulations, as contained in the website http://www.cuhk.edu.hk/policy/academichonesty/.
Windows Azure
Mirantis
Amazon EC2