Difference between revisions of "Course: Big Data Analysis"

From VistrailsWiki
Jump to navigation Jump to search
Line 68: Line 68:


* Guest lecture by [http://cs.nyu.edu/shasha/ Dennis Shasha]:  Statistics and Big Data
* Guest lecture by [http://cs.nyu.edu/shasha/ Dennis Shasha]:  Statistics and Big Data
* Provenance and data exploration
* Pig Latin and Query Processing


=== Required Reading ===
=== Required Reading ===
* http://www.morganclaypool.com/doi/abs/10.2200/S00142ED1V01Y200807MAS001 -- book is available for free for NYU students  
* http://www.morganclaypool.com/doi/abs/10.2200/S00142ED1V01Y200807MAS001 -- book is available for free for NYU students  
* Second edition of the book: http://www.morganclaypool.com/doi/pdf/10.2200/S00295ED1V01Y201009MAS008


== Week 5: Monday Oct. 8st - Finding Similar Items ==
* Overview of information integration
* Provenance and data exploration
=== Required Reading ===
* [http://vgc.poly.edu/~juliana/pub/vistrails-reproducibility2012.pdf Making Computations and Publications Reproducible with VisTrails]
* [http://vgc.poly.edu/~juliana/pub/vistrails-reproducibility2012.pdf Making Computations and Publications Reproducible with VisTrails]
Juliana Freire and Claudio Silva. In Computing in Science and Engineering 14(4): 18-25, 2012.
Juliana Freire and Claudio Silva. In Computing in Science and Engineering 14(4): 18-25, 2012.
Line 79: Line 85:
Juliana Freire, David Koop, Emanuele Santos, and Claudio T. Silva. In IEEE Computing in Science & Engineering, 2008.
Juliana Freire, David Koop, Emanuele Santos, and Claudio T. Silva. In IEEE Computing in Science & Engineering, 2008.


== Week 5: Monday Oct. 8st - Finding Similar Items ==
 
* Overview of information integration


=== Readings ===
=== Readings ===

Revision as of 18:43, 30 September 2012

This schedule is tentative and subject to change

Make sure to check my.poly.edu for course announcements

Week 1: Monday Sept. 10th - Course Overview

Required Reading

Additional References

Week 2: Monday Sept. 17th - Map-Reduce

Required Reading

Additional References

Week 3: Monday Sept. 24th - Databases and Big Data

Related Topics

Required Reading

Additional Readings

Week 4: Monday Oct. 1st - Statistics is easy - Invited Speaker: Dennis Shasha

  • Guest lecture by Dennis Shasha: Statistics and Big Data
  • Pig Latin and Query Processing

Required Reading

Week 5: Monday Oct. 8st - Finding Similar Items

  • Overview of information integration
  • Provenance and data exploration

Required Reading

Juliana Freire and Claudio Silva. In Computing in Science and Engineering 14(4): 18-25, 2012.

Juliana Freire, David Koop, Emanuele Santos, and Claudio T. Silva. In IEEE Computing in Science & Engineering, 2008.


Readings

Week 6: Monday Oct. 15st - Invited Speaker: Torsten Suel

  • Reading: inverted index and crawling (Lin chapter 4)
  • Ask Torsten (tentative, ask him for reading material)

Readings

Week 7: Monday Oct. 22st - Invited Speakers: Claudio Silva and Lauro Lins

  • Introduction to Visualization; Data stewardship and provenance
  • Guest lecture by Claudio Silva and Lauro Lins

Readings

  • Hellerstein (ask Claudio for additional references)
  • ADD: provenance and reproducibility

Week 8: Monday Oct. 29th - Graph Analysis

  • Graph algorithms, link analysis, social networks

Readings

  • Data-Intensive Text Processing with MapReduce, Chapter 4


Week 9: Monday Nov. 5th - Frequent Itemsets

Reading

  • Mining of Massive Datasets, Chapter 6


Week 10: Monday Nov. 12th - Mining Data Streams =

Readings

  • Mining of Massive Datasets, Chapter 4


Week 11: Monday Nov. 19th - Clustering

Readings

  • Mining of Massive Datasets, Chapter 7

Week 12: Monday Nov. 26th - Recommendation Systems

Readings

  • Mining of Massive Datasets, Chapter 9

Week 13 Monday Dec. 3rd - EM algorithms for text processing

  • Data-Intensive Text Processing with MapReduce, Chapter 6

Week 14: Monday Dec. 10th - Project presentation

Further Readings