Course: Cloud Computing and Storage Class
Abstract
Course Objective and Description:
Using large-scale computing systems to solve data-intensive realworld problems has become indispensable for many scientific and engineering disciplines. This course provides a broad introduction to the fundamentals in cloud computing and storage, focusing on system architecture, programming models, algorithmic design, and application development. Selected scientific applications will be used as case studies.
Prerequisite: introduction to programming or data structures and algorithms (EEL4834 or equivalent), computer architecture (EEL5764 or equivalent), proficiency in Java, or instructor approval.
Textbook:
- Hadoop: The Definitive Guide (3rd Edition), Tom White, O'Reilly Media, 2012.
Other References:
- Many recent papers in leading conferences/journals will be discussed.
- Data-Intensive Text Processing with MapReduce, Jimmy Lin and Chris Dyer, 2010. (PDF version available online)
- Programming Amazon EC2, Jurg van Vliet and Flavia Paganelli, O'Reilly Media, 2011.
- Distributed and Cloud Computing: From Parallel Processing to the Internet of Things by Kai Hwang, Jack Dongarra & Geoffrey C. Fox, Morgan Kaufmann, 2011.
- The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, Luiz Andre Barros and Urs Hoelzle, Morgan and Claypool Publishers, 2009.
- The Grid: Blueprint for a New Computing Infrastructure (2nd Edition), Ian Foster, Carl Kesselman, Morgan Kaufmann/Elsevier, 2004.
- The Fourth Paradigm: Data-Intensive Scientific Discovery, Tony Hey, Stewart Tansley, and Kristine Tolle, Microsoft Research, 2009. (PDF version available online)
Course Homepage:
http://www.andyli.ece.ufl.edu/teaching/cloud
Course Outline (tentative):
- Introduction and Overview
- Programming Paradigms
- Introduction to Hadoop
- MapReduce Runtime Management
- Algorithm Design and Implementation in MapReduce
- Consistency and Coordination
- Key-Value Structured Storage
- Enhancements to Hadoop/MapReduce
- Distributed File Systems
- Case Study
Intellectual Merit
Novel approach teaching Cloud Computing and Storage in a programming-oriented approach. Some course projects may end up with novel ideas and publications.
Broader Impact
Currently 65 graduate students enrolled (could be more)
Use of FutureGrid
We have about 65 graduate students working on course projects. They will use FutureGrid to run mainly MapReduce related jobs and conduct performance analysis.
Scale Of Use
We have about 65 graduate students working on about 20 course projects. Most usage will be within 8 VMs, and some might be slightly more.
Futuregrid is a resource provider for