Administrative Information
| Title | Hadoop-based technologies |
| Duration | 60 |
| Module | B |
| Lesson Type | Practical |
| Focus | Practical - Organisational AI |
| Topic | Hadoop |
Keywords
Map Reduce,Hadoop Framework,
Learning Goals
- To know the fundamentals of Map Reduce programming paradigm
- To know how to setup Hadoop Framework
- To know how to apply the Map Reduce functionalities
- To know how to program in Python with library of Map Reduce
Expected Preparation
Learning Events to be Completed Before
Obligatory for Students
None.
Optional for Students
None.
References and background for students
Recommended for Teachers
Lesson materials
Instructions for Teachers
The following outline should be followed:
- Introduction to Hadoop
- Hadoop Functionalities
- Map Reduce Operation
- Data Processing
- Data Locality
- Dataset description and preparation
- Adult Dataset preparation
- Hadoop SetUp and Configuration
- Hadoop Installation
- Hadoop Configuration
- Map and Reduce Instructions
- ML pipeline made with Kubeflow
- Library of Map/Reduce in Python
- Google Colab of Map / Reduce Library
Time schedule
| Duration (min) | Description | Concepts | Activity | Material |
|---|---|---|---|---|
| 5 | Introduction to Hadoop | Introduction to Hadoop | Lecture | Tutorial |
| 10 | Usage of Hadoop Functionalities | Features of Hadoop | Laboratory | Tutorial |
| 5 | Dataset description and preparation | Adult Dataset preparation | Laboratory | Tutorial |
| 10 | Hadoop SetUp | Hadoop Installation | Laboratory | Tutorial |
| 15 | Map and Reduce Instructions | Hadoop Programming Script | Running Example | Hadoop Script |
| 15 | Library of Map/Reduce in Python | Hadoop Functionalities in Python | Running Example | Google Colab |
Acknowledgements
The Human-Centered AI Masters programme was Co-Financed by the Connecting Europe Facility of the European Union Under Grant №CEF-TC-2020-1 Digital Skills 2020-EU-IA-0068.