Given the unstructured nature of the source data and the need to stay agile, organizations must also be able to change their schemas dynamically (at read-time versus write-time). Apache Hadoop is an open-source distributed fault-tolerant system that leverages commodity hardware to achieve large-scale agile data storage and processing. In this presentation, Dr. Amr Awadallah will introduce the design principles behind Apache Hadoop and explain the architecture of its core sub-systems (the Hadoop Distributed File System and MapReduce).
Awadallah will also contrast Hadoop to relational database systems and illustrate how they truly complement each other. Finally, he will cover the Hadoop ecosystem at large, which includes a number of projects that together form a cohesive Data Operating System for the modern data center, and he will outline how this fits into existing data infrastructures.
