
Explore the big data landscape, its huge volume, high velocity, and varied formats, and see how analytics, data storage, and predictive analytics enable smarter decisions across industries.
Trace the history of big data—from defining high volume, velocity, variety, and veracity to evolving architectures like map reduce and Hadoop that enable real-time, distributed data processing.
Explore the big data technologies and ecosystem, including machine learning, natural language processing, business intelligence, cloud computing, and distributed databases, to enable accurate analysis and better decision making.
Explore the five big data characteristics—volume, velocity, variety, veracity, and value—and how cognitive big data, advanced analytics, and cloud computing enable real-time, contextual insights.
Explore how big data applications drive cost savings, productivity, and innovation across manufacturing, healthcare, education, and media, enabling predictive tools and personalized medication for future planning.
Discover how a data lake acts as a centralized, scalable store for all data types, enabling dashboards, analytics, and machine learning with Hadoop and Spark.
Explore data science as an interdisciplinary field applying statistics, machine learning, and data mining to collect, clean, analyze data, and build predictive models for big data decisions.
Discover how the Hadoop open source framework stores and processes big data in distributed clusters, using a scalable distributed file system and the MapReduce processing model.
Explore hdfs overview, a distributed file system inspired by google file system, designed for commodity hardware with high throughput and reliability, using name nodes, data nodes, blocks, and replication.
Explore the Hadoop architecture, including the master–slave NameNode and DataNodes, HDFS storage, and MapReduce with YARN for resource management and fault tolerance.
Explore the Hadoop architecture with assumptions and goals for large-scale data handling, emphasizing high-throughput batch processing, fault tolerance, data locality, and a scalable distributed file system for massive files.
Learn how to install and verify Hadoop on Linux; download a stable release, verify integrity with signatures, install Java, and run in local standalone, pseudo distributed, or fully distributed modes.
Install and configure Hadoop by verifying the release, setting JAVA_HOME and HADOOP_HOME, enabling SSH passwordless login, and starting a standalone or pseudo-distributed cluster.
Access Hadoop
The NameNode and DataNode are pieces of software designed to run on
commodity machines. These machines typically run a GNU/Linux operating
system (OS).
This course is focusing on Big data and Hadoop technologies, hands on demos,
Section 1 - Big data
1.1 Big data introduction
1.2 Big data history
1.3 Big data technologies
1.4 Big data characteristics
1.5 Big data Applications
1.6 Data Lake
1.7 Data Science and Data scientist
Section 2 - Hadoop
2.1 - Hadoop introduction
2.2 - HDFS-Overview
2.3 - Hadoop Architecture
2.3a - Hadoop Architecture - assumptions and goals
2.4 - Demo-Hadoop install - sw download verify integrity
2.5 - Demo-Hadoop install - Java ssh configure
2.6 - Demo hadoop access by browser