Activity #3738
openModule #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation
Module #3696: Center for Epidemic Forecsting(EPIFORM)
Hands-On Hadoop Configuration, Monitoring and Management
100%
Description
Installed and configured Hadoop 3.4 on a multi-node cluster:
Single Node (pseudo-distributed) setup for initial testing.
Multi-Node (fully distributed) setup for production-like environment.
Configured important files:
core-site.xml, hdfs-site.xml, yarn-site.xml, mapred-site.xml
Enabled SSH key-based login between nodes for cluster operations.
Practiced key HDFS commands:
Uploading/downloading files.
Directory operations (mkdir, rm, chmod).
Checking block distribution and replication.
Monitoring and Management
Used Hadoop Web UI to monitor:
Cluster health.
DataNode status.
HDFS usage and NameNode logs.
Learned basic troubleshooting techniques by analyzing logs and fixing configuration errors.
Updated by Prasidh J S about 1 year ago
- Subject changed from Hands-On Hadoop Configuration to Hands-On Hadoop Configuration, Monitoring and Management