Project

General

Profile

Actions

Activity #3738

open

Module #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation

Module #3696: Center for Epidemic Forecsting(EPIFORM)

Hands-On Hadoop Configuration, Monitoring and Management

Added by Prasidh J S about 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
Start date:
02/11/2025
Due date:
% Done:

100%

Estimated time:
Planned Due Date:

Description

Installed and configured Hadoop 3.4 on a multi-node cluster:
Single Node (pseudo-distributed) setup for initial testing.
Multi-Node (fully distributed) setup for production-like environment.

Configured important files:
core-site.xml, hdfs-site.xml, yarn-site.xml, mapred-site.xml

Enabled SSH key-based login between nodes for cluster operations.

Practiced key HDFS commands:
Uploading/downloading files.
Directory operations (mkdir, rm, chmod).

Checking block distribution and replication.

Monitoring and Management
Used Hadoop Web UI to monitor:
Cluster health.
DataNode status.
HDFS usage and NameNode logs.

Learned basic troubleshooting techniques by analyzing logs and fixing configuration errors.

Actions #1

Updated by Prasidh J S about 1 year ago

  • Subject changed from Hands-On Hadoop Configuration to Hands-On Hadoop Configuration, Monitoring and Management
Actions #2

Updated by Prasidh J S about 1 year ago

  • Status changed from New to Closed
Actions #3

Updated by Prasidh J S about 1 year ago

  • Status changed from Closed to New
Actions #4

Updated by Prasidh J S about 1 year ago

  • Status changed from New to Resolved
Actions #5

Updated by Prasidh J S about 1 year ago

  • Due date deleted (03/01/2025)
Actions

Also available in: Atom PDF