Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation

1. Understanding Big Data Concepts

Studied the characteristics of Big Data
Explored challenges in traditional data processing systems and the need for scalable, distributed frameworks.
Learned about real-world applications of Big Data in healthcare, finance, transport, social media, and research.

2. Big Data Ecosystem Overview

Familiarized with components of the Big Data ecosystem:
Data Storage: HDFS, NoSQL (HBase, Cassandra)
Data Processing: MapReduce, Spark, Flink
Data Ingestion: Apache NiFi, Sqoop, Kafka
Workflow Orchestration: Oozie, Airflow
Data Querying: Hive, Impala, Presto
Data Lakes: Delta Lake, Iceberg, Apache Hudi
Identified the role and integration of each component in a complete data pipeline.