Project

General

Profile

Actions
Copy link

Activity #3711

open

Module #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation

Module #3696: Center for Epidemic Forecsting(EPIFORM)

Module #3704: Technology Exploration

Explore - Delta Lake data read from multiple files with filtering

Added by Thara S Pillai about 1 year ago. Updated about 1 year ago.

Status:
New
Priority:
Normal
Assignee:
Sreeshna T
Start date:
03/27/2025
Due date:
% Done:

0%

Estimated time:
Planned Due Date:
06/24/2025
Actions
Copy link
 #1

Updated by Thara S Pillai about 1 year ago

  • Tracker changed from Module to Activity
Actions
Copy link
 #2

Updated by Thara S Pillai about 1 year ago

  • Assignee set to Sreeshna T
Actions
Copy link
 #3

Updated by Thara S Pillai about 1 year ago

  • Planned Due Date changed from 03/28/2025 to 06/24/2025
  • Read multiple IDSP (Integrated Disease Surveillance Programme) files from a remotely hosted HDFS-backed Delta Lake.
  • Query the Delta Lake's Parquet files to retrieve confirmed and suspected case counts for all dates and a selected disease.
  • Expose the queried results via Python FastAPI services for integration with visualization dashboards.
Actions
Copy link

Also available in: Atom PDF