Actions
Activity #3879
openModule #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation
Module #3696: Center for Epidemic Forecsting(EPIFORM)
Module #3704: Technology Exploration
Sub module #3873: Data Mapping and Harmonization for Delta Lake Consolidation
Mapping and Transformation in Silver Layer
Start date:
07/07/2025
Due date:
% Done:
0%
Estimated time:
Planned Due Date:
07/08/2025
Description
- Normalize key fields (e.g., lowercase district_name, different names used for districts unify date formats)
- Join with dim_district to get district_id for each row
- Create silver_disease, silver_weather, etc., with district_id and cleaned data
- Add data validation steps (e.g., unmatched districts, nulls)
No data to display
Actions