Actions
Activity #3735
closedModule #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation
Module #3696: Center for Epidemic Forecsting(EPIFORM)
Module #3704: Technology Exploration
Demonstrate Delta lake - scheme enforcement/evolution
Start date:
06/11/2025
Due date:
% Done:
100%
Estimated time:
Planned Due Date:
06/16/2025
Description
Ingest a data csv.
Develop a Rest API using python pySpark API/sparkSQL and Fast API framework to read data from the delta lake.
Create the csv with addition/deletion of columns
Ingets the modified data csv.
Run REST API using jMeter to demonstrate scheme enforcement/evolution works https://www.databricks.com/blog/2019/09/24/diving-into-delta-lake-schema-enforcement-evolution.html
Actions