Project

General

Profile

Actions
Copy link

Activity #3716

open

Module #3693: Big Data Analytics Platform and Tools for Epidemic Forecasting and Mitigation

Module #3696: Center for Epidemic Forecsting(EPIFORM)

Module #3704: Technology Exploration

Use NiFi to ingest CSV files from SFTP

Added by Thara S Pillai about 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
Sreeshna T
Start date:
05/30/2025
Due date:
% Done:

100%

Estimated time:
Planned Due Date:
06/04/2025

Description

  • Setup an SFTP server to serve files
  • Use NiFi processor to read from this server
  • Validate schema using ValidateCsv or custom processor.
  • Route invalid files separately to a network folder
Actions
Copy link

Also available in: Atom PDF