scheduler - Scheduling job with Apache NiFi by passing dynamic property values -


i have created nifi workflow shown below: generateflowfile --> custom processor --> logattribute custom processor has property start date. start date should change in each scheduled run based on maximum end date previous run. looking incremental data fetch server.

could please help, how can achieved in apache nifi?

processor scheduling left data flow manager configuring processor flow. recommend let them schedule processor, expecting run on periodic basis.

but can use apache nifi's state manager feature store data tracks incremental progress. decide action take, if any, when processor triggered. if there nothing do, don't anything.

the best examples of list* processors listfile. these processors typically store timestamp of file last read, use timestamp determine newer files should acted on, regardless of how asked check. executions of list* processor result in no output.

there examples of reading , persisting state data in abstractlistprocessor class.


Comments

Popular posts from this blog

php - Permission denied. Laravel linux server -

google bigquery - Delta between query execution time and Java query call to finish -

python - Pandas two dataframes multiplication? -