scheduler - Scheduling job with Apache NiFi by passing dynamic property values -


i have created nifi workflow shown below: generateflowfile --> custom processor --> logattribute custom processor has property start date. start date should change in each scheduled run based on maximum end date previous run. looking incremental data fetch server.

could please help, how can achieved in apache nifi?

processor scheduling left data flow manager configuring processor flow. recommend let them schedule processor, expecting run on periodic basis.

but can use apache nifi's state manager feature store data tracks incremental progress. decide action take, if any, when processor triggered. if there nothing do, don't anything.

the best examples of list* processors listfile. these processors typically store timestamp of file last read, use timestamp determine newer files should acted on, regardless of how asked check. executions of list* processor result in no output.

there examples of reading , persisting state data in abstractlistprocessor class.


Comments

Popular posts from this blog

cookies - Yii2 Advanced - Share session between frontend and mainsite (duplicate of frontend for www) -

angular - password and confirm password field validation angular2 reactive forms -

php - Permission denied. Laravel linux server -