I create the Cumulative aggregation and I see in the guide that:
"To use the cumulative aggregation it is mandatory to configure the check point in pipeline from pipeline definition."
How can we configure the check point ?
When you hit save button of pipeline, "Pipeline Definition" pop up is invoked. Expand the +More button and set "Enable Check Point" true and set the "Check Point Directory" path as below screen shot
I followed your suggestion but I can't change the filed "Enable Check Point" from "FALSE" to "TRUE", it's deactivated.
Your pipeline is in running mode, thats why options are disabled, kindly stop, edit and save the pipeline and run.
it works. I will try and let you know if I have a problem.
I created cumulative aggregation as below:
the filter's configuration:
and the cumulative's configuration is:
When inspect pipeline, I get the error:
what's is '/path_to_dir/ in my case ?
It's a path used by pipeline to run, it can be any random path like /hieuiph1 please update the path in case of re run.
thanks. you mean that we must update the path in 'pipeline definition' when we would like to re run inspect pipeline ?
In case of inspect it will ask for its own check point directory if inspect require it.you don't need to update check point directory in pipeline definition.
so what case we have to set different "Check Point Directory" path with each run. ?
In case you are running a pipeline:If you set the checkpoint directory, you need to update checkpoint directory for every consecutive run.
In case you are inspecting a pipeline:The checkpoint option will automatically appear on 'Inspect Definition' if you are using cumulative aggregation processor or TransformByKey with updateStateByKey function.Please update it for every consecutive run.