Incremental loads use an internal value to track the latest row received.
This feature enables you to reset incremental load control values, allowing a load to be rerun even after it succeeds. One driver for this feature is detection of a source system error that does not affect the running of a load, but does affect the data content of the load.
The “ajilius” schema of your data warehouse contains a table named “ajilius_control”. This table holds one row for each column for which incremental values are tracked, and a “previous” and “latest” value.
On successfully processing a load, we update the “previous” value with the contents of the “latest” value (that was used to process the load), and over-write the “latest” value with the maximum column value from the load.
When select a menu option Deploy | Reset Controls, the following screen is shown:
When you press the Reset button, the control values of any checked table will be reset to their previous state. This enables the incremental load to be repeated.