Persisting Ingest changes (NiFi Registry)
This topic describes how to make changes to a specific pipe by changing its property/configuration across all connectors. For example, changing SQL statement for a processor, Execute SQL, in a pipe, DatabaseCategoryStage1b, across all connector in NiFi.
About this task
Procedure
-
Find the processor that you want to change.
Note: You can make only property/configuration changes and no logic change to the processor.
-
Find all the pipes in NiFi containing the processor that you want to change and
then make a list of
pipe.name
. -
Run the following command to navigate to NiFi Registry container/pod.
docker exec -it {registryContainer} bash
-
Run the following command to extract the pipe description JSON for the list of
pipe.name
created in Step 2.sh /opt/nifi-registry/scripts/export_flow.sh {pipe.name} > /opt/nifi-registry/{pipe.name}.json
- Open {pipe.name}.json and then search for the desired processor for editing and changing its property/configuration value.
-
Run the following command to import the updated pipe description JSON for the
list of
pipe.name
.sh /opt/nifi-registry/scripts/import_flow.sh {pipe.name} /opt/nifi-registry/{pipe.name}.json
-
Run the following command to exit out of the container and backup the updated
pipe description JSON.
docker cp {registryContainer}:/opt/nifi-registry/{pipe.name}.json {pipe.name}.json
- Using the following URL, check NiFi Registry to verify that these pipe description JSON (flow) have a new version defined.
-
Use any one of the following two ways (a or b) to update the pipes in NiFi with
a new version: