Troubleshooting: Numerous NiFi "unable to write flowfile" messages
After deploying Version 9.1.14 updates, a large number of NiFi
interface warnings are generated, stating that the system is unable to write flowfile contents due to archive file size constraints
.
This issue can be resolved by changing the
nifi.content.repository.archive.max.usage.percentage property in the
nifi.properties file or setting it as an environment variable in
the NiFi container.
Problem
Unable to write flowfile contents to content repository container default due to
archive file size constraints, waiting for archive cleanup.
Solution
NIFI_CONTENT_REPOSITORY_ARCHIVE_MAX_USAGE_PERCENTAGE: "90%"
in
the container.Allocate at least 200 GB of disk space to virtual memory, and preferably 400GB in production environments.
The optimal percentage for performance purposes is highly deployment-specific. You may be able to operate efficiently with the environment variable set as low as 10% to 30%.