Security considerations for Domino IQ
When you use Domino IQ to integrate any AI solution, you must test that solution for performance, quality, and security (including for Domino's out of the box IQ features). For better security, your model should support paraphrasing capability, which Domino IQ leverages.
At the time of this release, artificial intelligence is a rapidly evolving area. Models are updated constantly as are the best practices for safely configuring, deploying, and using such models in production. Careful consideration must be given to which model to deploy and rigorous testing should be performed to ensure adequate performance, security, and functionality. All system prompts, including the ones shipped with Domino, should also be tested in the target environment with the chosen model, and adjustments made as required. Domino IQ implements paraphrasing of text as a way to improve the security of AI inputs and decrease the likelihood of abuse, and expanding this effort is planned for future releases. Support for paraphrasing is a requirement for the large language models used with Domino.
Paraphrasing
In 14.5, Domino IQ does paraphrasing of the text provided as user prompt/input in the NotesLLMRequest. This request is sent to the large language model (LLM) running on the AI inference engine, whether configured to be local or remote on the Domino IQ server. The output of the paraphrased user prompt is then sent as the input for the specified command in the NotesLLMRequest call.
It is important to make sure that the LLMs that you choose to run support the paraphrasing of text, both for built-in features such as mail summarization and reply and queries built for custom applications. At this time the only way to determine support is through testing. HCL has tested LLMs such as Phi4 and Llama 3.x and confirmed that they support paraphrasing, while noting that additional tuning of the system prompts might still be needed.
Paraphrasing adds additional overhead in request processing. It also increases the number of tokens used. This could exceed the configured token limits, which may need to be increased. The additional tokens may also impact requirements when using an external paid service. Depending on the commands executed and the data used as the input prompt, you can disable paraphrasing at the Domino IQ server level by setting the following notes.ini. In general this is not recommended because paraphrasing provides an additional element of security.
DOMIQ_DISABLE_PROMPT_PARAPHRASE=1
In 14.5, Domino IQ is enabled as a feature at the Domain level in the Domino Directory. There are no fine-grained policy controls to enable this for a subset of users or a group, or at an Organization level.