Adding an LLM Command document
You use an LLM Command document to specify which server or servers support the LLM system prompt that you want. LLM system prompts are defined in LLM System Prompt documents.
Procedure
- From the Domino Administrator client, open the Domino IQ database, dominoiq.nsf, on the Domino IQ Administration server.
- From the Commands view, click Add Command.
-
On the Basic tab, complete the following fields.
Table 1. LLM Command fields Field Action Configuration(s) Enter the name of a single server or enter a wildcard (*) to indicate that the specified command is available to be used by all Domino IQ servers defined in the Domino Directory Profile). document. Model Optional field used for the remote AI endpoint . Command Enter the name of the system prompt that you want, which you can obtain from the System Prompt document in this database. Note: You can use the system prompt StdSummarizeEmailThread that is built-in in Domino IQ.Description Enter a short description of what the command does. System prompt Enter the same name used in the Command field. Maximum tokens Enter a value as specified in the Chat Completion Request OpenAI spec. Temperature Enter a value as specified in the Chat Completion Request OpenAI spec. Sample LLM command document
-
Save the document.
Domino IQ caches the contents in Command, System Prompt, and configuration documents for up to 5 minutes , using the cached entries to process incoming LLM requests. Any changes to these documents will automatically be picked up by the first LLM request after the cache expiration period.
Changes to a Configuration document that affect the launch of a local AI inference engine require a Domino server restart.