CompletionStream method (NotesLLMRequest - LotusScript

Send a chat completion method request to a large language model (LLM) hosted by a DominoIQ and receive response in stream mode. Base on the notify event fired by DominoIQ server, user can start process response immediately.

Defined in

NotesLLMRequest

Parameters

SERVER$

String. The Domino Server IQ name that is needed to send the request. If empty, the request will be routed to the Domino IQ server configured to service the command.

COMMAND$

String. The name of a command document defined in the Domino IQ configuration database. The command document specifies a system prompt that guides the LLM behavior and responses.

userPROMPT$

String. The user prompt is the specific input given by the caller of this method. This prompt is merged with the system prompt defined in the command document and then presented to the language model through the Domino IQ server.

Example