LLM Node
The LLM Node processes incoming text prompts and generates responses using a local or specified language model. It enables integration of AI-powered conversational or generative text capabilities within your application, without relying on external APIs.
| Number of inputs | 0 |
| Number of outputs | 0 |
Configuration​
prompt (Optional)​
Type: String
A text prompt that guides the behavior of the LLM when generating responses. This can be used to set the context, style, or instructions for the AI's replies. If omitted, a default prompt will be used.
modelPath (Optional)​
Type: String
The initial model to load in the LLM node. Only used when initializeModel is set to true.
initializeModel (Optional)​
Type: Bool
When set the LLM not will initialize the model when it is created. Default value is false.
Values​
Inherits values from its parent, Node.
Actions​
Inherits actions from its parent, Node.
loadModel​
Loads an LLM model.
Parameters​
| Name | Type | Description |
|---|---|---|
| modelPath | String | The file path of the model file. |
setInput​
Sends a request to the LLM model with the given text.
Parameters​
| Name | Type | Description |
|---|---|---|
| text | String | The text to send to the LLM model. |
Events​
Inherits events from its parent, Node.
response​
Emitted when the LLM model responds.
Data​
| Name | Type | Description |
|---|---|---|
| text | String | The text to received from the LLM model. |