Configure an LLM Configuration Template

Updated 

LLM Configuration Templates let you create reusable configurations for Large Language Models (LLMs). These templates help standardize settings such as model selection, prompt parameters, guardrails, and PII masking across supported workflows.

Before you begin, ensure that:

  • The AI+ Studio module is enabled.
  • You have the required permissions to access AI+ Studio.

Steps to Add the LLM Configuration Menu

  1. Click the New Tab icon.
  2. Under Platform Modules, select All Settings within Listen.
  3. Under Manage Customer, select Persona App Manager.
  4. Do one of the following:

    • Click Create to create a new Persona App.
    • Open an existing Persona App to edit it.
  5. If creating a new Persona App:

    • Enter a Label.
    • Select Sprinklr Service as the Product Suite.
    • Click Next
  6. In the Persona App, click the Add icon and add LLM Configuration as a menu item.

Steps to Create an LLM Configuration Template

  1. Open the Persona App that contains the LLM Configuration menu.
  2. In the left pane, click LLM Configuration.
  3. Click Create.
  4. Enter a Name for the template.
  5. Select the required Provider and Model.
  6. (Optional) Enable Additional Settings to configure model hyperparameters directly from the UI.
  7. Click Save.

The LLM Configuration Template is created and available for use.

Note: LLM Configuration Templates are supported only for Dynamic Workflow.

Steps to Apply an LLM Configuration Template

  1. Open the application where the template is required.
  2. Navigate to Additional Settings.
  3. Under LLM Configuration, select the template you created.
  4. Click Save.