Configure AI Prompt for Copilot for Agents KB Query Extraction

You can use NiCE CXone GenAI Prompts to control the prompt that Copilot for Agents uses to perform KB query extraction. This lets you guide how Copilot for Agents interprets the conversation and formulates knowledge base search queries, including the level of detail, language, and any special instructions you want applied.

Once you have completed your prompt configuration, you can import or enter up to five transcripts to test the settings against. Copilot for Agents uses your custom prompt to extract KB queries from each transcript so you can preview how well the configuration surfaces the right intents and topics.

If you are not satisfied with the queries generated in the test, you can continue to refine your settings and prompt instructions until you are satisfied. After that, you can publish the prompt to make it available for selection within the Copilot for Agents profile on the Copilot for Agents Config page.

All users can now open the LLM Model dropdown. Users with an Prompt Editor Advanced license can select any model in the list; other users are limited to standard models. The list itself is grouped by standard and premium models, with models verified by NiCE CXone shown first and the rest listed alphabetically.

NiCE Default is available as an LLM Model option. It represents the model NiCE CXone currently recommends for that specific prompt type. If a prompt template only supports one model, NiCE Default is the only option shown and the dropdown is disabled. If a template supports multiple models, NiCE Default appears alongside them as a selectable choice.

If the LLM model currently selected for a profile is scheduled for retirement, NiCE CXone displays a warning next to the LLM Model dropdown stating that the model will retire in a set number of days and prompting you to update to a supported model.

When a model you use is closer to its retirement date, NiCE CXone also displays an LLM Update dialog when you open the affected profile. The dialog states the date the model switches to retention mode, after which the model is no longer accessible, and reminds you to update the LLM and test and publish all affected profiles before that date. Select Don't show this message again to suppress the dialog for that profile, or click OK to close it.

If a model reaches its retirement date and you have not selected a different model, NiCE CXone automatically switches the profile to NiCE Default. Test and publish the profile after this switch to confirm the output still meets your requirements.

Launch GenAI Prompts

1. Click the app selector .

2. Under General, select AI Studio.

3. In the AI Studio left navigation, select GenAI Prompts.

Create Prompt Profile

Required permissions: GenAI Prompts, Prompt Access Edit

You will also need a license for NiCE CXone Copilot for Agents and the KB Query Extraction feature enabled.

Each flow comes with one default profile. You can create a custom prompt profile either by using a blank form or by copying an existing prompt and making edits. As you're working in the profile, it automatically saves for you only. Others cannot see the new profile, or edits you're making to an existing profile, until you click Publish Prompt. Profiles are also unavailable to select as the live prompt until they have been published.

1. In the Profiles tree expand Copilot for Agents > KB Query Extraction.

2. Create a new profile. You can do this in one of two ways: 

   1. Create a new, blank profile. To do so, click the plus icon next to the KB Query Extraction folder. The new profile appears at the bottom of the list.

   2. Duplicate an existing profile.  

      1. Click the stacked dots icon next to the existing profile you want to copy and select Duplicate.

      2. Rename the copy by locating it at the bottom of the KB Query Extraction profiles, clicking the stacked dots icon , and selecting Rename. Enter the new name for the profile and click the check mark to save it.

3. On the Prompt Configuration tab, adjust the values for these fields as needed:

   • What is the reasoning language?

   • What is the query language?

   • What is the tenant terminology and context?

   • What knowledge base scope?

   Learn more about fields in this step

   Field	Details
   Reasoning Language	Specifies the language used by the model to analyze the conversation and identify intent and key concepts. This setting affects internal reasoning only and does not control the language of the retrieved articles or generated responses. It is recommended to choose the primary language used in customer or agent conversations.
   Query Language	Defines the language in which extracted queries are formulated before being submitted to the Knowledge Base. This setting determines which articles are most relevant during retrieval. It is recommended to align this language with the language used to author Knowledge Base content.
   Tenant terminology and context, also called tenant details	Supplies tenant-specific language, acronyms, and contextual information that the model uses when forming Knowledge Base queries. Tenant details help normalize domain terms and reduce ambiguity during query extraction. It is recommended to use product names, feature names, internal acronyms, abbreviations, brand-specific, or industry-specific terminology.
   Knowledge base scope	Controls which Knowledge Base sources are searched when executing extracted queries. Restricting the scope improves relevance by limiting results to applicable content. It is recommended to select only the Knowledge Bases required for this prompt’s use case. Broader scopes increase coverage but may reduce relevance.

4. Click Publish Prompt.

Add Transcripts for Testing

Required permissions: Launch GenAI Prompts, Prompt Access Edit

Import a Transcript

1. Click the Transcripts tab.

2. Under the Transcript Options area, in the Type of Transcript File field, select Segment.

3. Enter the segment ID of the transcript you want to use in the What are the segment IDs for the transcripts? text box. Click the add button. The new transcript appears in the table below the text box.

4. Click the paper and pencil icon to view and edit the imported transcript. The transcript shows dialog from the agent in purple and the contact in blue.

5. Modify the transcript as needed. You can take any of the following actions: 

   • Click + Agent Phrase or + Client Phrase at the top of the window to add a new dialog box of a certain type. The new agent or contact dialog box appears at the bottom of the transcript. Enter the dialog for the role you selected.

   • Add another dialog box of the same type (agent or client) by selecting the box above where you want the new box and clicking the add dialog box icon . The new box appears below the box you selected. Enter the dialog you want and then click the save icon .

   • Edit a dialog box by selecting the box you want to change and clicking the pencil icon . Make the changes you need and then click the save icon .

   • Move dialog boxes higher or lower in the transcript by selecting the box and clicking the up icon or the down icon until the box is where you want it.

   • Delete a dialog box by selecting the box and clicking the trash can icon .

   • Remove all dialog by clicking Clear in the top right corner of the window.

6. Continue to add agent and contact dialog until you have completed the transcript.

7. Click the Back to Transcript List icon to return to the table of transcripts.

8. Continue adding the transcripts you want to test. Testing the prompt will use all of the transcripts you have included in the table.

Manually Enter a Transcript

1. Click the Transcripts tab.

2. For the Type of Transcript File field, select New Transcript.

3. Click Create New Transcript. A new transcript appears in the table below.

4. Click the paper and pencil icon .

5. Modify the new transcript by using the following actions as needed:

   • Click + Agent Phrase or + Client Phrase at the top of the window to add a new dialog box of a certain type. The new agent or contact dialog box appears at the bottom of the transcript. Enter the dialog for the role you selected.

   • Add another dialog box of the same type (agent or client) by selecting the box above where you want the new box and clicking the add dialog box icon . The new box appears below the box you selected. Enter the dialog you want and then click the save icon .

   • Edit a dialog box by selecting the box you want to change and clicking the pencil icon . Make the changes you need and then click the save icon .

   • Move dialog boxes higher or lower in the transcript by selecting the box and clicking the up icon or the down icon until the box is where you want it.

   • Delete a dialog box by selecting the box and clicking the trash can icon .

   • Remove all dialog by clicking Clear in the top right corner of the window.

6. Continue to add agent and contact dialog until you have completed the transcript.

7. Click the Back to Transcript List icon to return to the table of transcripts.

8. Continue adding the transcripts you want to test. Testing the prompt will use all of the transcripts you have included in the table.

Test and Publish the Prompt

Required permissions: Launch GenAI Prompts, Prompt Access Edit

After you have configured the prompt settings and added a transcript, you can test your prompt with that transcript. This will help you see what the AI-generated text looks like and gives you a chance to refine your settings. Publishing the prompt makes it available both for others to see and for selection in Copilot for Agents profiles.

1. When you are happy with your transcript, click Test Response.

2. Review the response generated for the customized prompt and transcript you provided. If you are not satisfied with the result, adjust the prompt configuration settings and try again. Continue testing and refining your settings until the extracted queries return the expected Knowledge Base results.

3. Click Publish Prompt.

Select the Prompt in Copilot for Agents

Once you have published the prompt profile, you can select it in the Copilot for Agents Config page profile.

1. Click the app selector and select General.
2. From the left menu, navigate to AI Studio > Profiles.
3. From the list of Copilot profiles on the left, select the Copilot for Agents profile you want to apply the KB Query Extraction prompt profile to. If you don't have one yet, click Add Copilot Profile and follow these instructions to create one.
4. On the Knowledge tab, scroll down to the CXone Knowledge Settings section and from the KB Query Extraction Promptdrop-down, select the prompt profile you want to use.
5. Click Save.