The playground lets you safely test your AI agent before deploying it with real customers. You can experiment with responses, test guidance, and ensure everything works correctly without affecting actual customer interactions.
What is the playground?
The playground is a simulation environment where you can chat with your AI agent using real customer data from your Shopify store. Test different scenarios, validate responses, and refine your AI agent's behavior before enabling it on live conversations.
You can find the playground by navigating to AI agent → Playground or simply clicking the Test button on other AI agent pages, which opens the playground on the side of the page.
Testing your AI agent
Chat directly Type questions and messages to see how your AI agent responds. Test various customer scenarios and language patterns to ensure appropriate responses.
Replay existing conversations Import previous customer interactions using the Replay button found below any customer message in your conversation history. This lets you test how your AI agent would handle real-world scenarios from your actual support tickets.
Select channels Choose which channel you want to simulate - email & DMs, chat, or social media comments. The AI agent will adapt its tone and response style according to the selected channel.
Select customers Pick specific customers to simulate by searching their name or email address. This is particularly useful for testing Shopify actions and order-related guidance, as you can select customers with recent orders to test realistic scenarios.
Simulated actions
Actions in the playground are simulated only - no actual changes are made to Shopify orders or conversations. This allows safe testing of order modifications, refunds, and other actions without affecting real customer data.
The AI agent will show you what actions it would perform, but your Shopify store and customer conversations remain unchanged.
Revising answers
When the AI agent provides incorrect information or poor responses in the playground, use the Revise answer feature to improve its knowledge.
How to revise answers:
-
Hover over any AI agent message in the playground
-
Click Revise answer
-
Provide the correct response you want the AI agent to give
-
Save the revision as an AI training response
This adds the corrected response to your knowledge library, helping the AI agent handle similar situations better in the future.
Managing AI knowledge
If you notice issues like repetitive canned responses or inappropriate knowledge sources, visit the Knowledge page. You can exclude or edit problematic knowledge sources to help your AI agent respond more naturally and effectively.
Regular testing in the playground helps identify knowledge gaps and ensures your AI agent provides consistent, accurate responses across all customer interactions.