The playground lets you safely test your AI agent before deploying it with real customers. You can experiment with responses, test guidance, and ensure everything works correctly without affecting actual customer interactions.
What is the playground?
The playground is a simulation environment where you can chat with your AI agent using real customer data from your Shopify store. Test different scenarios, validate responses, and refine your AI agent's behavior before enabling it on live conversations.
You can find the playground by navigating to AI agent → Playground or simply clicking the Test button on other AI agent pages, which opens the playground on the side of the page.
Good to know: AI agent can't access real customers order data unless you a) simulate them or b) replay an existing conversation with the contact.
Testing your AI agent
Chat directly
Type questions and messages to see how your AI agent responds. Test various customer scenarios and language patterns to ensure appropriate responses.
Replay existing conversations
Import previous customer interactions using the Test button found below any customer message in your conversation history. This lets you test how your AI agent would handle real-world scenarios with real order data from your actual support tickets.
Select channel
Choose which channel you want to simulate - email & DMs, chat, or social media comments. The AI agent will adapt its tone and response style according to the selected channel.
Simulate customers
Pick specific customers to simulate by searching their name or email address. This is useful for testing Shopify actions and order-related guidance, as you can select customers with recent orders to use their order data for testing.
Simulated actions
Actions in the playground are simulated only - no actual changes are made to Shopify orders or conversations. This allows safe testing of order modifications, refunds, and other actions without affecting real customer data.
The AI agent will show you what actions it would perform, but your Shopify store and customer conversations remain unchanged.
Managing AI knowledge
If you notice issues like repetitive canned responses or inappropriate knowledge sources, visit the Knowledge page. You can exclude or edit problematic knowledge sources to help your AI agent respond more naturally and effectively.
Regular testing in the playground helps identify knowledge gaps and ensures your AI agent provides consistent, accurate responses across all customer interactions.