AI Chat Assistant
The AI Chat Assistant is your always-available testing companion inside ProvaLab.io. Instead of navigating through menus and filters, you can simply type what you need in plain English and get instant answers, reports, and actions.
Opening the Chat Panel
There are two ways to open the AI Chat Assistant:
- From the sidebar -- Click the AI Assistant icon in the left navigation menu.
- With a keyboard shortcut -- Press
Ctrl+K(Windows/Linux) orCmd+K(Mac) from anywhere in ProvaLab.io.
The chat panel opens on the right side of your screen. You can resize it by dragging the left edge, or expand it to full screen using the expand button in the top-right corner.
Asking Questions in Plain English
You do not need to learn any special syntax. Just type your question the way you would ask a teammate. Here are some examples to get you started:
Querying Test Results
"Show me test results for the last sprint"
"What is the pass rate for the Payment module this week?"
"Which tests failed in the staging environment yesterday?"
Finding Patterns and Issues
"What are the most common failures across all projects?"
"Are there any flaky tests in the Checkout module?"
"Which test cases have never been executed?"
Generating Reports
"Generate a test report for Project X"
"Give me a summary of test execution trends for the last 30 days"
"What is the test coverage for the Authentication module?"
Taking Actions
"Create a test run for all critical tests in staging"
"Which tests should I run for the login feature?"
"Show me all test cases tagged as 'regression' that failed recently"
Example Conversations
Here is what a typical conversation with the assistant looks like:
You: What are the top 5 failing test cases this week?
AI Assistant: Here are the top 5 failing test cases for this week:
| # | Test Case | Failures | Module |
|---|---|---|---|
| 1 | Verify checkout with expired credit card | 8 | Payments |
| 2 | User login with SSO redirect | 6 | Authentication |
| 3 | Search results pagination on mobile | 5 | Search |
| 4 | File upload exceeding 50MB limit | 4 | File Management |
| 5 | Password reset email delivery | 4 | Authentication |
The Payments and Authentication modules have the highest failure concentration. Would you like me to analyze the root causes for any of these?
You: Yes, analyze the checkout failure.
AI Assistant: The "Verify checkout with expired credit card" test has been failing since Tuesday. The error consistently occurs at the payment validation step with the message: PaymentGatewayTimeout: Connection to payment service timed out after 30s. This suggests an issue with the payment gateway integration in the staging environment rather than a bug in your application code. I recommend checking the payment gateway service health and network connectivity.
Project-Scoped vs. Global Chat
The AI Chat Assistant can work in two modes:
Project-Scoped Chat
When you open the assistant from within a project, it automatically focuses on that project's data. Questions like "What is the pass rate?" will return results for the current project only.
Global Chat
When you open the assistant from the main dashboard or navigation, it operates across all projects you have access to. This is useful for cross-project comparisons and organization-wide insights.
If you are in project-scoped mode and want to ask about a different project, just mention it by name: "What is the pass rate for the Mobile App project?"
Conversation History
Your conversations with the AI Assistant are saved automatically. To access previous conversations:
- Open the AI Chat Assistant.
- Click the History icon at the top of the chat panel.
- Browse or search your past conversations.
- Click any conversation to resume it.
Conversation history is private to your account. Team members cannot see your chat history.
Tips for Getting the Best Responses
Follow these guidelines to get the most out of the AI Assistant:
Be Specific About Time Ranges
Instead of "Show me recent failures," try "Show me failures from the last 7 days." The more specific you are, the more precise the response.
Mention the Project or Module
If you are in global mode, include the project or module name in your question: "What is the coverage for the Payments module in the E-Commerce project?"
Ask Follow-Up Questions
The assistant remembers the context of your conversation. After getting initial results, you can drill deeper: "Of those failures, which ones are flaky?" or "Show me the details for the third one."
Use Natural Phrasing
You do not need to use exact field names or technical terms. The assistant understands variations:
- "tests that keep failing" = flaky tests
- "how much is covered" = test coverage
- "what broke" = recent failures
If the assistant's response is not quite what you expected, try rephrasing your question with more context. For example, instead of "Show me results," say "Show me the test execution results for the Login module in the last sprint on the staging environment."
What the Assistant Can Do
| Category | Examples |
|---|---|
| Query data | Test results, pass rates, coverage, failure trends |
| Generate reports | Execution summaries, coverage reports, defect reports |
| Find issues | Flaky tests, common failures, untested areas |
| Take actions | Create test runs, search test cases, generate test cases |
| Provide insights | Risk assessment, optimization suggestions, trend analysis |
Keyboard Shortcuts
| Shortcut | Action |
|---|---|
Ctrl+K / Cmd+K | Open the AI Assistant |
Enter | Send your message |
Shift+Enter | Add a new line without sending |
Esc | Close the chat panel |