Skip to main content

AI Chat Assistant

The AI Chat Assistant is your always-available testing companion inside ProvaLab.io. Instead of navigating through menus and filters, you can simply type what you need in plain English and get instant answers, reports, and actions.

Opening the Chat Panel

There are two ways to open the AI Chat Assistant:

  1. From the sidebar -- Click the AI Assistant icon in the left navigation menu.
  2. With a keyboard shortcut -- Press Ctrl+K (Windows/Linux) or Cmd+K (Mac) from anywhere in ProvaLab.io.

The chat panel opens on the right side of your screen. You can resize it by dragging the left edge, or expand it to full screen using the expand button in the top-right corner.

Asking Questions in Plain English

You do not need to learn any special syntax. Just type your question the way you would ask a teammate. Here are some examples to get you started:

Querying Test Results

"Show me test results for the last sprint"

"What is the pass rate for the Payment module this week?"

"Which tests failed in the staging environment yesterday?"

Finding Patterns and Issues

"What are the most common failures across all projects?"

"Are there any flaky tests in the Checkout module?"

"Which test cases have never been executed?"

Generating Reports

"Generate a test report for Project X"

"Give me a summary of test execution trends for the last 30 days"

"What is the test coverage for the Authentication module?"

Taking Actions

"Create a test run for all critical tests in staging"

"Which tests should I run for the login feature?"

"Show me all test cases tagged as 'regression' that failed recently"

Example Conversations

Here is what a typical conversation with the assistant looks like:


You: What are the top 5 failing test cases this week?

AI Assistant: Here are the top 5 failing test cases for this week:

#Test CaseFailuresModule
1Verify checkout with expired credit card8Payments
2User login with SSO redirect6Authentication
3Search results pagination on mobile5Search
4File upload exceeding 50MB limit4File Management
5Password reset email delivery4Authentication

The Payments and Authentication modules have the highest failure concentration. Would you like me to analyze the root causes for any of these?


You: Yes, analyze the checkout failure.

AI Assistant: The "Verify checkout with expired credit card" test has been failing since Tuesday. The error consistently occurs at the payment validation step with the message: PaymentGatewayTimeout: Connection to payment service timed out after 30s. This suggests an issue with the payment gateway integration in the staging environment rather than a bug in your application code. I recommend checking the payment gateway service health and network connectivity.


Project-Scoped vs. Global Chat

The AI Chat Assistant can work in two modes:

Project-Scoped Chat

When you open the assistant from within a project, it automatically focuses on that project's data. Questions like "What is the pass rate?" will return results for the current project only.

Global Chat

When you open the assistant from the main dashboard or navigation, it operates across all projects you have access to. This is useful for cross-project comparisons and organization-wide insights.

tip

If you are in project-scoped mode and want to ask about a different project, just mention it by name: "What is the pass rate for the Mobile App project?"

Conversation History

Your conversations with the AI Assistant are saved automatically. To access previous conversations:

  1. Open the AI Chat Assistant.
  2. Click the History icon at the top of the chat panel.
  3. Browse or search your past conversations.
  4. Click any conversation to resume it.

Conversation history is private to your account. Team members cannot see your chat history.

Tips for Getting the Best Responses

Follow these guidelines to get the most out of the AI Assistant:

Be Specific About Time Ranges

Instead of "Show me recent failures," try "Show me failures from the last 7 days." The more specific you are, the more precise the response.

Mention the Project or Module

If you are in global mode, include the project or module name in your question: "What is the coverage for the Payments module in the E-Commerce project?"

Ask Follow-Up Questions

The assistant remembers the context of your conversation. After getting initial results, you can drill deeper: "Of those failures, which ones are flaky?" or "Show me the details for the third one."

Use Natural Phrasing

You do not need to use exact field names or technical terms. The assistant understands variations:

  • "tests that keep failing" = flaky tests
  • "how much is covered" = test coverage
  • "what broke" = recent failures
tip

If the assistant's response is not quite what you expected, try rephrasing your question with more context. For example, instead of "Show me results," say "Show me the test execution results for the Login module in the last sprint on the staging environment."

What the Assistant Can Do

CategoryExamples
Query dataTest results, pass rates, coverage, failure trends
Generate reportsExecution summaries, coverage reports, defect reports
Find issuesFlaky tests, common failures, untested areas
Take actionsCreate test runs, search test cases, generate test cases
Provide insightsRisk assessment, optimization suggestions, trend analysis

Keyboard Shortcuts

ShortcutAction
Ctrl+K / Cmd+KOpen the AI Assistant
EnterSend your message
Shift+EnterAdd a new line without sending
EscClose the chat panel