Skip to main content

Managing Incidents

Use this guide to manage incidents from the dashboard through to resolution.

Incident Dashboard

The Incident Dashboard gives a real-time overview of incident health. It lists open incidents in groups to help you triage many failures at once, and it lists the individual incidents behind each group. Incident Manager dashboard with the summary metrics, the filters, and the incident groups

Summary Metrics

Four cards at the top of the dashboard show key incident statistics at a glance:
  • Open Incidents: Total number of currently active incidents.
  • Resolved Incidents: Total number of closed incidents.
  • Response Time: Average time from incident creation to first acknowledgement.
  • Resolution Time: Average time from incident creation to resolution.
Summary metrics

Incident Groups

The dashboard groups open incidents. A resolved incident leaves its group. Use Group By to choose how Collate groups the incidents:
  • Test case type: One group for each test definition, such as Column Values To Be Not Null. This is the default.
  • Table: One group for each table that has open incidents.
  • Test case owner: One group for each owner of the failing test cases. Test cases that nobody owns appear in a No Owner group.
Group By menu with the Test case type, Table, and Test case owner options Each group row shows the following:
  • The group name: The first column is named after the grouping, for example Test case type. A line under the name lists related tables, or check types when you group by Table.
  • Tables: The number of tables that the group’s incidents cover, for example “2 tables”. When you group by Table or Test case owner, this column is Check type and counts check types instead.
  • Incidents: The number of open incidents in the group.
  • Severity: The most critical severity among the open incidents in the group, or No Severity when none of them has one.
  • Status: The most actionable status in the group, ranked Assigned, then Ack, then New. A bar and counts, for example “2 ack”, show how many incidents are in each status.
  • Assignees: The users and teams that the incidents are assigned to, or None.
  • Last Seen: When the group’s incidents last changed, with the month and year of the first incident, for example “First Jul ‘26”.
  • Trend: Whether new incidents in the group are Rising, Falling, or Steady.
Above the table, a summary shows the number of groups and how many are recurring, for example “3 groups” and “0 recurring”. A group is recurring when its Trend is Rising. Collate counts recurring groups only among the groups loaded on the current page. To sort the groups, select the Incidents, Severity, or Last Seen column header. By default, the groups with the most open incidents appear first. Use the pager below the table to move between pages, and the Records menu to change how many groups appear on a page. The default is 15.

Filters

Use the filter bar to narrow the groups. The filters apply to the incidents inside each group:
  • Test case: Filter by a specific test case name.
  • Assignee: Filter by the team member assigned to the incident.
  • Status: Filter by current status: New, Ack, or Assigned. Resolved incidents aren’t part of a group.
  • Severity: Filter by the severity of the incident.
  • Date Filter: Choose the date field to filter by: Created at or Updated at.
  • Date Range: Set a custom date range.
Select Clear all to remove every filter. The filters stay in the page address, so a link or a page reload keeps them. Incident Manager filter bar with the Test case, Assignee, Status, Severity, Date Filter, and Date Range filters

Open a Group

  • Select a group to open the Incident group panel. It shows when the group’s incidents were first and last seen, and it lists the Individual incidents in the group. Incident group panel
  • Select the right arrow next to the test case type to open the full list of the group’s incidents, and select Back to groups to return to the groups with your filters still applied. Page for the Table Data to be Fresh group with the Back to groups link, the group summary, and the list of incidents The list shows only the incidents that match the filters of the groups. Select Clear Filters to list every open incident in the group.
  • Each row in the incident list represents one incident and shows:
    • Test Case Name: The test case that triggered the incident, with the data asset that it belongs to underneath.
    • Last Updated: Date and time of the most recent activity.
    • Status: Current stage of the incident (New, Ack, Assigned, Resolved). Select the value to change it.
    • Severity: Severity level assigned to the incident. Select the value to change it.
    • Assignee: The team member responsible for resolution.

Incident Status Change

Update the incident status to reflect the current stage of the resolution process. The incident owner assigns it to a team member for resolution.

For Single Incident or Test Case

To change the status of individual test cases, follow the steps below:
  1. Open the group that contains the incident. See Open a Group.
  2. In the Status column, select the status of the incident whose status you want to change. A menu lists the statuses: New, Ack, Assigned, and Resolved.
  3. Select a status:
    • New or Ack: Collate applies the change right away.
    • Assigned: A panel titled Assigned opens. Search for a user or a team, select one, and select the check mark icon to save.
    • Resolved: A panel titled Resolved opens. Select a Reason: Duplicates, False Positive, Missing Data, Out Of Bounds, or Other. Enter a Comment. Both are required. Select the check mark icon to save. Incident group panel with the Resolved panel open, showing the Reason options and the Comment field
    In the Assigned and Resolved panels, select the back arrow to return to the status menu, or the X icon to close the panel without a change.

From the Incident Details Page

Alternatively, change the status from the incident details page:
  1. Open the incident details page. In the incident list, select the test case name.
  2. In the header, select the edit icon next to Incident Status. Incident details page with the edit icon next to Incident Status highlighted
  3. In the Update Status dialog, select a Status: Ack, Assigned, New, or Resolved. Update Status dialog with the Status list open, showing Ack, Assigned, New, and Resolved
  4. Complete the fields that the status needs:
    • Ack or New: The dialog has no other fields.
    • Assigned: Search for and select an Assignee. This field is required. Update Status dialog with Assigned selected and the Assignee field
    • Resolved: Select a Reason and enter a Comment. Both fields are required. Update Status dialog with Resolved selected and the Reason and Comment fields
  5. Select Save.

For Multiple Incidents or Test Cases

To change the status or severity of all the open incidents in several groups at once:
  1. Select the checkbox next to each test case type, or select all. A bar shows how many groups you selected and how many incidents the change can affect. Selection bar showing 3 groups selected, up to 5 incidents, and the Set status, Set severity, and Clear selection buttons
  2. In the bar, select Set status and choose Ack, Assigned, or Resolved. Or select Set severity and choose Severity 1 to Severity 5. Set status menu with the Ack, Assigned, and Resolved options
  3. Complete the action for the option that you selected:
    • Ack: Select Apply.
    • Assigned: Select an Assignee, which can be a user or a team, and select Apply. Assign to dialog with the scope message, the Assignee field, and the Cancel and Apply buttons
    • Resolved: The dialog is titled Resolve.
      1. Select a Reason: Duplicates, False positive, Missing data, Out of bounds, or Other.
      2. Enter a Comment.
      3. Select Apply.
      Resolve dialog with the scope message, the Reason and Comment fields, and the Cancel and Apply buttons
    • Severity: The dialog is titled Set severity and shows the severity that you chose. It has no fields. Select Apply.
Collate reports how many incidents it updated. If some incidents already had the change, or were past that stage, Collate skips them and reports how many. If some updates fail, a message shows how many incidents could not be updated, and Incidents not updated lists them. Select Clear selection to deselect the groups. To make the same changes from code, see Change Many Incidents at Once.

Incident Severity Change

Update the incident severity to reflect how critical the failure is. Collate sets a severity automatically when it has enough context. Change it at any time.

For Single Incident or Test Case

To change the severity of an individual incident, follow the steps below:
  1. Open the group that contains the incident. See Open a Group.
  2. In the Severity column, select the severity of the incident whose severity you want to change. A menu lists No Severity and Severity 1 to Severity 5. Severity 1 is the most critical.
  3. Select a severity. Collate applies the change right away. Incident group panel with the Severity menu open, showing No Severity and Severity 1 to Severity 5

For Multiple Incidents or Test Cases

To change the severity of all the open incidents in several groups at once:
  1. Select the checkbox next to each group, or select the checkbox in the header row to select every group on the page. A bar shows how many groups you selected and how many incidents the change can affect.
  2. In the bar, select Set severity and choose Severity 1 to Severity 5. Set severity menu with the Severity 1 to Severity 5 options
  3. Select Apply.
Collate reports how many incidents it updated, and lists any that it could not update, as it does for status changes.

Incident Resolution

Once you resolve an incident, close it officially. Add a Root Cause Analysis (RCA) to the resolution comments to provide context for what went wrong and how it was fixed.

Steps to Resolve and Close an Incident

  1. Verify that all necessary steps to resolve the incident have been completed.
  2. In the Status column, select the status of the incident and choose Resolved.
  3. In the Resolved panel, select a Reason and describe the RCA in the Comment. Both are required.
  4. Select the check mark icon to close the incident. It leaves its group and appears in the Resolved Incidents count. Incident Resolution

Incident Activities

Each incident includes a detailed timeline where all activity is recorded. This timeline provides a comprehensive view of the incident’s lifecycle, including key events, RCA documentation, and closure updates.

How to View Incident Activities

  1. On the Incident Manager page, select the test case type and open the incident.
  2. Navigate to the Incident tab.
  3. Review the chronological events, RCA, and closure updates associated with the incident.
Incident Activities

Set Up Alerts for Incident Activity

To receive notifications when an incident is created, updated, commented on, or assigned, configure an alert with Source = Task. Incidents in Collate are Task threads with task type RequestTestCaseFailureResolution. Alert sources are matched by thread type, not task type — so if you configure an alert with Source = Conversation, it will never fire for incidents.

Create an Incident Alert

  1. Select the Profile icon and navigate to Settings > Notifications > Alerts. Notifications page in Settings with the Alerts card highlighted
  2. Select Add Alert. Alerts page with the Add Alert button highlighted
  3. On the Add Alert page, do the following:
    1. Add a unique Name and Description (optional).
    2. Set Source to Task.
    3. (Optional) Add a Mentioned User or Team filter to limit alerts to incidents where a specific person or team is @-mentioned.
    4. Set Destination to Slack, MS Teams, email, or internal Collate users.
    Add Alert form with the Name and Description fields and Source set to Task
  4. Select Save to create an alert.
Note: The Task source covers all structured workflow tasks — incidents, description requests, tag requests, and approval workflows. There is currently no filter to restrict to incidents only. If you only want incident notifications, configure a dedicated alert and instruct your team to use that alert’s destination channel for incident discussions.
For a full reference of alert source entities and their available filters, see System & Governance Notifications.