Running a guided review

Work through a Coworker's feedback and struggled interactions one by one, mark how each was resolved, and record the outcome.

For: A Coworker's Supervisor · Last updated

The guided review is where a Supervisor works through everything that went wrong with a Coworker: the thumbs-down feedback people gave it and the interactions automatic review found did not help. You open each item, read the conversation, try to reproduce the problem and fix the Coworker in your usual way, then mark the item with how it turned out. Start a review with Start review on the Reviews view of Governance.

Only the Coworker's Supervisor can work through the list and record a review. Someone else who can see the Coworker sees a message that working through feedback requires being its Supervisor. If you cannot open the review at all, the page says "This review isn't available — you may not be this Coworker's Supervisor." with a Back button.

The page#

The page is headed with the Coworker's name, its role and its Supervisor. The Review type switch sets which review you are recording: Monthly review or Quarterly deep review.

Two links at the top right open in a new tab, so you can keep your place here:

  • Open chat with the Coworker's name opens a chat with it, where you can try to reproduce a problem.
  • Coworker details opens its details page, where you edit its instructions and Knowledge Bases. See Coworker details.

Work the way you normally work on a Coworker in that second tab, then come back and mark the item.

Feedback to work through#

Feedback to work through is one list with two kinds of items:

  • every thumbs-down, and every thumbs-up that carries a flag, since the last review of this type (or all on record if there has not been one), each with its date, the thumb, any kind of problem chosen and the comment. It does not show who gave it.
  • every interaction that automatic review judged did not help the person, from the same period. Each carries an Automatic review tag, the reason in plain words (Person corrected a mistake, Person asked again another way, Reply left out what was needed, Person gave up, Reply was an error or Other) and the Coworker's duty it fell under, when one matched.

Above the list, a line shows your progress, for example "3 of 8 worked". When every item has a marker it reads "8 of 8 worked · All items worked."

Themes#

The list is grouped by theme. A weekly synthesis groups the feedback into themes so you read patterns instead of a long list; select Run synthesis now to run one straight away (the button reads Synthesizing… while it works). Under the button the page shows the latest synthesis made since the last review of this type: how many items it grouped, the dates they cover, the thumbs-up and thumbs-down counts, and a short summary. If there is none, the page says "No synthesis since the last review." and you can run one.

Each theme has a name, a tag (Gap, Topic or Working well), a description and how many of its items you have worked, for example "2 of 3 worked". Every item appears once. Items that are not in a theme are listed last under Not in a theme, split into Thumbs-down feedback and Automatic review. Until a synthesis exists, the whole list appears without themes, split the same way.

If a synthesis cannot finish, the page says "This synthesis couldn't be completed. Run it again." If your company has not chosen a default model, the page says "Feedback synthesis isn't set up for your company — ask an admin to choose a default model in Settings."

Filtering#

Two menus narrow the list:

  • All statuses, Open or Worked shows every item, only those without a marker, or only those with one.
  • All reasons or one reason shows only the automatic items with that reason. Choosing a reason hides the thumbs feedback.

The progress line and each theme's count always cover every item. On the Coworker's details page, Read these interactions beside a reason on the Signals card opens this page with that reason already chosen. The list shows 25 items at a time; select Show more for more.

Opening an item#

Select a row to open its conversation right under it, so you keep your place. It is indented from the list. Only one is open at a time: selecting another row moves it there. Close it by selecting the row again, by selecting Close transcript (the x button at its top right), or by pressing Escape while you are inside it. The title and the close button stay above the messages, and the messages scroll on their own inside the transcript, so the page does not.

The conversation shows each message's role, with the message you selected highlighted. Messages from tools appear as "Tool result (succeeded)" or "Tool result (failed)", followed by "sent to the Coworker, not shown here"; their output is not displayed. When the Coworker called a tool without writing any text, the message reads, for example, The Coworker called the tool "browser". An item whose conversation has been removed says "This conversation is no longer available." You can still mark it.

When you open an item found by automatic review, a line at the top reads "Automatic review:" with the reason and duty, then "The marked messages are what the automatic review looked at: the request, everything the Coworker did and said in reply, and the person's next message." The marked messages carry a solid left edge: Request reviewed (what the person asked), Reply reviewed (the Coworker's whole turn, including its tool calls and results) and Next message (what the review used), the person's following message. The verdict depends on that next message, for example asking again another way, so check it before deciding the review was wrong. The transcript scrolls to the request. When the person sent no next message, only the request and reply are marked.

Only the marked messages are shown at first. Every other message is hidden behind See rest of conversation, with a count such as "(3 earlier messages)". It appears above the marked messages when earlier messages exist and below them when later ones exist. Selecting either one shows all the messages in place, and both change to Hide rest of conversation.

Marking an item#

Under the transcript, How was this resolved? has six choices:

  • Fixed: you changed the Coworker and the problem is gone.
  • Could not reproduce: you tried and could not make it happen again.
  • Transient error: a one-off hiccup, not a problem with the Coworker, so there is nothing to fix.
  • Not fixable: the cause is outside what you can change.
  • Not a problem: the feedback or the review was mistaken, or the Coworker worked as intended.
  • Other: none of these fit. A comment is required; without one the form says "Add a comment to explain."

A Comment is optional for the other five. Select Save to keep the marker. Select Save and open next to save it, close this item and open the next item without a marker, in list order; when none are left it closes and the progress line reads "All items worked."

The row's status shows the marker, or Open when it has none. When an item has a marker, its choice and comment are shown again when you open it, with who marked it and when, for example "Fixed by Elena Voss, 10/24/2026, 6:32 PM". Change the choice and save again to replace it, or select Mark as open to remove it. If saving fails, the form says "This couldn't be saved. Try again."

Markers belong to the Coworker, not to one review: an item you marked in an earlier review stays marked in the next, so each review picks up where the last left off.

Finish the review#

Under Finish review:

  1. Choose an outcome: Healthy, Watch, Sunset or Due. Healthy is selected to begin with.
  2. Write a Summary.
  3. Select Save review. It records the review with today's date and returns you to Governance, where it appears under Recent reviews.

Select Cancel to leave without recording. If saving fails, the page says "The review couldn't be saved. Try again."