Feedback synthesis

Feedback synthesis groups the thumbs-up and thumbs-down feedback each Coworker has received into themes, so its Supervisor reads patterns instead of a long list. Supervisors see the themes in the work list on a Coworker's guided review, where the feedback is worked through one item at a time; see Running a guided review.

What a run does#

A run takes every item of feedback on a Coworker that has not been grouped before, sends it to your company's default model in one or more calls, and records the themes. The feedback it used is marked as grouped, so the next run starts from new feedback only. A large batch is split into several calls and merged, so no feedback is left out. If a run cannot finish, the feedback stays ungrouped and the next run picks it up.

Every call is metered under the system job feedback-synthesis, and its cost is attributed to the Coworker, so it shows in Usage and cost.

A run needs a Company default model. If none is set, starting a run fails with "Feedback synthesis isn't set up for your company — ask an admin to choose a default model in Settings." Set one under Model providers; see Default models.

The weekly schedule#

Open Settings, find Features and select Manage. Feedback Synthesis has an Off and On switch. It is On by default.

When it is on, a Coworker with new feedback gets a synthesis at least once every 7 days. Retired Coworkers and Coworkers with no new feedback are skipped. When it is off, no scheduled runs happen. Turning it off does not stop anyone starting a run by hand.

Run it now#

Under the switch, Run synthesis now starts a synthesis for every Coworker that has new feedback, whether the weekly schedule is on or off, or ahead of it. The page then says "Started for N Coworkers.", "A synthesis is already running." or "No new feedback to synthesize." A Coworker that already has a synthesis in progress is not started a second time.

You need the admin ability to use the Features page. A Coworker's Supervisor can run a synthesis for that Coworker from its guided review without it.

Feedback synthesis is Coworkers work, so it follows the Coworkers switch on Settings, then Features. While Coworkers is off, running a synthesis, from here or from a guided review, is not available.

Turning the schedule off for the whole deployment#

The environment variable WI_FEEDBACK_SYNTHESIS_SCHEDULER=none removes the schedule for every company, regardless of the switch. See the Configuration reference.