What youβll get: a shared standard for rating investigations, so the skills ewake
writes from your feedback are ones you would have written yourself.
Where feedback comes from
What happens after you submit
1
You click π or π
A form opens: Help us improve Ewake.
2
You pick dimensions and (optionally) write details
On a π at least one dimension is required. On a π the dimensions are optional.
The Additional Details box is always optional β but it is the part that carries
the lesson.
3
Ewake acknowledges immediately
You see βThanks! Weβve flagged this for the team.β β that is the save, not the
learning.
4
A curator re-reads the run against your feedback
In the background, ewake replays the transcript of the run you rated, your selected
dimensions, your comment, and the catalog of active skills. It decides whether the
run teaches a lesson worth keeping.
5
A skill is written or sharpened β and goes live
If there is a lesson, the curator either rewrites an existing skillβs body or writes a
new skill. Both are activated immediately, with your feedback recorded as the
reason for the change.
6
Ewake replies in the thread
βThanks for the feedback β we learned from it. β’ New skill: β¦β Silence means the
curator judged that the run added nothing worth carrying forward β which is a valid
outcome, not a failure.
What the curator can and cannot see
It reads a condensed transcript of the investigation:- the messages of the run, each truncated at ~2,000 characters
- the names of the tools the agent called, in order, and whether a call failed
- at most 60 messages β a long run keeps its opening and its conclusion, and says so in the middle
Choosing the right dimension
The dimension tells ewake which kind of mistake or success it was. Picking the wrong one sends the lesson to the wrong place.Diagnosis and presentation are separate judgements. An answer that found the right root
cause but buried it is Hard to Read, not Missed the Mark. Flagging it as the
latter teaches ewake to investigate differently when the investigation was fine.
Writing the comment
The comment is the only place you can say what the right answer was. A good one contains three things:- What ewake concluded β briefly, so the lesson is anchored.
- What was actually true, and how you knew.
- The rule a future run should follow, stated so it generalises beyond today.
- Name services, metrics and thresholds. βauth-api p99 over 2sβ teaches; βthe upstream service was slowβ does not.
- Write the rule, not the incident. The curator is told never to mention your run in the skill body β so give it something that still makes sense next month.
- One lesson per rating. Two unrelated complaints in one comment tend to produce one muddled skill.
- Do not write instructions to a person. The skill body is read by the agent as prior knowledge to weigh against its own evidence, not as an order to obey.
- Leave out links and ticket ids. They are stripped when a skill is written, so they cost you space and teach nothing.
Praise is training too
A π goes through exactly the same curation as a π. Rating a genuinely good investigation is how the ordering that worked becomes the ordering ewake reaches for next time. Rate π when the run changed what you did next. Do not rate π as a thank-you for a run you did not read β it is treated as a lesson either way.When not to leave feedback
- The gap is a missing integration, not a mistake. If ewake could not see the data, no skill fixes that. Connect the source instead.
- You are asking for a product change. Send it to support@ewake.ai β the curator can only write skills.
- Someone already rated the same run for the same reason. Each submission starts its own curation pass; two people making the same point can produce two overlapping skills.
- You have not read the answer. A reflex rating is indistinguishable from a considered one.
Reviewing what your feedback taught
Everything the curator writes is visible and reversible in the dashboard under Skills:- The skillβs version history shows each change, who made it, and a per-field explanation of why it changed, ending with the feedback it came from.
- Activate this version puts a previous version back in service.
- The status toggle disables a skill without deleting it; Archive retires it.
A short checklist
Before you submit:- I read the answer and know what it got wrong or right.
- My dimension matches the kind of problem (diagnosis vs. evidence vs. presentation).
- My comment names the correct answer and how I know.
- My comment states a rule that will still be true next month.
- I would be happy for this rule to apply to the next investigation, unreviewed.
Need help? Contact support@ewake.ai.