https://nousergon.ai/blog/tags/evaluation/Recent content in Evaluation on Nous Ergonhttps://nousergon.ai/blog/images/og-default.pnghttps://nousergon.ai/blog/images/og-default.pngHugoen-usTue, 10 Nov 2026 00:00:00 +0000https://nousergon.ai/blog/posts/independent-critic-vs-self-review/Tue, 10 Nov 2026 00:00:00 +0000https://nousergon.ai/blog/posts/independent-critic-vs-self-review/<p><strong>TL;DR.</strong> I tested whether an independent AI critic improves an agent&rsquo;s research more than an agent reviewing its own work. An agent wrote 9 short equity research answers on Deere (3 questions, each run 3 times). A separate judge agent flagged a material error in 3 of the 9 first drafts, all the same omission. By its assessment, self-review fixed 2 of the 3 and an independent critic fixed all 3. The judge also classified 13 of the critic&rsquo;s 41 complaints as invalid, yet the writer accepted 12 of them. For a task this size, self-review looks like the more efficient choice, though I&rsquo;d want to test more questions before deciding whether the critic&rsquo;s extra fix justifies 22.5% more cost.</p>