Does a second AI reviewer make research better?
TL;DR. I tested whether an independent AI critic improves an agent’s research more than an agent reviewing its own work. An agent wrote 9 short equity research answers on Deere (3 questions, each run 3 times). A separate judge agent flagged a material error in 3 of the 9 first drafts, all the same omission. By its assessment, self-review fixed 2 of the 3 and an independent critic fixed all 3. The judge also classified 13 of the critic’s 41 complaints as invalid, yet the writer accepted 12 of them. For a task this size, self-review looks like the more efficient choice, though I’d want to test more questions before deciding whether the critic’s extra fix justifies 22.5% more cost. ...