LLMs1 min read
Recall Doesn't Guarantee Safety Monitor Effectiveness
New research shows that safety monitors, evaluated by recall against harmfulness labels, don't consistently prevent harmful responses. Monitors miss prompts the model would have answered anyway, highlighting the need for a more accurate evaluation method.
From arXiv cs.CL