Reliability

Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know" featured image

Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know"

Decomposed prompting does not reliably repair missing knowledge in closed-book QA, but disagreement across prompting regimes provides a strong signal for when models should abstain …

avatar
Dhruv Madhwal