VQV Signal

CREATOR TOOLS WATCH GENERAL

PoEM previews what RL post-training would learn from a new reward, without training on it

According to a post on X by @kimiahmdh, Kimia Hamidieh, Giannis Daras and Antonio Torralba of MIT CSAIL describe PoEM, which composes policies already trained on other rewards to preview the policy that reinforcement learning (RL) post-training would produce for a new reward. A coverage score computed in advance ranks which held-out rewards the existing basis can span. The excerpt also mentions five experts trained on smaller Skywork reward models, but it cuts off before stating the results.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-20T17:45:00+00:00 Detected 2026-11-21T00:03:26+00:00
View original source

According to a post on X by @kimiahmdh, Kimia Hamidieh, Giannis Daras and Antonio Torralba of MIT CSAIL describe PoEM, which composes policies already trained on other rewards to preview the policy that reinforcement learning (RL) post-training would produce for a new reward. A coverage score computed in advance ranks which held-out rewards the existing basis can span. The excerpt also mentions five experts trained on smaller Skywork reward models, but it cuts off before stating the results.

AI-assisted summary based on the listed source.

Kimia Hamidieh, Giannis Daras and Antonio Torralba (MIT CSAIL) compose policies already trained on other rewards to preview the policy RL would produce for a new reward. A coverage score computed in advance ranks which held-out rewards the existing basis can span, and five experts trained on smaller Skywork reward...

Teams running RL post-training could use an approach like this to estimate what a new reward would produce before committing to full training runs. If the method holds up, it could lower the cost of testing reward designs. Readers should look for the full paper and measured results, since the excerpt does not show them.

Signal Strength 78% Technical label WATCH Public Interest 27 Category CREATOR TOOLS Reader Depth GENERAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 94 Consequence Score 26 Curiosity Score 0 Shareability Score 45

VQV surfaced this signal because it is recent, relevant to AI Search, connected to Scobleizer News Pulse (X).