masked diffusion · single forward pass
Calibrated typed decisions, scored without generating a token
A 350M bidirectional diffusion LM answers a decision by writing one masked token. The softmax over the option letters at that position is the distribution — so a decision costs one pass, and k questions about one state cost the same one pass. Same data, same seed, same 3000 steps: only the training objective differs between the two fine-tunes.
connecting…
state
Unstructured state
select a record to score it