Writing study: On the Reasoning Abilities of Masked Diffusion Language Models
← ICLR 2026 oral writing corpus
Anej Svete, Ashish Sabharwal · Official ICLR 2026 oral record
Figure, table and section ledger
Editorial contribution type: Theory & formal foundations (primary).
Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.
- Canonical PDF
- 36 physical pages
- Before references / appendix
- ≈ 10.3 page-equivalents
- Main figures / tables
- 3 / 0
- Attached appendix figures / tables
- 0 / 0
- Attached appendix span
- ≈ 21.89 page-equivalents
Section-by-section lengths and source pages
The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.
| Top-level heading | Starts on PDF page | Estimated span | Share of entire PDF |
|---|---|---|---|
| 1 INTRODUCTION | 1 | ≈ 2.04 pp. | 5.67% |
| 2 PRELIMINARIES | 3 | ≈ 2.84 pp. | 7.89% |
| 3 THEORETICAL RESULTS | 6 | ≈ 2.44 pp. | 6.78% |
| 4 DISCUSSION | 8 | ≈ 1.87 pp. | 5.19% |
| 5 CONCLUSION | 10 | ≈ 0.2 pp. | 0.56% |
| ETHICS STATEMENT | 10 | ≈ 0.24 pp. | 0.67% |
| REPRODUCIBILITY STATEMENT | 11 | ≈ 0.14 pp. | 0.39% |
| ACKNOWLEDGMENTS | 11 | ≈ 0.06 pp. | 0.17% |
| REFERENCES | 11 | ≈ 3.8 pp. | 10.56% |
| A RELATED WORK ON THE EXPRESSIVITY OF MDMS | 15 | ≈ 0.51 pp. | 1.42% |
| B PRELIMINARIES | 15 | ≈ 7.75 pp. | 21.53% |
| C A DISCUSSION OF THE THEORETICAL MODEL | 23 | ≈ 2.05 pp. | 5.69% |
| D THEORETICAL GADGETS | 25 | ≈ 7.14 pp. | 19.83% |
| E PROOFS | 32 | ≈ 4.44 pp. | 12.33% |
All detected figure and table locations
Attached appendix
No recognized caption labels.
Argument and organization
- Five takeaways and theorem maps
Provides an accessible navigation layer before formal definitions.
- Planner/predictor idealization
States the departures from conventional diffusion assumptions.
- Simulations and implications
Relates model classes while accounting for padding and step overhead.
Problem, claim and contribution
An arithmetic-expression example introduces parallel subproblems before complexity classes. Five numbered takeaways then provide a reading route, each linked to its theorem rather than functioning as an unsupported claim list.
§1, Figures1–3, pp.1–3 · Main paper
Argument and section order
The preliminaries explain why uniform unmasking and perfect conditionals are restrictive before introducing a learnable planner and resampling. This order helps readers see that the theorem concerns an explicitly broadened idealization, not every deployed diffusion model.
§§2.2–2.2.1, pp.4–6 · Main paper
Figures, captions and visual explanation
The inclusion maps encode strictness, novelty and resource restrictions separately. Figure3 makes the abstract distinction tangible by contrasting three parallel unmasking rounds with eleven sequential tokens; these are illustrative steps, not measured latency.
Figures2–3, p.2 · Main paper
Tables, comparisons and evidence
Simulation results retain their padding costs, and the strict logarithmic-step separation invokes TC0≠NC1. The discussion separately labels conjectures and empirical validation as future work, preventing expressivity from being mistaken for demonstrated learning.
Theorems3.1–3.4 and Corollary3.7, pp.6–8; §4, pp.9–10 · Main paper
Appendix and reproducibility
The appendix builds reusable positional-encoding and attention gadgets before the simulations. The dump/decode/read construction shows why discrete intermediate states require additional storage rather than merely asserting equivalence.
AppendicesD–E, pp.25–36; LemmaE.1 and TheoremE.2, pp.33–34 · Main paper
Clarity and writing conventions
The discussion explicitly separates external positional information, stochastic noise, ideal planning and trainability. Some appendix statements need care: Remark1 lists logarithmic loops for constant-depth classes, unlike the main corollaries, and fixed top-k planner equivalence needs cardinality assumptions clarified.
§4, pp.9–10; Remark1, p.21; TheoremC.1, p.24 · Main paper
What to reuse—and what not to infer
Transferable lesson: Give theory readers a theorem map and worked toy example, then attach assumptions and resource blow-ups to every informal equivalence claim.
Boundary: Reading the supplied proofs is not independent proof certification. Results concern L-uniform, fixed-precision, logarithmic-width families with supplied positional information; they do not establish training convergence, empirical accuracy or wall-clock superiority of present-day diffusion LMs.
Apply this lesson using the argument and evidence worksheet.
Inspection record and sources
- Checked
- 2026-09-19
- Reading status
- Full text + selected visuals inspected
- Main text
- pp.1–11, §§1–5 and declarations; references pp.11–14
- Appendix / supplement
- pp.15–36, A–E: related theory, formal models, modeling departures, technical gadgets and complete supplied proofs
- Visually inspected PDF pages
- 2, 34
- official ICLR 2026 proceedings PDF · 36 pages