Skip to content

Writing patterns from the oral corpus

For a category-level overview before inspecting papers, use writing by contribution type: each category combines corpus measurements, a short synthesis, a section outline and an explicit artifact package. The inline visual gallery shows the forms directly; the 223-paper atlas supplies the quantitative context.

These are editorial lessons drawn from inspected manuscripts, not additional ICLR rules. Each pattern links to concrete paper-level observations and their source locations. The examples span methods, theory, empirical studies, benchmarks and systems; they are selected illustrations, not a statistical ranking of writing styles.

Use this page in three passes:

  1. Choose a pattern that addresses a problem in your draft.
  2. Inspect the cited example and its full writing study, including the caveat.
  3. Apply the principle using your own evidence, figures and language—not by copying the paper’s text or artwork.

The complete oral corpus contains the paper-by-paper record. The official requirements govern formatting. The argument worksheet and visual blueprints turn the observations into reusable drafting tools.

Turn the introduction into a testable argument

Name an obstacle, identify the changed mechanism, and tell the reader which experiment or result will test it. Reuse the same nouns in the contributions, method headings and evaluation questions.

Apply it to a draft

Draft a three-column ledger: limitation → intervention → discriminating test. Delete contribution bullets that merely rename the same intervention.

Boundary: A coherent narrative is not evidence of causality. The intervention still needs an appropriate control, and contradictory results must remain visible.

Carry one concrete example through the abstraction

A worked tensor operation, geometric case or program can introduce the object before the general definition. Reuse its labels through the algorithm and evaluation so each formal step has a recognizable role.

Apply it to a draft

Choose the smallest nontrivial example that exhibits the actual failure. Show its input, one intermediate state, the changed operation and output; explain where the example stops representing the general case.

Boundary: A toy example teaches a mechanism; it does not substitute for a proof or establish real-world performance.

Make assumptions part of the result

Separate the mathematical object, assumptions, guarantee, proof idea and practical algorithm. If a practical approximation does not satisfy the theorem’s conditions, give it its own claim and evaluation.

Apply it to a draft

Place a compact “proved / implemented / observed” ledger beside the main result. State whether the result is finite-sample or asymptotic, necessary or sufficient, and whether optimization attainment is proved.

Softmax Transformers are Turing-Complete

The progression from counting-friendly languages to arbitrary languages makes the necessity of the encoding phase intelligible; phase I stores an input encoding and phase II simulates a counter machine.

Sections 3–4, pp. 5–9 · Inspected paper

Boundary: An accepted theoretical paper can still have an overbroad title, a conditional guarantee or an implementation gap. Do not strip these qualifications when borrowing its presentation.

Draw the training and inference boundary

Different line styles and clearly labeled panels can distinguish training-only labels, teacher signals and privileged observations from deployed inputs. Frozen/trainable status should agree with the algorithm and code.

Apply it to a draft

Trace one test example without looking at the training panel. Every deployed input and operation must be accounted for; no training-only arrow should silently remain necessary.

Boundary: A dashed arrow has no universal meaning. Include a legend and a caption that explains whether it denotes training only, stop-gradient, optional execution or another relation.

Use a consistent visual grammar for comparisons

Aligned old/new diagrams, repeated colors and shapes, labeled tensor dimensions, and matched qualitative crops make the changed computation easier to identify than unrelated block drawings.

Apply it to a draft

Keep unchanged modules in the same position and style. Highlight only the intervention; label the feature or state carried by ambiguous arrows. Compare qualitative outputs at matched scale.

Generative Human Geometry Distribution

The overview uses two clearly separated panels for encoding and generation, with repeated feature-map colors, a visible SMPL condition and tensor dimensions beside intermediate objects. The comparison figure adds magnified crops to normal-map renderings so fine geometric differences can actually be inspected.

Figure 4, page 5; Figure 8, page 8 · Inspected paper

Boundary: Color cannot be the only encoding, and an attractive heatmap is not causal evidence. A figure must remain legible in the final PDF at normal size.

Put the comparison contract beside the numbers

Tables should identify data access, model scale, metric direction, aggregation and additional training stages. Separate controlled ablations from literature leaderboard results with unmatched resources.

Apply it to a draft

Write the table caption before bolding any cell. State what is fixed and what differs; mark adapted baselines and values copied from another publication.

Pre-training under infinite compute

The matched-token self-distillation ablation isolates whether retaining real data matters. Its explicit no-mixing comparison supports a narrower and stronger conclusion than a general statement that synthetic training avoids collapse.

Appendix F.3 and Table 4, p.34 · Inspected paper

Latent Speech-Text Transformer

Adjacent Tables 3 and 4 reuse task columns while explicitly changing the budget constraint. This makes an efficiency claim auditable without conflating extra processed data with a better architecture.

Tables 3–4, p. 7 · Inspected paper

Boundary: Equal parameter count, equal unique data, equal training tokens and equal inference latency are different controls. A best score is not automatically a fair comparison.

Explain which work a speedup removes

A systems or efficiency claim needs an accounting boundary. Show preprocessing, model execution, auxiliary computation, memory movement and output generation when they affect the user-visible measurement.

Apply it to a draft

Report quality at a fixed resource budget, resource use at a fixed quality target, and measured end-to-end behavior as separate questions when feasible. State hardware, precision, batch, warm-up and included operations.

Boundary: Token reduction and FLOPs are not measured latency; latency and throughput are not interchangeable. A component speedup can disappear behind an unchanged bottleneck.

Validate the evaluator as well as the model

Benchmark and agent papers must define the behavior being measured, its denominator and the scoring process. A simulator, judge or interaction protocol is part of the scientific instrument, not neutral plumbing.

Apply it to a draft

Include collection/exclusion rules, a scored worked example, judge or simulator checks, leakage controls and failure categories. Distinguish exposure, attempted behavior and successful execution.

Boundary: A low score can reflect invalid scoring or navigation failure rather than the intended capability. More tasks do not automatically make the measurement valid.

Distinguish observations from fitted explanations

Use different visual marks for measured points, interpolation, extrapolation and theoretical limits. An explanatory plot must also identify how its variables and normalizations were constructed.

Apply it to a draft

Put the fitting range, uncertainty or sensitivity analysis and any extrapolation boundary in the caption. Keep raw and normalized views when normalization materially changes the story.

Pre-training under infinite compute

Figure 8 distinguishes finite measured models from fitted dashed asymptotes, using arrows to show teacher-to-student compression. Its parameter-count axis makes deployment size visible while leaving training compute a separate question.

Figure 8, p.8 · Inspected paper

Intrinsic Entropy of Context Length Scaling in LLMs

Figure 1 places a conceptual decomposition beside training and inference measurements. Its training panel subtracts each dataset-size curve's own minimum; the caption and appendix restore the absolute losses needed to interpret that normalization.

Figure 1, p.2; Figure 15, p.31 · Inspected paper

Boundary: A high in-sample fit from a few model scales does not validate a remote asymptote. A qualitative projection is not a complete description of a high-dimensional representation.

Make the appendix a navigable audit trail

Organize proofs, protocols, sensitivity tests, prompts, per-task results and failure cases by the main-text claims they verify. Precise cross-references are more useful than “see appendix for details.”

Apply it to a draft

For each major claim, give a stable appendix destination and the artifact/configuration that reproduces it. Retain version differences and explain which record is authoritative.

Pre-training under infinite compute

Appendix F reveals sampling from individual teachers, batch mixing ratios and repeated synthetic data caused by generation limits. These details materially qualify the simplified main-text ensemble-distillation description and are essential for a faithful method summary.

Appendices F.1–F.2, p.33 · Inspected paper

Boundary: Essential validity conditions must remain intelligible in the main paper. ICLR 2026 reviewers were not obliged to read appendices; observed appendix size is not a recommended target.

Use exceptions to sharpen, not weaken, the contribution

A negative control, a failed extension or a setting where the baseline wins can identify the method’s actual domain. State the limitation next to the claim it qualifies.

Apply it to a draft

Replace universal adjectives with the tested setting and retain a counterexample or failure analysis. Recheck title, abstract and conclusion after the final tables are fixed.

Boundary: Do not infer that a writing choice caused acceptance. This is an oral-only, accepted-paper collection with no matched rejected-paper control; it cannot estimate acceptance effects.

Accepted oral papers are a selected population. Without a suitable comparison group and a design that addresses confounding, these observations cannot show that a particular section order, number of figures, sentence style or appendix length causes acceptance. Scientific importance, soundness, evidence, fit, review judgments and presentation all vary together.

Likewise, a final proceedings manuscript may differ from the anonymous submission that reviewers evaluated. This collection records the inspected version; it does not reconstruct a submission’s revision history without evidence. Learn how a claim is made inspectable, not a supposed formula for acceptance.