Skip to content

Writing study: Unsupervised Partner Design Enables Robust Ad-hoc Teamwork

← ICML 2026 oral writing corpus

Constantin Ruhdorfer, Matteo Bortoletto, Victor Oei, Anna Penzkofer, Andreas Bulling · Official ICML 2026 oral record

Figure, table and section ledger

Editorial contribution type: Training, objectives & optimization (primary).

Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.

Canonical PDF
27 physical pages
Before references / appendix
≈ 8.61 page-equivalents
Main figures / tables
8 / 2
Attached appendix figures / tables
14 / 5
Attached appendix span
≈ 13.91 page-equivalents
Before references / appendix: ≈ 31.89%References / intervening material: ≈ 16.59%Attached appendix: ≈ 51.52%Estimated layout envelopes, not text/artwork area. Unresolved appendix boundaries remain within the undivided post-body material.
Section-by-section lengths and source pages

The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.

Top-level headingStarts on PDF pageEstimated spanShare of entire PDF
1. Introduction1≈ 0.95 pp.3.52%
2. Related Work2≈ 0.55 pp.2.04%
3. Preliminaries2≈ 1.08 pp.4%
4. Unsupervised Partner Design3≈ 1.8 pp.6.67%
5. Experiments in Fixed Environments5≈ 2.74 pp.10.15%
6. Experiments with Procedural Generation8≈ 0.5 pp.1.85%
7. Discussion and Limitations8≈ 0.35 pp.1.3%
8. Conclusion9≈ 0.09 pp.0.33%
Impact Statement9≈ 0.2 pp.0.74%
Acknowledgements9≈ 0.07 pp.0.26%
References9≈ 4.48 pp.16.59%
A. Infrastructure & Tools14≈ 0.27 pp.1%
B. Reproducibility Statement14≈ 0.14 pp.0.52%
C. UPD and Convention Selection Extended14≈ 1.02 pp.3.78%
D. Additional Comparison with ROTATE and fine-tuned UPD15≈ 0.2 pp.0.74%
E. Additional Training Details15≈ 3.5 pp.12.96%
F. Observations on Computational Requirements of UPD19≈ 1.55 pp.5.74%
G. Additional Environment Details20≈ 0.96 pp.3.56%
H. Training Curves21≈ 2.73 pp.10.11%
I. Partner Curriculum Dynamics24≈ 0.32 pp.1.19%
J. Additional Results in Overcooked24≈ 1.51 pp.5.59%
K. Additional User Study Details26≈ 1.71 pp.6.33%
All detected figure and table locations

Argument and organization

  1. Problem and contribution

    Extends unsupervised environment design to partner behavior and separates fixed-level teaming from joint generalization over levels and partners.

  2. Argument sequence

    The generator and selection score precede a small convention-selection example; separate experiment sections then evaluate artificial partners, humans and procedural environments.

  3. Evidence and verification

    The twelve-participant study randomizes all agent-layout combinations and reports paired tests with Holm–Bonferroni correction, expressly stopping short of declaring overall superiority.

Problem, claim and contribution

Extends unsupervised environment design to partner behavior and separates fixed-level teaming from joint generalization over levels and partners.

Contributions, p. 2; Section 5, p. 5 · Main paper

Argument and section order

The generator and selection score precede a small convention-selection example; separate experiment sections then evaluate artificial partners, humans and procedural environments.

Sections 4-6, pp. 3-8 · Main paper

Figures, captions and visual explanation

A fixed-mixture sweep exposes tuning sensitivity, while the human-study figure reports metric directions and corrected comparisons beside the procedural-generalization table.

Figure 3, p. 5; Figure 7/Table 2/Figure 8, p. 8; both PNGs inspected · Main paper

Tables, comparisons and evidence

The twelve-participant study randomizes all agent-layout combinations and reports paired tests with Holm–Bonferroni correction, expressly stopping short of declaring overall superiority.

Section 5.3, pp. 7-8 · Main paper

Appendix and reproducibility

A transparency note states that earlier baseline implementation/configuration issues were corrected and rerun; later pages retain all questionnaire-response distributions.

Appendix B, p. 14; K and Figure 22, pp. 26-27 · Main paper

Clarity and writing conventions

The human-study conclusion is calibrated to sample size, and the reproducibility statement identifies a consequential source-version correction rather than silently replacing results.

Section 5.3, p. 8; Appendix B, p. 14 · Main paper

What to reuse—and what not to infer

Transferable lesson: Separate artificial, human and environment-shift evidence, and document corrected baseline versions explicitly when the public manuscript has evolved.

Boundary: Population-free does not mean generator-free or compute-free; a conceptual two-action game and a small human sample do not establish universal partner generalization.

Apply this lesson using the argument and evidence worksheet.

Inspection record and sources

Checked
2026-10-07
Reading status
Writing-focused manuscript scan + selected visuals inspected
Main text
Writing-focused distributed manuscript scan, not exhaustive technical/proof validation. Sections 1-8, pp. 1-9: partner-space curriculum motivation, online generation/selection, illustrative convention game, artificial/human teaming and procedural partner-level generalization.
Appendix / supplement
Writing-focused appendix scan; code, data and external assets not executed. Appendices A-K, pp. 14-27: infrastructure and correction note, conceptual extension, RL setup, compute observations, task/training curves, alternative scores and human-study details.
Visually inspected PDF pages
5, 8

This is a writing-focused scan of the manuscript and the stated supplementary scope: framing, organization, visual explanation, evidence presentation and wording. It is not a line-by-line proof audit, reproduction of results or exhaustive scientific review.