Writing study: daVinci-Dev: Agent-native Mid-training for Software Engineering
← ICML 2026 oral writing corpus
Ji Zeng, Dayuan Fu, Tiantian Mi, Zhuang Yumin, Yaxing Huang, Xuefeng Li, Lyumanshan Ye, Muhang Xie, Qishuo Hua, Zhen Huang, Mohan Jiang, Hanning Wang, Jifan Lin, Yang Xiao, Jie Sun, Yunze Wu, Pengfei Liu · Official ICML 2026 oral record
Figure, table and section ledger
Editorial contribution type: Training, objectives & optimization (primary).
Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.
- Canonical PDF
- 18 physical pages
- Before references / appendix
- ≈ 9.34 page-equivalents
- Main figures / tables
- 4 / 6
- Attached appendix figures / tables
- 3 / 0
- Attached appendix span
- ≈ 4.56 page-equivalents
Section-by-section lengths and source pages
The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.
| Top-level heading | Starts on PDF page | Estimated span | Share of entire PDF |
|---|---|---|---|
| 1. Introduction | 1 | ≈ 1.43 pp. | 7.94% |
| 2. Background and Problem Setup | 3 | ≈ 0.48 pp. | 2.67% |
| 3. Agent-Native Data: Design and Synthesis | 3 | ≈ 1.78 pp. | 9.89% |
| 4. Experiments | 5 | ≈ 2.03 pp. | 11.28% |
| 5. Analysis | 7 | ≈ 1.82 pp. | 10.11% |
| 6. Related Work | 9 | ≈ 0.58 pp. | 3.22% |
| 7. Conclusion | 9 | ≈ 0.13 pp. | 0.72% |
| Impact Statement | 9 | ≈ 0.36 pp. | 2% |
| Acknowledgments | 10 | ≈ 0.09 pp. | 0.5% |
| References | 10 | ≈ 4.1 pp. | 22.78% |
| A. Training Details | 14 | ≈ 0.65 pp. | 3.61% |
| B. Evaluation-Infrastructure Fixes for SWE-Bench Verified | 15 | ≈ 0.59 pp. | 3.28% |
| C. LLM prompts used for PR rendering | 15 | ≈ 0.09 pp. | 0.5% |
| D. Dataset Formats | 15 | ≈ 2.92 pp. | 16.22% |
| E. Benchmark decontamination | 18 | ≈ 0.31 pp. | 1.72% |
All detected figure and table locations
Main text
Attached appendix
Argument and organization
- Problem and contribution
Distinguishes contextually native trajectories, which preserve process structure, from environmentally native trajectories, which require real execution feedback.
- Argument sequence
Data definitions precede training comparisons; robustness is then divided into post-training regime and model scale, before broader transfer and scaling discussion.
- Evidence and verification
The table distinguishes author-rerun results from a value estimated from another figure; adjacent prose qualifies the 72B 0.3-point increment as within per-entry standard error.
Problem, claim and contribution
Distinguishes contextually native trajectories, which preserve process structure, from environmentally native trajectories, which require real execution feedback.
Introduction and Figure 1, p. 2 · Main paper
Argument and section order
Data definitions precede training comparisons; robustness is then divided into post-training regime and model scale, before broader transfer and scaling discussion.
Sections 3-5, pp. 3-9 · Main paper
Figures, captions and visual explanation
The overview uses two parallel data paths with distinct coverage/authenticity roles. Table 1 exposes mid-training data, post-training data and method rather than collapsing them into a model-name leaderboard.
Figure 1, p. 2; Table 1, p. 6; both PNGs inspected · Main paper
Tables, comparisons and evidence
The table distinguishes author-rerun results from a value estimated from another figure; adjacent prose qualifies the 72B 0.3-point increment as within per-entry standard error.
Table 1 and Section 4.3, p. 6 · Main paper
Appendix and reproducibility
Prompt and rendered-PR examples show the exact supervision format. Decontamination defines the n-gram overlap denominator and reports removed evaluation instances.
Appendices C-E, pp. 15-18 · Main paper
Clarity and writing conventions
Exploratory SWE-Bench Pro/Multilingual results are explicitly withheld from comparative claims because repository sources overlap training data.
Section 4.4, p. 6 · Main paper
What to reuse—and what not to infer
Transferable lesson: Expose the whole training/evaluation recipe in comparison columns and place contamination or uncertainty qualifications next to the gain.
Boundary: The overview's best-baseline bar comparison is less controlled than the full table; retain table annotations and do not treat small increments as established improvements.
Apply this lesson using the argument and evidence worksheet.
Inspection record and sources
- Checked
- 2026-10-07
- Reading status
- Writing-focused manuscript scan + selected visuals inspected
- Main text
- Writing-focused distributed manuscript scan, not exhaustive technical/proof validation. Sections 1-7, pp. 1-9: deployment mismatch, two trajectory types, data construction, training/evaluation comparisons, scaling and conclusion.
- Appendix / supplement
- Writing-focused appendix scan; code, data and external assets not executed. Appendices A-E, pp. 14-18: stage and hyperparameter details, evaluation-infrastructure fixes, prompt/data-format examples and benchmark decontamination.
- Visually inspected PDF pages
- 2, 6
This is a writing-focused scan of the manuscript and the stated supplementary scope: framing, organization, visual explanation, evidence presentation and wording. It is not a line-by-line proof audit, reproduction of results or exhaustive scientific review.