Skip to content

Writing study: ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data

← ICLR 2026 oral writing corpus

Zhaoyang Liu, JingJing Xie, Zichen Ding, Zehao Li, Bowen Yang, Zhenyu Wu, Xuehui Wang, Qiushi Sun, Shi Liu, Weiyun Wang, Shenglong Ye, Qingyun Li, Zeyue Tian, Gen Luo, Xiangyu Yue, Biqing Qi, Kai Chen, Bowen Zhou, Yu Qiao, Qifeng Chen, Wenhai Wang · Official ICLR 2026 oral record

Figure, table and section ledger

Editorial contribution type: Datasets, benchmarks & measurement resources (primary) · Inference, algorithms & systems efficiency.

Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.

Canonical PDF
60 physical pages
Before references / appendix
≈ 10.55 page-equivalents
Main figures / tables
6 / 4
Attached appendix figures / tables
26 / 16
Attached appendix span
≈ 42.89 page-equivalents
Before references / appendix: ≈ 17.58%References / intervening material: ≈ 10.93%Attached appendix: ≈ 71.48%Estimated layout envelopes, not text/artwork area. Unresolved appendix boundaries remain within the undivided post-body material.
Section-by-section lengths and source pages

The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.

Top-level headingStarts on PDF pageEstimated spanShare of entire PDF
1 INTRODUCTION1≈ 1.6 pp.2.67%
2 RELATED WORK3≈ 0.58 pp.0.97%
3 CROSS-PLATFORM INTERACTIVE DATA PIPELINE3≈ 2.06 pp.3.43%
4 THE DESIGN OF COMPUTER USE AGENTS5≈ 1.37 pp.2.28%
5 EXPERIMENTS7≈ 3.5 pp.5.83%
6 CONCLUSION10≈ 0.42 pp.0.7%
ACKNOWLEDGMENTS11≈ 0.08 pp.0.13%
ETHICS STATEMENT11≈ 0.22 pp.0.37%
REPRODUCIBILITY STATEMENT11≈ 0.15 pp.0.25%
REFERENCES11≈ 6.56 pp.10.93%
A APPENDIX18≈ 42.89 pp.71.48%
All detected figure and table locations

Argument and organization

  1. Data infrastructure before agent design

    A collection bottleneck motivates a hybrid pipeline, then three inference modes and platform-specific evaluations.

  2. Engineering evidence and replication details

    Diagnostics and ablations precede an extensive appendix of collection procedures, failure examples and exact prompts.

Problem, claim and contribution

The paper makes a defensible engineering contribution explicit: collecting consistent GUI trajectories across heterogeneous platforms is the bottleneck, rather than a claimed new model architecture.

Sections 1 and 3; page 5 discussion. · Main paper

Argument and section order

Understanding, grounding and task completion recur as dataset families and evaluation dimensions. The separate grounding, direct-action and reasoned-action modes prevent conflating a localizer with an autonomous planner.

Sections 3.2, 4.2 and 5.1; Figure 3. · Main paper

Figures, captions and visual explanation

Figure 2 groups environment interaction, raw trajectories and annotated training tasks into legible containers, with separate arrows for collection and training. It makes the human-versus-agent data origins visible.

Page 4, Figure 2. · Main paper

Tables, comparisons and evidence

Table 3 separates native agents from planner–grounder workflows and labels step budgets, including unknown or larger budgets. Its platform columns expose weak macOS results instead of hiding them in one average.

Page 8, Table 3. · Main paper

Appendix and reproducibility

Platform-specific parsing failures, browser-native dialogs and benchmark revisions are documented alongside prompts. These details explain why evaluation environments and screenshots are part of the experimental specification.

Appendices A.8–A.10, pages 38–60. · Main paper

Clarity and writing conventions

Example tables require the same checking as metrics: the referring-OCR row repeats a search-bar appearance answer despite an Apple Watch screenshot, and a functionality row uses a position prompt. These visible mismatches weaken otherwise useful task definitions.

Page 34, Table 17. · Main paper

What to reuse—and what not to infer

Transferable lesson: For a data-engineering contribution, connect acquisition decisions to task-aligned ablations, and publish the inconvenient platform failures and benchmark modifications needed to reproduce the claim.

Boundary: Strong grounding does not establish universal planning or safety. WebArena-Lite-v2 modifies the original benchmark; native and GPT-4o-planner results are different systems. Cross-platform data is not uniformly better than domain-only data. Synthetic rationales can use hindsight during annotation, and public release claims were not independently audited here.

Apply this lesson using the argument and evidence worksheet.

Inspection record and sources

Checked
2026-09-19
Reading status
Full text + selected visuals inspected
Main text
Pages 1–11, Sections 1–6, limitations, ethics and reproducibility; references through page 17.
Appendix / supplement
Pages 18–60, A.1–A.10: additional results, public data, actions, failures, curation, data examples, platform-specific collection lessons, benchmark revisions and all prompt templates.
Visually inspected PDF pages
4, 8, 34