Skip to content

Writing study: Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI

← ICLR 2026 oral writing corpus

Zheng Huang, Enpei Zhang, Weikang Qiu, Yinghao Cai, Carl Yang, Elynn Chen, Xiang Zhang, Rex Ying, Dawei Zhou, Yujun Yan · Official ICLR 2026 oral record

Figure, table and section ledger

Editorial contribution type: Architecture & representation design (primary) · Empirical analysis, diagnosis & auditing.

Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.

Canonical PDF
25 physical pages
Before references / appendix
≈ 10.32 page-equivalents
Main figures / tables
2 / 6
Attached appendix figures / tables
5 / 3
Attached appendix span
≈ 8.89 page-equivalents
Before references / appendix: ≈ 41.28%References / intervening material: ≈ 23.16%Attached appendix: ≈ 35.56%Estimated layout envelopes, not text/artwork area. Unresolved appendix boundaries remain within the undivided post-body material.
Section-by-section lengths and source pages

The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.

Top-level headingStarts on PDF pageEstimated spanShare of entire PDF
1 INTRODUCTION1≈ 0.97 pp.3.88%
2 PRELIMINARY2≈ 0.96 pp.3.84%
3 METHOD3≈ 2.97 pp.11.88%
4 EXPERIMENTS6≈ 3.16 pp.12.64%
5 RELATED WORK9≈ 1 pp.4%
6 CONCLUSION10≈ 0.38 pp.1.52%
7 ETHICS STATEMENT11≈ 0.11 pp.0.44%
8 REPRODUCIBILITY STATEMENT11≈ 0.11 pp.0.44%
REFERENCES11≈ 5.78 pp.23.12%
A A COMMON ERROR IN GENERATIVE MODELS17≈ 0.49 pp.1.96%
B PRELIMINARY: DIFFUSION MODEL17≈ 0.81 pp.3.24%
C DATASET18≈ 0.7 pp.2.8%
D BASELINES19≈ 0.63 pp.2.52%
E TRAINING DETAILS19≈ 0.59 pp.2.36%
F CASE STUDY ON OBJECT-LEVEL DESCRIPTIONS FOR IMAGE20≈ 0.47 pp.1.88%
G RECONSTRUCTION PERFORMANCE ACROSS DIFFERENT LATENT SPACES20≈ 0.46 pp.1.84%
H ANALYSIS ON THE NUMBER OF OBJECTS IN OUR FRAMEWORK21≈ 1.15 pp.4.6%
I ATTRIBUTE/RELATIONSHIP OPTIMIZATION DETAILS22≈ 0.69 pp.2.76%
J KEYWORD SEARCH WITH DIFFERENT INITIAL SETS23≈ 0.26 pp.1.04%
K PROMPTS USED BY PRISM23≈ 1.74 pp.6.96%
L THE USE OF LARGE LANGUAGE MODELS (LLMS)25≈ 0.89 pp.3.56%
All detected figure and table locations

Argument and organization

  1. Representation comparison

    Motivates structured text as the intermediate space before proposing PRISM.

  2. Description search, encoder training and object composition

    Separates training-time image annotation from fMRI-only reconstruction.

  3. Research-question experiments

    Tests reconstruction, latent-space choice and module contributions in order.

Problem, claim and contribution

Rather than opening with a new backbone, the paper asks which intermediate representation should connect brain signals and an image generator. The representation comparison supplies a rationale for the method.

Sections 1 and 3.1, pages 1–4 · Main paper

Argument and section order

Three explicit research questions map to the main performance table and ablations, while the keyword-search case study tests a more specific interpretation of the method.

Sections 4.1–4.4, pages 6–9 · Main paper

Figures, captions and visual explanation

Figure 1 separates annotation/search, supervised fMRI-to-text training and inference with horizontal bands. Its repeated elephant-and-car example makes the symbolic object descriptions concrete.

Figure 1, page 3 · Main paper

Tables, comparisons and evidence

Table 2 groups results by dataset and separates SDXL variants from the shared SD 2.1 backbone, avoiding a misleading comparison across different generators.

Table 2, page 7; Appendix D, page 19 · Main paper

Appendix and reproducibility

Exact description templates and an epsilon-greedy search algorithm expose otherwise hidden choices: two object slots, discrete spatial labels and a 667-image search subset.

Appendices H–K, pages 21–24 · Main paper

Clarity and writing conventions

Brain-alignment claims should remain empirical and model-dependent. The paper appropriately notes that its ROI interpretation needs further neuroscience validation, but some broader conclusions use stronger language than those comparisons warrant.

Section 4.4, page 9; conclusion page 10 · Main paper

What to reuse—and what not to infer

Transferable lesson: Use a motivating representation comparison to justify architecture, then make training-only supervision visibly distinct from information available at inference.

Boundary: Higher similarity to selected text encoders is not a general proof that the brain represents images as language. The practical model fixes two object groups and coarse spatial labels; its generated images are reconstructions, not direct visual readouts.

Apply this lesson using the argument and evidence worksheet.

Inspection record and sources

Checked
2026-09-19
Reading status
Full text + selected visuals inspected
Main text
Pages 1–10, Sections 1–6
Appendix / supplement
Pages 17–25, Appendices A–L, including prompt templates, search algorithm and training settings
Visually inspected PDF pages
3, 7