Writing study: Multimodal Aligned Semantic Knowledge for Unpaired Image-text Matching
← ICLR 2026 oral writing corpus
Laiguo Yin, Yixin Zhang, YUQING SUN, Lizhen Cui · Official ICLR 2026 oral record
Figure, table and section ledger
Editorial contribution type: Architecture & representation design (primary) · Learning & optimization algorithms.
Layout extraction, not a required paper template. Counts are distinct caption labels; a multi-panel figure counts once. Section spans are estimated from heading positions, including floats and whitespace. Method and limitations.
- Canonical PDF
- 28 physical pages
- Before references / appendix
- ≈ 10.18 page-equivalents
- Main figures / tables
- 3 / 6
- Attached appendix figures / tables
- 0 / 9
- Attached appendix span
- ≈ 14.89 page-equivalents
Section-by-section lengths and source pages
The title/abstract/front matter precede the first numbered heading. A span ends at the next detected top-level heading, not at the last sentence; end-page whitespace is included. References and statements are listed separately. These are not measurements of text-only or artwork area.
| Top-level heading | Starts on PDF page | Estimated span | Share of entire PDF |
|---|---|---|---|
| 1 INTRODUCTION | 1 | ≈ 1.15 pp. | 4.11% |
| 2 RELATED WORK | 2 | ≈ 0.65 pp. | 2.32% |
| 3 METHOD | 3 | ≈ 3.97 pp. | 14.18% |
| 4 EXPERIMENTS | 7 | ≈ 3.51 pp. | 12.54% |
| 5 CONCLUSION | 10 | ≈ 0.29 pp. | 1.04% |
| ACKNOWLEDGMENTS | 11 | ≈ 0.07 pp. | 0.25% |
| REFERENCES | 11 | ≈ 2.92 pp. | 10.43% |
| A TABLE OF NOTATION | 14 | ≈ 0.39 pp. | 1.39% |
| B PROOF: EQ. 8 FACILITATES THE CONSTRUCTION OF CORRESPONDING | 14 | ≈ 1.2 pp. | 4.29% |
| C PROOF: THE COSINE SIMILARITY IN EQ. 9 IS A REASONABLE DISTANCE | 15 | ≈ 1.15 pp. | 4.11% |
| D PROOF: THE OBJECTIVE EXISTENCE OF THE ISOMETRIC HYPOTHESIS. | 16 | ≈ 0.83 pp. | 2.96% |
| E PROOF: Lcm (EQ. (9)) ENCOURAGES f TO APPROACH THE ISOMETRY | 17 | ≈ 11.33 pp. | 40.46% |
All detected figure and table locations
Main text
Argument and organization
- Three deficiencies of aligned conceptual knowledge
Maps unseen vocabulary, within-concept variance and semantic relations to separate components.
- Knowledge construction, matching and re-ranking
Distinguishes training a semantic bridge from using it alone or with CLIP/ALBEF.
Problem, claim and contribution
The introduction enumerates three concrete limitations, and the contribution bullets mirror them; this makes the component-to-problem mapping easy to follow.
Section 1, pages 1–2. · Main paper
Argument and section order
Notation, mathematical arguments, optional domain adaptation, implementation and extra experiments occupy distinct appendix sections; exact detector and word-vector dependencies are recoverable.
Appendices A–J, pages 14–27. · Main paper
Figures, captions and visual explanation
Figure 2 separates knowledge acquisition above from inference below, with consistent colored concept symbols; the dense labels require enlargement and the training/inference boundary deserves explicit caption wording.
Figure 2, page 3. · Main paper
Tables, comparisons and evidence
Standalone matching and re-ranking receive separate tables, avoiding the misleading impression that the low-data knowledge model alone reaches CLIP-level recall.
Tables 1–2, pages 7–8. · Main paper
Appendix and reproducibility
Positive and negative retrieval examples explain which unseen words help and which abstract words harm, making the limitations operational rather than generic.
Appendix J.2 and Table 10, pages 24–25. · Main paper
Clarity and writing conventions
The prose calls prototype/pooling substitutions a minor effect, but Table 1 shows large recall-sum reductions. Interpretive adjectives should be checked against the displayed effect size.
Section 4.2, pages 7–8; Table 1. · Main paper
What to reuse—and what not to infer
Transferable lesson: Separate a reusable representation's construction, standalone evaluation and downstream re-ranking, and include negative cases that reveal when semantic transfer fails.
Boundary: Unpaired means no target-domain image–caption pairs, not no external supervision: Visual Genome region–word pairs and a pretrained detector are central. The appendix isometry arguments contain norm/dimension and uniform-error assumptions that should not be repeated as established general guarantees.
Apply this lesson using the argument and evidence worksheet.
Inspection record and sources
- Checked
- 2026-09-19
- Reading status
- Full text + selected visuals inspected
- Main text
- Pages 1–10, Sections 1–5; references on pages 11–13.
- Appendix / supplement
- Pages 14–28, Appendices A–L, including derivations, adaptation, implementation, negative examples and detector comparisons.
- Visually inspected PDF pages
- 3, 8