- TROLL: Trust Regions Improve Reinforcement Learning for Large Language Models
The primary reading route follows the annotated argument: Clipping failure and related work → Projection and sparse implementation → Experiments, ablations and appendix. The introduction narrows the intervention to PPO-like clipping while preserving the surrounding estimator and inference behavior, making the claimed novelty unusually easy to locate.
- Multiplayer Nash Preference Optimization
The primary reading route follows the annotated argument: From two-player preferences to populations → Homogeneous formulation and extensions → Evaluation and technical appendix. Use a comparison matrix to make a unifying framework falsifiable: specify which settings recover each baseline. Keep theoretical guarantees attached to the assumptions that support them, especially when introducing a practical extension.
- Shoot First, Ask Questions Later? Building Rational Agents that Explore and Act Like People
The primary reading route follows the annotated argument: Controlled game and Bayesian formalization → Human study then agent decomposition → Replication and appendix. The game creates a measurable exploration/action tradeoff with a binary answer bottleneck; this is a narrower and testable claim than general rational agency.
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
The primary reading route follows the annotated argument: Problem formulation and GEPA → Evaluation: numbered observations → Extended applications and appendix. The title says the method can outperform RL, while the formulation explicitly permits prompt-space versus weight-space optimization; this helps readers understand what is actually being compared.
- Mastering Sparse CUDA Generation through Pretrained Models and Deep Reinforcement Learning
The primary reading route follows the annotated argument: Introduction and related work → SparseRL → Experiments, ablations, and discussion → Appendix A. The opening two-kernel example grounds the problem in different correct implementations with different runtimes. This motivates a hardware-aware objective more concretely than a generic claim about code-generation capability.
- Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)
The primary reading route follows the annotated argument: Background and common matching loss → Universal inverse distillation and real data → Unified experiments → Theoretical and experimental appendices. Two explicit gaps—fragmented distillation formulations and adversarial machinery for incorporating real data—map directly onto the two contributions. The background establishes shared notation before claiming universality.
- Discount Model Search for Quality Diversity Optimization in High-Dimensional Measure Spaces
The primary reading route follows the annotated argument: A concrete stagnation failure → Formal QD and algorithm lineage → Method, new setting, controlled comparisons. The hiker example distinguishes optimizing one image from seeking a diverse archive, making the unusual optimization objective understandable.
- Modality-free Graph In-context Alignment
The primary reading route follows the annotated argument: Three criteria for graph ICL → Fingerprints, alignment and episodic matching → Node transfer, edge transfer and ablations. A compact criteria table establishes which combination is claimed new before introducing the method.
- Revela: Dense Retriever Learning via Language Modeling
The primary reading route follows the annotated argument: Motivation and in-batch language modeling → Benchmarking followed by controlled analysis. The introduction makes the missing supervision problem concrete before proposing next-token prediction as the training signal, rather than introducing another retrieval loss without motivation.
- Exploring Synthesizable Chemical Space with Iterative Pathway Refinements
The primary reading route follows the annotated argument: Projection rather than unconstrained generation → Representation, bidirectional search and holistic edits. The introduction explains why heuristic synthesizability scores are insufficient and why projection can complement an existing molecular optimizer, giving the contribution a practical interface.
- PateGAIL++: Utility Optimized Private Trajectory Generation with Imitation Learning
The primary reading route follows the annotated argument: Privacy challenge to three design components → Utility, attacks and deployment variants. The introduction motivates adaptive noise using distinctive versus common trajectories, making the application-level concern concrete before introducing DP notation.
- Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary Loss
The primary reading route follows the annotated argument: Three principles and three computation steps → Performance, scale and specialization. The problem is defined as a mismatch between router decisions and expert responses, not simply a demand for more expert diversity. Three design principles constrain the proposed fix.
- Exploratory Causal Inference in SAEnce
The primary reading route follows the annotated argument: Motivation and failure → Algorithm, guarantees, evidence. The introduction connects hypothesis-driven trials to exploratory discovery using a concrete ant-behaviour example rather than an abstract foundation-model promise.
- Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning
The primary reading route follows the annotated argument: Practical evaluation before model design → Cold start, preference alignment, online exploration. The introduction identifies a protocol mismatch, not merely an accuracy deficit: single-source training underrepresents realistic mixed-source deployment.
- Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
The primary reading route follows the annotated argument: Evaluation, data, model → Shared reward objective, distinct model families. Modality imbalance and fixed implicit preferences are introduced as separate obstacles; free-form criteria are part of the formal sample tuple, making the second obstacle operational.
Mixed contribution: Data, benchmark and two reward-model families are all named contributions. Primary learning/optimization is a browsing choice, not an exclusive account of the paper.
- Half-order Fine-Tuning for Diffusion Model: A Recursive Likelihood Ratio Optimizer
The primary reading route follows the annotated argument: Estimator design space → RLR and diffusion experiments → Theory and implementation appendix. The opening compares full differentiation, truncated differentiation and policy gradients as competing resource tradeoffs; this gives the hybrid design an intelligible motivation before its equations.
- FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability–Plasticity Tradeoff
The primary reading route follows the annotated argument: Two measurable desiderata → Theory to a short iteration → Three learning regimes. The paper explicitly distinguishes continual adaptation with old data available from restricted-memory catastrophic-forgetting settings. This scope statement prevents an otherwise ambiguous stability claim.
- Stable Video Infinity: Infinite-Length Video Generation with Error Recycling
The primary reading route follows the annotated argument: Train–test mismatch → Closed-loop error recycling → Generation regimes and stress tests. The introduction reframes drifting as a training–inference mismatch and contrasts generation with restoration. This motivates training on errors rather than adding another inference-time heuristic.
- Visual Planning: Let's Think Only with Images
The primary reading route follows the annotated argument: A different reasoning medium → Initialization then reinforcement learning → Performance, failure analysis and generalization. The first comparison diagram makes the proposed change of representation explicit: actions emerge from image-state transitions instead of being verbalized. It frames visual planning as a supplement, not a universal replacement for language.
- Fast training of accurate physics-informed neural networks without gradient descent
The primary reading route follows the annotated argument: Two bottlenecks and space–time separation → Constructing and solving the reduced system → Experiments organized by PDE difficulty. The introduction names optimization difficulty and non-causal time treatment separately, then maps the proposed solver components to those obstacles.
- DiffusionNFT: Online Diffusion Reinforcement with Forward Process
The primary reading route follows the annotated argument: Move reinforcement to the forward process → Positive/negative policy geometry and implicit objective → Multi-reward results, head-to-head speed and stability ablations. A single question about forward versus reverse optimization gives the paper a clear organizing contrast instead of an undifferentiated list of engineering improvements.
- Pareto-Conditioned Diffusion Models for Offline Multi-Objective Optimization
The primary reading route follows the annotated argument: Offline MOO as conditional sampling → Benchmark breadth, component ablations and limitations. The introduction states a concrete tension: improve beyond a fixed dataset without exploiting unreliable surrogate predictions. This motivates direct conditioning and gives each method component a clear purpose.
- Enhancing Generative Auto-bidding with Offline Reward Evaluation and Policy Search
The primary reading route follows the annotated argument: Introduction → Preliminaries / Method → Experiments → Appendices A–I. The opening contrasts bootstrapped offline RL with conditional trajectory imitation, then identifies missing quality feedback and unprincipled extrapolation as distinct problems. Contributions answer those problems in the same order.
- Overthinking Reduction with Decoupled Rewards and Curriculum Data Scheduling
The primary reading route follows the annotated argument: Introduction / Preliminaries / Rethinking Length Rewards → Decoupled Rewards and Curriculum Data Scheduling → Experiments / Analysis → Appendices A–I. Two failure modes—penalizing essential reasoning and rewarding redundant continuations—organize both the analysis and method. The problem is credit assignment inside a sequence, not an assertion that all long reasoning is undesirable.
- Mean Flow Policy with Instantaneous Velocity Constraint for One-step Action Generation
The primary reading route follows the annotated argument: Introduction / Preliminaries → Mean velocity policy / Instantaneous constraint → Mean flow RL / Experiments → Appendices A–F. The opening converts a practical control bottleneck into a specific question: whether expressive action distributions require repeated numerical integration. The proposed answer concerns a mean-velocity policy, rather than treating all generative policies as inherently slow.
- Huxley-G\"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine
The primary reading route follows the annotated argument: Introduction / Self-improving as tree-search → Huxley–Gödel Machine → Experiments → Appendices A–F. The paper gives a precise name to the gap between current benchmark performance and future self-improvement potential. It then defines separate expansion, evaluation and scheduling decisions, making the proposed optimization target easier to distinguish from task accuracy.
- Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression Prediction
The primary reading route follows the annotated argument: Current methods do not benefit from long sequence input → Method → Experiments and extended analyses. The introduction challenges context length with two complementary diagnostics: retraining at different lengths and truncating a long-trained model at test time. That distinction strengthens the motivation beyond a single favorable short-input comparison.
- Improving Diffusion Models for Class-imbalanced Training Data via Capacity Manipulation
The primary reading route follows the annotated argument: Motivation and theoretical insights → Capacity Manipulation → Experiments and further analysis. The opening diagnostic is specific: similar raw diffusion losses coexist with minority sensitivity to removing small-magnitude parameters. This motivates a capacity-allocation hypothesis without making loss imbalance the sole explanation.
- LLM Fingerprinting via Semantically Conditioned Watermarks
The primary reading route follows the annotated argument: Fingerprint paradigm and instantiation → Effectiveness, robustness and stealth → Detector, ablations and examples. The introduction identifies two independent weaknesses in query–key fingerprints, then replaces both with a semantic query domain and a distributed statistical signal. That parallel problem–solution structure makes the novelty easy to locate.
- Reducing Belief Deviation in Reinforcement Learning for Active Reasoning of LLM Agents
The primary reading route follows the annotated argument: Failure mechanism to operational proxy → Outcomes and mechanism diagnostics. A repeated-question failure becomes a named mechanism before a method is proposed, giving the reader a causal narrative rather than a collection of optimization tricks.
- Learning to Segment for Vehicle Routing Problems
The primary reading route follows the annotated argument: Empirical stability motivates a decomposition theorem → Complementary decoders and practical validation. An observable inefficiency—many route edges do not change—provides a concrete motivation before architecture details.
- LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
The primary reading route follows the annotated argument: Data difficulty as the bottleneck → Generalization, preservation and attribution. The introduction turns a vague need for better reasoning into three obstacles: task difficulty, expensive long rollouts and short-task retention.
- Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment
The primary reading route follows the annotated argument: A two-level corruption taxonomy → Training robustness and inference reasoning. Concrete mismatches explain why noisy correspondence differs from merely missing modalities; a manual sample audit supports the practical motivation.
- Optimistic Task Inference for Behavior Foundation Models
The primary reading route follows the annotated argument: Offline limitation → online task inference → Preliminaries → regret analysis → practical method → Question-led experiments. The opening contrasts collecting labels for an existing dataset with actively requesting rewards during deployment; this identifies the changed information-access assumption, not merely an improved return.
- Radiometrically Consistent Gaussian Surfels for Inverse Rendering
The primary reading route follows the annotated argument: Unobserved-direction failure → physical consistency → Principle → ray tracing → two-stage framework → Quality → ablation → adaptation cost. The gap is precise: radiance trained only from camera views remains unconstrained along directions needed for indirect illumination. Related work differentiates cached radiance, learnable residual light and differentiable tracing.
- AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms
The primary reading route follows the annotated argument: Training-cost motivation → measured search state → Sense → reason → act → Solver benchmarks → component and frequency ablations. The method deliberately leaves the numerical optimizer in place and uses language models as hyperparameter supervisors; this distinguishes the work from generating candidate solutions or new operators.
- P-GenRM: Personalized Generative Reward Model with Test-time User-based Scaling
The primary reading route follows the annotated argument: Two personalization failures → evaluation chains → Three training stages → two scaling levels → Preference accuracy → prototypes → OOD and policy evaluation. The introduction distinguishes scenario-dependent preferences from sparse-history generalization, allowing persona-conditioned rubrics and prototype transfer to answer different questions.
- Semi-Supervised Preference Optimization with Limited Feedback
The primary reading route follows the annotated argument: Scarce comparisons to thresholded unpaired responses → Toy validation, real-data results, and mechanism checks. The introduction identifies an available but structurally incompatible resource—single SFT responses—and explains why pairwise preference methods cannot directly consume it.
- In-Place Test-Time Training
The primary reading route follows the annotated argument: Three barriers and matching design choices → Three experimental questions. The introduction and preliminary desiderata use the same three-part organization, making each proposed component answer a named limitation.
- Token-Importance Guided Direct Preference Optimization
The primary reading route follows the annotated argument: Introduction, related work, preliminaries → Methodology → Experiments and appendices. Two claimed gaps—token-importance estimation and coarse preference supervision—map directly onto the two proposed components.
- Uncover Underlying Correspondence for Robust Multi-view Clustering
The primary reading route follows the annotated argument: Introduction and related work → Generative formulation and EM procedure → Question-led experiments and appendices. Figure 1 gives one concrete image–text example before contrasting reweighting, realignment, and many-to-many correspondence generation. The two mismatch definitions then formalize exactly what those illustrations are meant to solve.
- Information Shapes Koopman Representation
The primary reading route follows the annotated argument: Three representation desiderata and five theoretical questions → Practical objective and proposition-led experiments. Table 1 translates the familiar information-bottleneck formulation into a dynamical prediction setting before introducing additional Koopman constraints.
Mixed contribution: A practical representation objective is derived from propositions; this is theory-guided learning rather than a theory-only contribution.
- TD-JEPA: Latent-predictive Representations for Zero-Shot Reinforcement Learning
The primary reading route follows the annotated argument: Bridge two vocabularies → Derive before specializing → Separate guarantees and empirical questions. The introduction locates the gap along three independent axes: single-step prediction, single-policy learning and dependence on on-policy data. It then names the components that address them. This is a useful way to explain a combination of established ideas without pretending each component is new.
- DTO-KD: Dynamic Trade-off Optimization for Effective Knowledge Distillation
The primary reading route follows the annotated argument: Two optimization failures → Vector objective and implementation → Tasks, ablations and limitations. The introduction gives two distinct bottlenecks memorable names, then reuses them in the method and gradient diagnostics. This makes the proposed optimization change easier to locate than a generic compression motivation alone.
- RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format
The primary reading route follows the annotated argument: Parameter-space observation followed by its limitation → Two-stage method and research-question-led evaluation. The motivating failure is concrete: a correct reasoning answer can still violate a requested format. The paper distinguishes parameter compatibility from behavioral compatibility.
- SafeDPO: A Simple Approach to Direct Preference Optimization with Enhanced Safety
The primary reading route follows the annotated argument: Hard constraint to optimal policy to transformed pair data → Safety, helpfulness and over-refusal as separate outcomes. The introduction makes reduced training complexity concrete by contrasting auxiliary reward/cost networks with a transformed preference dataset.
- One for Two: A Unified Framework for Imbalanced Graph Classification via Dynamic Balanced Prototype
The primary reading route follows the annotated argument: Introduction and preliminaries → Method and experiments → Appendices A–J. Two clearly named imbalance axes create a testable unification claim; graph-level classification is distinguished from node- and edge-level tasks.
- In-the-Flow Agentic System Optimization for Effective Planning and Tool Use
The primary reading route follows the annotated argument: Preliminary and AgentFlow → Flow-GRPO and experiments → Algorithm, theory and operational appendix. Make training ownership, runtime collaboration and evaluation access separately visible, and pair behavioral claims with trace-level evidence that survives checking.
- Q-RAG: Long Context Multi‑Step Retrieval via Value‑Based Embedder Training
The primary reading route follows the annotated argument: Methods → Experiments and ablations → Appendices. The contrast is explicit: train state/action embedders while leaving the answer-generating LLM frozen. The main text honestly states that reported rewards use supporting facts, not the proposed future LLM-feedback alternative.
- DCFold: Efficient Protein Structure Generation with Single Forward Pass
The primary reading route follows the annotated argument: Bottlenecks and dual consistency → Temporal geometry and applications. The opening decomposes runtime before proposing acceleration, making the two consistency targets traceable to measured bottlenecks rather than a generic compression claim.
- LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learning
The primary reading route follows the annotated argument: Three explicit research questions → Complementary evaluation and case studies. Use research-question headings and matched learning curves to connect design choices with evidence, and publish evaluation prompts plus specific observed failure modes.
- WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training
The primary reading route follows the annotated argument: Scheduling problem and algebraic bridge → Main comparison and factor analysis → Implementation and broader controls. The initial comparison diagram makes the operational difference visible: keep the live training rate stable and form evaluation models from stored checkpoints. Scheduling flexibility is distinguished from downstream performance.
- FALCON: Few-step Accurate Likelihoods for Continuous Flows
The primary reading route follows the annotated argument: Explain why likelihood accuracy changes the task → Separate the mathematical target from the finite model → Make cost and quality auditable. The paper motivates a specific bottleneck: a molecular proposal must have sufficiently accurate likelihoods for importance reweighting, not merely produce plausible samples. Its contribution bullets separate the objective, architecture, evaluation cost and sample quality. Table 1 compares model families against explicit requirements, making the gap more concrete than a generic faster-generator claim.
- Task-free Adaptive Meta Black-box Optimization
The primary reading route follows the annotated argument: Task-free motivation and formalization → Attention-based evolutionary operators → Four research questions. The opening comparison distinguishes learning from a task distribution from learning during a single optimization run. The phrase task-free is defined operationally, not as absence of a target task.
- Compactness and Consistency: A Conjoint Framework for Deep Graph Clustering
The primary reading route follows the annotated argument: Two representation deficiencies → Local/global extraction, compactness and consistency → Layered empirical audit. The two stated deficiencies map directly to the local/global views and compactness module, making the method’s organization predictable from the introduction.
- Taming Momentum: Rethinking Optimizer States Through Low-Rank Approximation
The primary reading route follows the annotated argument: EMA as online regression → Factorized moments → Pretraining, fine-tuning and rank ablations. The central equivalence is stated as one short equation before the full method. This creates an accessible entry point into optimizer-state compression without beginning with several pages of matrix calculus.
- FlashWorld: High-quality 3D Scene Generation within Seconds
The primary reading route follows the annotated argument: Two generation paradigms and their opposing defects → Dual-mode pretraining → cross-mode distillation → OOD co-training. The early comparison grid gives names and visible failure modes to the multi-view-oriented and 3D-oriented alternatives before explaining why naive distillation is insufficient.
- Plug-and-Play Compositionality for Boosting Continual Learning with Foundation Models
The primary reading route follows the annotated argument: Compositional motivation → concept extraction → relational distillation → Matched baseline pairs → component controls → visual mechanism. For an add-on method, present matched with/without pairs across host algorithms, isolate capacity and representation-use controls, and disclose both reusable preparation cost and per-host overhead.
- Efficient Resource-Constrained Training of Transformers via Subspace Optimization
The primary reading route follows the annotated argument: Memory bottlenecks and decomposition precedents → Stable subspaces and joint iteration → Hypothesis tests, tradeoffs and devices. The introduction distinguishes reducing trainable parameters from reducing saved activations or inference work. This taxonomy clarifies the specific gap claimed for joint weight-activation compression.
- The Polar Express: Optimal Matrix Sign Methods and their Application to the Muon Algorithm
The primary reading route follows the annotated argument: Application-specific numerical requirements → Scalar minimax reduction and greedy construction → Finite precision and measured optimizer effects. The paper motivates a numerical-linear-algebra contribution through throughput and precision requirements, explicitly holding Muon's update rule fixed. This keeps the algorithmic claim narrower than inventing a new optimizer.
Mixed contribution: A numerical algorithm improves an existing optimizer and has an explicit optimality class. Its theorem and systems performance must remain attached to the algorithmic claim.
- Planner Aware Path Learning in Diffusion Language Models Training
The primary reading route follows the annotated argument: Planner-aware likelihood and its practical surrogate → Experiments and appendix. The boxed question names a precise mismatch: training with uniform unmasking while sampling with a confidence-based planner. This is more informative than claiming diffusion language models are generally inefficient.
- TRACE: Your Diffusion Model is Secretly an Instance Edge Detector
The primary reading route follows the annotated argument: Observed transient instance cues → IEP, ABDiv, distillation and propagation → Benefits and domain failures. Two visible errors—merging adjacent objects and fragmenting single objects—organize the motivation. The proposed boundary cue answers those errors directly rather than treating generative features as generally superior representations.
- Generative Universal Verifier as Multimodal Meta-Reasoner
The primary reading route follows the annotated argument: Three research questions → Atomic verification capabilities → Sequential generation and editing. The introduction's three questions map directly to benchmark, training and application sections. This gives a multi-contribution paper a coherent dependency chain: establish a verification gap, train a verifier, then test whether its feedback improves generation.
Mixed contribution: Benchmark diagnosis, verifier training and application are three linked contributions; learning/optimization is the chosen primary, not a statement that the benchmark is unimportant.
- Through the Lens of Contrast: Self-Improving Visual Reasoning in VLMs
The primary reading route follows the annotated argument: Contrastive observation and data construction → Think, contrast and rethink → Baseline comparisons and design questions. A skateboard example motivates the narrower question of repairing visually ungrounded rationales. The opening observation is concrete, but correct final answers and selected examples do not alone verify every intermediate visual claim.
- MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent
The primary reading route follows the annotated argument: Long-document bottleneck and memory workflow → Multi-conversation outcome-reward optimization → Length sweeps, ablations and failure traces. The central distinction is processing millions of input tokens through repeated bounded-context calls, not creating a million-token attention window. The 1,024-token memory is overwritten after each 5,000-token chunk; the question remains available throughout processing.
- EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning
The primary reading route follows the annotated argument: Three obstacles to emotional explanation → Prosody supervision and progressive rewards → Recognition and explanation evaluation. The three-challenge introduction provides a direct outline for dataset construction, prosody-centric SFT and reward design. However, plausible explanations of an emotion label are not necessarily causal explanations of the model's actual decision.
- Neon: Negative Extrapolation From Self-Training Improves Image Generation
The primary reading route follows the annotated argument: Reverse a short self-training update → Local gradient geometry → Families, trade-offs and implementation details. The paper turns self-training degradation into a constructive question: can reversing the update help? The one-line merge keeps the intervention memorable while distinguishing training-time adaptation from extra inference-time guidance or model compression.
- Exploratory Diffusion Model for Unsupervised Reinforcement Learning
The primary reading route follows the annotated argument: Exploration bottleneck and two-stage method → Theory, practical algorithms and research questions → Proofs and reproducibility supplement. The opening gives diffusion two distinct jobs: model heterogeneous replay data and provide a reusable policy prior. Gaussian acting is then motivated by interaction cost rather than presented as an unrelated component.
- Conformal Robustness Control: A New Strategy for Robust Decision
The primary reading route follows the annotated argument: Coverage is sufficient but not necessary → Parameterized empirical optimization and theory → Calibration and experiments. The introduction contrasts the desired event—loss below a certificate—with the stronger event that the outcome lies in a prediction set. This precise sufficient-versus-necessary distinction supplies the entire motivation.
- Hyperparameter Trajectory Inference with Conditional Lagrangian Optimal Transport
The primary reading route follows the annotated argument: A new inference task before a method → Two inductive biases and multiple demonstrations. Concrete reward-weight and quantile examples explain why the surrogate predicts output distributions rather than a scalar Bayesian-optimization objective; notation links the user problem to trajectory inference.