AI Research & Papers
整理大Models、智能体、多模态、机器学习与生成式 AI 的Research、基准和研究进展。
Category articles1528
当前页1 / 39
UpdatesPermanent archive
Category articles
按发布Time从新到旧 · 每页 40 stories
ResearchOrdinary
Sensorimotor Alignment: A Platonic Proxy for Embodied Policy Success
Robotic foundation models are typically evaluated through costly closed-loop rollouts, which motivates cheap offline proxies for model capability. The Platonic Representation Hypothesis (PRH) suggests that as representations improve, diffe…
Source: arXiv
ResearchOrdinary
Direct Pass@$k$ Optimization for Thought Pruning: Balancing Quality and Diversity in Test-Time Reasoning
Test-time scaling has emerged as a key inference strategy for reasoning models, where a model generates a large number of candidate solutions in the hope of finding at least one correct solution. Running all candidate solutions to completi…
Source: arXiv
ResearchOrdinary
Phase Transition from Random Features to Fully Trainable Networks
Constructing accurate and computationally tractable approximation spaces is a fundamental task in scientific computing. Partially trainable neural networks bridge fixed random features and fully adaptive representations. This paper quantif…
Source: arXiv
ResearchOrdinary
Reliable AI-Assisted Decisions via Selective Auditing
We consider online monitoring of an AI system that produces a sequence of decisions. At each round, the system outputs a proposed decision together with a confidence score estimating the trustworthiness of the decision. The decision and co…
Source: arXiv
ResearchOrdinary
SpectralCanary: Embarrassingly Simple Low-Frequency Traces for T2I Dataset-Use Auditing
Auditing whether a text-to-image (T2I) model was fine-tuned on a particular image collection is difficult: a model can absorb collection-level visual characteristics without reproducing training images. Proactive dataset-use auditing plant…
Source: arXiv
ResearchOrdinary
Cost-Aware Abstention for LLM-Based IT Ticket Classification
Wrong automatic routing of an IT support ticket can cost more than human triage. We evaluate cost-aware abstention as an offline, cost-conditional readiness assessment: select a routing policy on calibration data under explicit costs, then…
Source: arXiv · GPT
ResearchOrdinary
METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning
Meta-reinforcement learning aims to train agents that adapt quickly to unseen tasks from limited interaction, but this requires representing task evidence over long interaction histories. Classical recurrent agents compress experience into…
Source: arXiv
ResearchOrdinary
EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence
Tool-using language model agents rely on environmental facts to decide whether an action is permitted. When a tool response omits a safety-relevant fact, an agent may carry out a prohibited action even though the user request is benign and…
Source: arXiv
ResearchOrdinary
Low-Bit N-Gram Embeddings for Language Models
Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of consecutive tokens, which the model retrieves duri…
Source: arXiv · GPT / DeepSeek / Qwen
ResearchOrdinary
A Fix for Softmax and Cross-Entropy
Standard implementations of softmax, log-softmax, and cross-entropy have two numerical bugs. The first bug, Softmax Collapse, rounds the target logit's gradient to zero if that one logit is much larger than the others, resulting in gradien…
Source: arXiv
ResearchOrdinary
Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation
Chain-of-thought (CoT) prompting elicits step-by-step rationales that appear to explain model predictions, but there is no guarantee these steps causally drive the final answer. In standard autoregressive generation, dense attention allows…
Source: arXiv
ResearchOrdinary
Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2
Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leaving the failure modes of individual languages unanticipated. We use an LLM once, as a corpus debugger rather than a classifier: a tool-using agent ex…
Source: arXiv
ResearchOrdinary
BeNice! Closing Looping's Inference-Memory Gap via KV-Sharing
Looped architectures scale quality while keeping parameter count fixed by repeatedly passing activations through the same block of layers. During inference, each recurrence generates independent KV-caches, causing memory to grow linearly. …
Source: arXiv · Kimi
ResearchOrdinary
Questioning Instrumental Convergence in RLVR: Checkpoint Evidence from OLMo-3
Instrumental convergence is often invoked as a general reason to expect capable agents to acquire or express power-seeking subgoals: self-preservation, resource acquisition, deception, or resistance to oversight which poses an important th…
Source: arXiv
ResearchOrdinary
Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading
While monolingual language model (LM) surprisal is widely established as a predictor of reading times, it cannot capture the non-native (L2) reading dynamics that are shaped by the reader's first language (L1). In this work, we investigate…
Source: arXiv
ResearchOrdinary
OP-Print: Tracing Membership Imprints in On-Policy Self-Distillation
On-policy distillation has been widely adopted for alleviating the distribution mismatch of off-policy distillation. Self-distillation further removes the need for an external teacher by using the student's own outputs, enhanced with extra…
Source: arXiv
ResearchOrdinary
Efficient and Optimal Learning of Discrete Distributions with Person-Level Privacy
We study learning a discrete distribution under person-level differential privacy in the batched setting. Given $n$ users, each contributing $m$ i.i.d. samples from an unknown distribution $μ$ over $[k]$, we seek an estimate of $μ$ with to…
Source: arXiv
ResearchOrdinary
How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions
Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrieval-augmented generation (RAG) system over breast lesion management literature, addressing the dependence of retrieval scores on annotation coverage.…
Source: arXiv · DeepSeek
ResearchOrdinary
CRANE: Post-Hoc Counterfactual Retrieval for Multimodal Classifiers
Counterfactual explanation methods have been introduced for unimodal settings, with dedicated frameworks for tabular, timeseries, text, and image data, yet no post-hoc method has been designed for classifiers that learn from multimodal inp…
Source: arXiv
ResearchOrdinary
Simulated Control Evals
Control evaluations measure whether safeguards can prevent an AI model from causing undesired outcomes even when it is intentionally trying to do so. These evaluations typically use purpose-built control settings and extrapolate their resu…
Source: arXiv
ResearchOrdinary
LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning of large language models (LLMs), but it needs training data that are long, diverse, challenging, and verifiable. Human annotation of such data is expe…
Source: arXiv
ResearchOrdinary
Think Harder Where It Matters: Item-Level Adaptive Recursion for Sequential Recommendation
Existing sequential recommenders usually allocate a fixed computational budget to every item in a user's interaction history, regardless of the item's contribution to the final prediction. We challenge this de facto design with two diagnos…
Source: arXiv
ResearchOrdinary
PhysiCalWorld: In-Context Physics Calibration for World Models
Existing world models typically perceive a scene through current visual frame or a narrow history window. However, these observations may not reveal the physics properties that determine transition dynamics, such as an object's mass distri…
Source: arXiv
ResearchOrdinary
A Quasipolynomial Algorithm for $\ell_\infty$ Contractions
We give an algorithm for computing an $\eps$-approximate fixed point of any $d$-dimensional nonexpansion with respect to the $\ell_\infty$ norm in time $\log(1/\eps)^{O(\log^2 d)}$. At its core, our method uses a boosting argument to geome…
Source: arXiv
ResearchOrdinary
Self-normalized Bernstein Inequalities for Regenerative Processes and Applications to Learning Without Independence
We prove a self-normalized Bernstein inequality for bounded functions of a regenerative process with independent, identically distributed marked cycles of finite mean length. The bound uses observed cycle lengths and retains explicit terms…
Source: arXiv
ResearchOrdinary
The role of locality and weight sharing in convolutional neural networks
The success of convolutional neural networks is often attributed to locality and weight sharing. However, how these two properties separately shape learning, and how their effects depend on the spatial correlations of natural images, remai…
Source: arXiv
ResearchOrdinary
Environment Duels: A Microcosm of LLM Co-Evolution
Through a tangle of real-world interactions, from synthetic training pipelines to data shared on the open web, frontier LLMs absorb what their predecessors and competitors create. How well does each model play its role in this ecosystem, a…
Source: arXiv · Qwen
ResearchOrdinary
The End of Consensus Research?
Consensus is a fundamental problem in distributed computing and at the core of state machine replication (SMR). Despite decades of active human research, discovering practical low-latency solutions to the problem is still open, as it requi…
Source: arXiv
ResearchOrdinary
Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research
Quantitative research is an iterative loop: a researcher proposes a market hypothesis, implements it as an executable signal, tests it on historical data, and decides what to keep. Existing benchmarks score formulas, code, or individual tr…
Source: arXiv · GPT
ResearchOrdinary
Minimax Optimality of the NPMLE for Gaussian Mixtures in Hellinger Distance
We analyze the problem of estimating univariate Gaussian mixture densities using the nonparametric maximum likelihood estimator (NPMLE) based on $n$ independent and identically distributed samples. We show that the unconstrained NPMLE achi…
Source: arXiv
ResearchOrdinary
Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use
Multimodal agents (MMAs) sustain interaction through reasoning, memory, tools, and feedback, most visibly as computer-use agents, while robotic systems (RSs) couple sensing and actuation under physical dynamics. We define multimodal embodi…
Source: arXiv
ResearchOrdinary
Velocity Ambiguity Profiles: Time-Resolved Bayes-Risk Diagnostics for Flow Matching
Flow matching trains a continuum of velocity regression problems but usually reports a loss averaged over interpolation time, obscuring which regions are limited by intrinsic ambiguity and which remain data-limited. We introduce the Veloci…
Source: arXiv
ResearchOrdinary
Asymmetric On-Policy Distillation Learns In-Context Exploration
Sequential decision-making under partial observability is difficult because agents must explore to infer hidden, task-relevant information before acting effectively. Learning such information-gathering behaviors tabula rasa via online rein…
Source: arXiv
ResearchOrdinary
BatchBench: Benchmarking AI Robustness to Batch Effects and Domain Shift in Biomedical Images - A JUMP Cell Painting Leaderboard
Despite recent advances, current AI systems remain highly susceptible to domain shifts, particularly in biomedical imaging, where images are usually acquired under substantially different experimental conditions. Although recent domain ada…
Source: arXiv
ResearchOrdinary
Did the Problem Actually Get Harder? Testing LLMs on Paired P and NP-Complete Problems Hardened by Adversarial Multi-Agent Rewriting
Many NP-complete (NPC) problems have a polynomial-time (P) twin that differs in a single structural detail, such as 3- versus 2-colouring a graph. A model that reasons rather than recalls should notice which side of this boundary a problem…
Source: arXiv
ResearchOrdinary
Differentially Private Sparse Reward Estimation with Preference Feedback
Reinforcement Learning with Human Feedback (RLHF) has become a central paradigm for aligning Large Language Models with human values. However, the reliance on sensitive preference data necessitates rigorous differential privacy (DP) guaran…
Source: arXiv
ResearchOrdinary
AtomicRL: Atomic Reinforcement Learning for Long-Horizon Robotic Manipulation
Vision-language-action (VLA) models have shown promise in robotic manipulation, but imitation learning (IL) alone often struggles to master complex long-horizon skills. Reinforcement learning (RL) offers an effective avenue for further imp…
Source: arXiv
ResearchOrdinary
VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage - An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift
Perimeter triage faces a latency/semantics trade-off: signature engines are fast and format-safe but blind to unseen attacks, while generative models are semantic but slow and produce unparseable output. In late 2026 a class of commercial …
Source: arXiv
ResearchOrdinary
Orbitol: Crystal Generation on Wyckoff Orbits
Generative models propose crystalline materials by learning composition and geometry, but unconditional sampling gives no direct control over the space group, which constrains whether responses such as piezoelectricity are symmetry-allowed…
Source: arXiv
ResearchOrdinary
Circuits of LLM Classifiers
Language models make it easy to build classifiers by simply prompting a model with the sample to classify. However, their predictions are neither deterministic nor uniformly reliable across samples. How can we combine predictions from diff…
Source: arXiv