AI Research & Papers
整理大Models、智能体、多模态、机器学习与生成式 AI 的Research、基准和研究进展。
Category articles1528
当前页18 / 39
UpdatesPermanent archive
Category articles
按发布Time从新到旧 · 每页 40 stories
ResearchOrdinary
Dating the Model: Hidden Dates in System Prompts Affect LLM Evaluation
Reproducibility is essential for scientific research, yet prior work shows that LLM outputs vary with hardware and batching. We identify an overlooked factor: the hidden injection of the current date into system prompts, which users cannot…
Source: arXiv
ResearchOrdinary
Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient Execution
Many computer tasks recur: the same workflow runs many times, with new inputs and from different starting states. Current computer-use agents re-plan every step of every run, which makes them costly and unreliable on such tasks. We introdu…
Source: arXiv
ResearchOrdinary
State Transport Routing for Short-horizon Adaptation in Multi-horizon Photovoltaic Forecasting
Recent power measurements provide valuable information for photovoltaic(PV) power forecasting, but directly extrapolating short-term trends can introduce substantial errors over longer forecast horizons. To address this challenge, we propo…
Source: arXiv
ResearchOrdinary
FurE: Efficient Instance-Specific 3D Fur Reconstruction without Animal-Fur Datasets
Realistic and editable animal fur reconstruction from multi-view images is challenging due to fine-scale detail, self-occlusion and obfuscation, and, unlike human hair, the lack of animal-fur datasets. Fur usually covers most of an animal'…
Source: arXiv
ResearchOrdinary
Telescopic Language Models
One deployed language model must often serve many compute budgets, yet serving each budget still means a separate training or compression run per point. We train a Telescopic Language Model (TLM) to be that continuum: a nested-capacity Tra…
Source: arXiv
ResearchOrdinary
PDMD: Projected Distribution Matching Distillation for Video Diffusion Models
Modern video diffusion models require tens of denoising evaluations over long spatiotemporal token sequences. Distribution Matching Distillation (DMD) reduces the number of function evaluations (NFE) to just a few. However, DMD samples can…
Source: arXiv
ResearchOrdinary
Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning
Unified multimodal models can both look at and render images, so in principle they can repair their own generations: diagnose what an image gets wrong, revise it, observe the result, and diagnose again. Whether a revision helps is known on…
Source: arXiv
ResearchOrdinary
Retrieving Biblical Intertextual References in Karen Blixen's Seven Gothic Tales
Identifying intertextual references is central to literary scholarship, but computationally difficult when source material is transformed through paraphrase, allusion, historical language, and translation. We investigate this problem throu…
Source: arXiv
ResearchOrdinary
Unifying Distributional Training for One-Step Visual Generation
\emph{Distributional training} provides collective supervision for one-step visual generation by matching real and generated features in frozen representation spaces. We introduce \emph{a unified theoretical framework} that separates distr…
Source: arXiv
ResearchOrdinary
TokenCast: Forecasting Token Consumption During LLM Agent Execution
When a large language model (LLM) agent executes the same task, token consumption can vary by over an order of magnitude across runs. The agent chooses its next steps based on tool feedback and intermediate results, while the growing conte…
Source: arXiv
ResearchOrdinary
Scaling Long-Form Story Generation via Narrative State Tracking
LLMs have demonstrated strong capabilities in creative writing. However, scaling them to full-length novels remains challenging, as maintaining narrative consistency becomes increasingly difficult. Existing story-generation methods typical…
Source: arXiv
ResearchOrdinary
Statistical Learning of Contractive Dynamical Representations for Composite Adaptive Control
We present a representation-learning framework for composite adaptive tracking control under dynamically coupled disturbances. The framework connects classical disturbance-accommodating control (DAC) to recent last-layer adaptive disturban…
Source: arXiv
ResearchOrdinary
Neural Harmonic Measure Operator
We introduce Neural Harmonic Measure Operator (NHMO), a neural solver for elliptic PDE problems on variable-shape domains. The harmonic measure of a domain is the boundary probability distribution that, integrated against any boundary data…
Source: arXiv
ResearchOrdinary
How to Loop MoE: Flatten the Experts, Untie the Attention
Looped Transformers reuse one block of layers several times: by spending extra computation they push a model of fixed size further, and so use its parameters more fully; while sparse mixture-of-experts (MoE) models activate only a few of m…
Source: arXiv
ResearchOrdinary
KV-streams for Efficient Compaction in Agentic Reinforcement Learning
Scaling the horizon of agentic LLMs is bottlenecked by the need to fit ever longer context traces in GPU memory. Context compaction has been the most popular mechanism to alleviate this issue, keeping GPU memory constant for a given trace.…
Source: arXiv
ResearchOrdinary
Towards Communication-Efficient Social Intelligence in Language Agents
Socially intelligent language agents must negotiate, coordinate, and resolve conflicting preferences while respecting the time and attention of both participants. Balancing these demands is challenging because agents must convey enough to …
Source: arXiv
ResearchOrdinary
Improving Test-Time Scaling with Adaptive Looped Transformers
Looped transformers have demonstrated promising parameter efficiency by reusing layers for latent computation. Prior studies compare looped and non-looped models at matched parameters or per-token FLOPs. However, to the best of our knowled…
Source: arXiv
ResearchOrdinary
Copy the Same, Distill the Difference: Initializing Linear Vision Transformers
Linear Vision Transformers (ViTs) are designed to replace the attention in Softmax ViTs with the linear-complexity attention operator for more efficient token routing, but they require from-scratch pre-training and typically underperform t…
Source: arXiv
ResearchOrdinary
FinAutoRubric: Expert-Guided Automatic Rubric Generation for Evaluating Financial Research Agents
Evaluating finance research agents requires rubrics that reflect expert standards and fix the values correct as of an information cutoff. Expert-reviewed finance benchmarks rely on fixed, per-item rubrics, which are costly to extend and ca…
Source: arXiv
ResearchOrdinary
Shockingly Simple Self-retrospection Improves Agentic Models Without RL
People learn not only by repeating successful actions, but also by recounting and explaining their experiences, revising their understanding to guide future behavior. Can a language-model agent improve its future actions by training only o…
Source: arXiv · Qwen
ResearchOrdinary
Harness Learning Enables Generalizable Test-Time Adaptation
A language-model agent is jointly defined by its model and its harness, the executable program that organizes model calls, tool use, and information flow. Because different tasks call for different ways of organizing these operations, the …
Source: arXiv
ResearchOrdinary
Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models
Tool-using agents can fail twice: a required tool can fail, and the agent can then report success without the evidence needed to justify it. Existing benchmarks often entangle this reporting failure with tool selection, recovery, and envir…
Source: arXiv
ResearchOrdinary
X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets
Reinforcement learning (RL) in simulation can train dexterous manipulation policies without robot demonstrations, but training a single generalist policy with task-agnostic rewards faces a severe exploration problem: approaching, grasping,…
Source: arXiv
ResearchOrdinary
Steering Language Model Goals with Value Transplant
Reasoning models often act as if they pursue goals, but their efforts are not always directed toward what users intend, sometimes leading them to pursue unintended outcomes. Previous work has examined how models may internally track their …
Source: arXiv · GPT / Qwen
ResearchOrdinary
PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction
Multi-LoRA agent systems enable efficient role specialization by sharing a common backbone model. However, each agent repeatedly processes the growing shared trajectory and constructs its own KV cache, introducing substantial memory and co…
Source: arXiv
ResearchOrdinary
The Statistical Cost of Causal Discovery with Feedback
What determines the unavoidable sample cost of learning cyclic causal structure? For cyclic linear non-Gaussian models, we study exact condensation recovery from observational data: identifying the strongly connected component (SCC) partit…
Source: arXiv
ResearchOrdinary
Thinking Outside the Box: Retention and Transmission of Information in Sliding-Window KV Inference
Sliding-window KV inference refers to processing a sequence incrementally while retaining only a fixed-size cache of recent key and value states. It can be applied to pretrained causal transformers at inference time without additional trai…
Source: arXiv · Qwen / Llama / Mistral
ResearchOrdinary
ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark
Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a bench…
Source: arXiv
ResearchOrdinary
Kafila: Serving Large Language Models on a Trusted Set of Heterogeneous Commodity Machines
Between them, the members of a research group or a circle of friends own several consumer computers, none large enough to run a capable large language model. Existing systems pool such capacity across open swarms anyone may join, which a g…
Source: arXiv
ResearchOrdinary
Singularities of Non-negative Matrix Factorization and their application to Bayesian inference
Non-negative matrix factorization (NMF) is a singular statistical model whose Bayesian asymptotics are governed by the real log canonical threshold (RLCT). We study the local geometry of the factorization map and derive an upper bound for …
Source: arXiv
ResearchOrdinary
Vision--Language Signals in Constrained RL: Safety Gains Without Anticipation
Safe reinforcement learning seeks policies that maximise task performance while satisfying safety constraints. In driving benchmarks, however, collision costs typically appear only at the time of collision, providing no advance warning of …
Source: arXiv
ResearchOrdinary
Large Language Models for Structured Clinical Data Analysis: Dual-Agent Grounding and Validation
Objective: To develop and characterize CLEAR-Med, a dual-agent framework for natural-language analysis of structured clinical data that separates SQL-based invocation from independent validation. Methods: CLEAR-Med uses one agent to transl…
Source: arXiv · ChatGPT
ResearchOrdinary
UOPD: Uncertainty-Aware Intervention for On-Policy Distillation of Multi-Turn Agents
On-policy distillation (OPD) trains a student on its own rollouts using dense supervision from a teacher. In multi-turn environments, a mistake at a critical decision step can redirect the subsequent rollout toward poor outcomes. We use lo…
Source: arXiv
ResearchOrdinary
3D Point Tracking with State Space Models
Tracking any point of a dynamic scene in metric 3D - in absolute meters, not up to an unknown scale - underpins 3D and 4D reconstruction, robot navigation, and autonomous driving, where decisions are made in meters, not pixels. Our objecti…
Source: arXiv
ResearchOrdinary
ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling
A central aim of neuromorphic computing is to provide a viable alternative to highly energy-intensive Transformer-based AI. However, efficient alternatives struggle to capture the set of qualities that have secured the Transformer's status…
Source: arXiv
ResearchOrdinary
Faithful Activation Verbalization: Reducing Hallucinations in LLM Representation Interpretation
Activation verbalization methods such as Activation Oracle and Natural Language Autoencoders decode hidden representations of large language models into human-readable natural language. However, existing methods can produce incomplete or h…
Source: arXiv
ResearchOrdinary
Posterior Regimes and Latent Deception: Variational Bayesian Inference in Hidden Markov Models for Sequential Fraud Detection in Financial Transactions
We present a three-tier progression of Hidden Markov Models: maximum-likelihood (Baum-Welch), variational Bayesian (VBEM), and a neural variational extension (Neural VBEM), that model each customer's transaction history as a trajectory thr…
Source: arXiv
ResearchOrdinary
Uncovering shortcut learning in audio classifiers by discovering recurring concepts in temporal explanations
Correlations between events in machine learning datasets may result in shortcut learning, where models learn to predict the target event based on the presence of a correlated event. When these correlations are spurious -- arising from data…
Source: arXiv
ResearchOrdinary
Structure-Adaptive Tree Field Integrators
We present a new class of near-linear algorithms for efficiently integrating general tensor fields defined on trees with distance dependent kernels, the Structure-Adaptive Tree Field Integrators (STAD-TFIs). STAD-TFIs exploit the tree's un…
Source: arXiv
ResearchOrdinary
Jev in Medicine: A Benchmark Evaluation. Preliminary Results
Jev is a non-generative "System One" model that assigns probabilities to predefined answer options and cannot answer outside them. Its accuracy and calibration on medical question-answering and case-based diagnostic-reasoning tasks are unk…
Source: arXiv · GPT