Skip to main navigation Skip to search Skip to main content

Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models

  • Yifan Ye
  • , Jiaqi Ma
  • , Jun Cen
  • , Zhihe Lu*
  • *Corresponding author for this work
  • Hamad bin Khalifa University
  • Mohamed Bin Zayed University of Artificial Intelligence
  • Zhejiang University

Research output: Contribution to journalArticlepeer-review

Abstract

Vision-Language-Action (VLA) models pretrained on large-scale multimodal datasets have emerged as powerful foundations for robotic perception and control. However, their massive scale, often billions of parameters, poses significant challenges for real-time deployment, as inference becomes computationally expensive and latency-sensitive in dynamic environments. To address this, we propose Token Expand-and-Merge-VLA (TEAM-VLA), a training-free token compression framework that accelerates VLA inference while preserving task performance. TEAM-VLA introduces a dynamic token expansion mechanism that identifies and samples additional informative tokens in the spatial vicinity of attention-highlighted regions, enhancing contextual completeness. These expanded tokens are then selectively merged in deeper layers under action-aware guidance, effectively reducing redundancy while maintaining semantic coherence. By coupling expansion and merging within a single feed-forward pass, TEAM-VLA achieves a balanced trade-off between efficiency and effectiveness, without any retraining or parameter updates. Extensive experiments on LIBERO benchmark demonstrate that TEAM-VLA consistently improves inference speed while maintaining or even surpassing the task success rate of full VLA models.

Original languageEnglish
Pages (from-to)9279-9286
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume11
Issue number8
DOIs
Publication statusPublished - 12 Jun 2026

Keywords

  • Deep learning
  • machine learning
  • token compression
  • training-free
  • vision-language-action models

Fingerprint

Dive into the research topics of 'Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models'. Together they form a unique fingerprint.

Cite this