← All speakers

Bio, Work & Ideas

Armen Aghajanyan

Conference affiliation: Co-Founder & CEO · Perceptron AI · 2026

Armen Aghajanyan was listed in the AI Engineer World’s Fair 2026 biography as co-founder and CEO of Perceptron AI and a former research scientist at FAIR and Microsoft. In his conference presentation, he described spending six years at FAIR working on scaling multimodal models, including early fusion, which brings different modalities together early in a model’s processing.

His presentation focused on Perceptron’s approach to embodied foundation models that combine perception, reasoning, and control. He described learning to predict useful future percepts rather than relying on sparse transcript supervision or treating every pixel as equally important. To reduce the computational burden of continuous visual input, he explained data sparse mixture of experts: a router selects or skips tokens across model layers, allocating computation toward informative regions and task-relevant objects.

Aghajanyan illustrated the team’s work with object detection that uses code, image tiling, zooming, contrast adjustments, and proposed bounding boxes; robotic video annotation that checks its own captions; and a book-sorting model that reads titles, identifies book types, and emits control tokens. He reported that joint training allowed ten times more video pretraining data to compensate for ten times less teleoperation data within the team’s tested compute range. He also acknowledged that temporal understanding remained insufficiently reliable for deployment and that robustness to changes in lighting and background remained limited.

1 conference talk

Key ideas

Scroll to read ↓

Armen Aghajanyan explains Perceptron AI’s approach to combining perception, reasoning, and control: learn useful visual targets, spend compute on relevant tokens, and use video pretraining to reduce the need for expensive robot demonstrations.

  • Visual supervision needs useful targets as well as density. Predicting every pixel can spend learning effort on background details; Perceptron proposes automatically learning future percepts, without disclosing the objective here.
    4:39 ↗
  • Learned token routing makes compute allocation task-dependent: a general question spreads attention across an image, while fruit segmentation concentrates more tokens on likely fruit.
    7:22 ↗
  • Perception can itself involve actions. Tiling, zooming, changing contrast, and revisiting video intervals let a model gather better evidence before producing a box or annotation.
    10:02 ↗
  • Joint training reportedly lets 10× more video pretraining substitute for 10× less teleoperation data within Perceptron’s tested compute range, offering a way to reduce dependence on demonstrations costing around $100 per hour.
    12:52 ↗
  • Combining reasoning and control enables tasks such as sorting books by their titles, but temporal reliability and resistance to severe visual disruption remain open problems.
    14:31 ↗

References