# FOVI: A biologically-inspired foveated interface for deep vision models

Source: [FOVI: A biologically-inspired foveated interface for deep vision models](<https://www.sota2.com/research/paper/6982d2faa8b01e76cc8e99f9>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T05:00:51.557Z

Authors: Nicholas M. Blauch, George A. Alvarez, Talia Konkle

Published: 2026-02-03T17:26:54.000Z

## Abstract

Human vision is foveated, with variable resolution peaking at the center of a large field of view; this reflects an efficient trade-off for active sensing, allowing eye-movements to bring different parts of the world into focus with other parts of the world in context. In contrast, most computer vision systems encode the visual world at a uniform resolution, raising challenges for processing full-field high-resolution images efficiently. We propose a foveated vision interface (FOVI) based on the human retina and primary visual cortex (V1), that reformats a variable-resolution retina-like sensor array into a uniformly dense, V1-like sensor manifold. Receptive fields are defined as k-nearest-neighborhoods (kNNs) on the sensor manifold, enabling kNN-convolution via a novel kernel mapping technique. We demonstrate two use cases: (1) an end-to-end kNN-convolutional architecture, and (2) a foveated adaptation of the DINOv3 ViT foundation model, leveraging low-rank adaptation (LoRA). These models provide competitive performance with a fraction of the pixels and computational cost of full resolution non-foveated baselines, opening pathways for efficient and scalable active sensing for high-resolution egocentric vision. Code (https://github.com/nblauch/fovi) and pre-trained models (https://huggingface.co/fovi-pytorch) are available.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on ImageNet-1K (val) (Accuracy, Latency, GFLOPS)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-val-accuracy-latency-gflops.md>): Image Classification; ImageNet-1k (val); Accuracy: 85.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2602.03766>)

[PDF](<https://arxiv.org/pdf/2602.03766.pdf>)
