# Cross-Learning from Scarce Data via Multi-Task Constrained Optimization

Source: [Cross-Learning from Scarce Data via Multi-Task Constrained Optimization](<https://www.sota2.com/research/paper/691bfe956750be83fe5cf4fe>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-11-19T05:05:33.335Z

Authors: Leopoldo Agorio, Juan Cervi\\~no, Miguel Calvo-Fullana, Alejandro Ribeiro, Juan Andr\\'es Bazerque

Published: 2025-11-17T18:35:59.000Z

## Abstract

A learning task, understood as the problem of fitting a parametric model from supervised data, fundamentally requires the dataset to be large enough to be representative of the underlying distribution of the source. When data is limited, the learned models fail generalize to cases not seen during training. This paper introduces a multi-task \\emph{cross-learning} framework to overcome data scarcity by jointly estimating \\emph{deterministic} parameters across multiple, related tasks. We formulate this joint estimation as a constrained optimization problem, where the constraints dictate the resulting similarity between the parameters of the different models, allowing the estimated parameters to differ across tasks while still combining information from multiple data sources. This framework enables knowledge transfer from tasks with abundant data to those with scarce data, leading to more accurate and reliable parameter estimates, providing a solution for scenarios where parameter inference from limited data is critical. We provide theoretical guarantees in a controlled framework with Gaussian data, and show the efficiency of our cross-learning method in applications with real data including image classification and propagation of infectious diseases.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2511.13680>)

[PDF](<https://arxiv.org/pdf/2511.13680.pdf>)
