# Let the Agent Steer: Closed-Loop Ranking Optimization via Influence Exchange

Source: [Let the Agent Steer: Closed-Loop Ranking Optimization via Influence Exchange](<https://www.sota2.com/research/paper/69cb552b0636e5bf4afc9ff2>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-11T05:00:11.573Z

Authors: Yin Cheng, Liao Zhou, Xiyu Liang, Dihao Luo, Tewei Lee, Kailun Zheng, Weiwei Zhang, Mingchen Cai, Jian Dong, Andy Zhang

Published: 2026-03-29T16:58:29.000Z

## Abstract

Recommendation ranking is fundamentally an influence allocation problem: a sorting formula distributes ranking influence among competing factors, and the business outcome depends on finding the optimal "exchange rates" among them. However, offline proxy metrics systematically misjudge how influence reallocation translates to online impact, with asymmetric bias across metrics that a single calibration factor cannot correct.   We present Sortify, the first fully autonomous LLM-driven ranking optimization agent deployed in a large-scale production recommendation system. The agent reframes ranking optimization as continuous influence exchange, closing the full loop from diagnosis to parameter deployment without human intervention. It addresses structural problems through three mechanisms: (1) a dual-channel framework grounded in Savage's Subjective Expected Utility (SEU) that decouples offline-online transfer correction (Belief channel) from constraint penalty adjustment (Preference channel); (2) an LLM meta-controller operating on framework-level parameters rather than low-level search variables; (3) a persistent Memory DB with 7 relational tables for cross-round learning. Its core metric, Influence Share, provides a decomposable measure where all factor contributions sum to exactly 100%.   Sortify has been deployed across two markets. In Country A, the agent pushed GMV from -3.6% to +9.2% within 7 rounds with peak orders reaching +12.5%. In Country B, a cold-start deployment achieved +4.15% GMV/UU and +3.58% Ads Revenue in a 7-day A/B test, leading to full production rollout.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Ranking Optimization on YMAL Scene Country B A/B Test Snapshot #38047](<https://www.sota2.com/research/sota/ranking-optimization-on-ymal-scene-country-b-a-b-test-snapshot-sharp-38047.md>): Ranking Optimization; YMAL scene Country B 7-day A/B test rollout Snapshot #38047 (03-15 to 03-22); GMV/UU Lift: 4.15.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.27765>)

[PDF](<https://arxiv.org/pdf/2603.27765.pdf>)
