# customer

Source: [customer](<https://www.sota2.com/research/dataset/customer>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Domain-Specific Applied Tasks on Multi-Domain Contexts (Education, CS Q&A, IE)](<https://www.sota2.com/research/sota/domain-specific-applied-tasks-on-multi-domain-contexts-education-cs-q-and-a-ie.md>): Domain-Specific Applied Tasks; Education, Customer Support Q&A, Information Processing, Intention Recognition, Information Extraction, Complex Workflow.

- [Vehicle Routing Problem on VRP 100 Customers (100 instances)](<https://www.sota2.com/research/sota/vehicle-routing-problem-on-vrp-100-customers-100-instances.md>): Vehicle Routing Problem; VRP 100 Customers (100 instances).

- [Customer Segmentation on B2B Customer Dataset](<https://www.sota2.com/research/sota/customer-segmentation-on-b2b-customer-dataset.md>): Customer Segmentation; B2B Customer Dataset.

- [Vehicle Routing Problem with Time Windows on VRPTW 100 customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-time-windows-on-vrptw-100-customers.md>): Vehicle Routing Problem with Time Windows; VRPTW 100 customers.

- [Boolean Matrix Factorization on customer](<https://www.sota2.com/research/sota/boolean-matrix-factorization-on-customer.md>): Boolean Matrix Factorization; customer.

- [Vehicle Routing Problem on VRP 500 Customers (100 instances)](<https://www.sota2.com/research/sota/vehicle-routing-problem-on-vrp-500-customers-100-instances.md>): Vehicle Routing Problem; VRP 500 Customers (100 instances).

- [Scenario classification on Customer-service conversations](<https://www.sota2.com/research/sota/scenario-classification-on-customer-service-conversations.md>): Scenario classification; Customer-service conversations.

- [Tactic classification on Customer-service conversations](<https://www.sota2.com/research/sota/tactic-classification-on-customer-service-conversations.md>): Tactic classification; Customer-service conversations.

- [Classification on customer (val)](<https://www.sota2.com/research/sota/classification-on-customer-val.md>): Classification; customer (val).

- [Vehicle Routing Problem with Time Windows on VRPTW 1K customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-time-windows-on-vrptw-1k-customers.md>): Vehicle Routing Problem with Time Windows; VRPTW 1K customers.

- [Vehicle Routing Problem with Time Windows on VRPTW 500 customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-time-windows-on-vrptw-500-customers.md>): Vehicle Routing Problem with Time Windows; VRPTW 500 customers.

- [Transaction Forecasting on Market Customer Average (test)](<https://www.sota2.com/research/sota/transaction-forecasting-on-market-customer-average-test.md>): Transaction Forecasting; Market Customer Average (test).

- [Binary Classification on TabArena Customer v0.1 (test)](<https://www.sota2.com/research/sota/binary-classification-on-tabarena-customer-v0-1-test.md>): Binary Classification; TabArena Customer v0.1 (test).

- [Clustering on Customer Purchasing Behaviors dataset](<https://www.sota2.com/research/sota/clustering-on-customer-purchasing-behaviors-dataset.md>): Clustering; Customer Purchasing Behaviors dataset.

- [Classification on Santander Customer Transaction Prediction](<https://www.sota2.com/research/sota/classification-on-santander-customer-transaction-prediction.md>): Classification; Santander Customer Transaction Prediction.

- [Tabular Classification on wholesale-customers (test)](<https://www.sota2.com/research/sota/tabular-classification-on-wholesale-customers-test.md>): Tabular Classification; wholesale-customers (test).

- [Convergence Detection on Average BIRD and Customer Datasets (5 Folds)](<https://www.sota2.com/research/sota/convergence-detection-on-average-bird-and-customer-datasets-5-folds.md>): Convergence Detection; BIRD and customer datasets (average across three datasets and five folds).

- [Convergence prediction on BIRD and customer datasets average of 3 (five folds)](<https://www.sota2.com/research/sota/convergence-prediction-on-bird-and-customer-datasets-average-of-3-five-folds.md>): Convergence prediction; BIRD and customer datasets average of 3 (five folds).

- [Vulnerability Prediction on Customer Service (CS)](<https://www.sota2.com/research/sota/vulnerability-prediction-on-customer-service-cs.md>): Vulnerability Prediction; Customer Service (CS).

- [Asymmetric Vehicle Routing Problem on AVRP 1K customers](<https://www.sota2.com/research/sota/asymmetric-vehicle-routing-problem-on-avrp-1k-customers.md>): Asymmetric Vehicle Routing Problem; AVRP 1K customers.

- [Asymmetric Vehicle Routing Problem on AVRP 500 customers](<https://www.sota2.com/research/sota/asymmetric-vehicle-routing-problem-on-avrp-500-customers.md>): Asymmetric Vehicle Routing Problem; AVRP 500 customers.

- [Dialogue Generation on ByteDance Customer Service (test)](<https://www.sota2.com/research/sota/dialogue-generation-on-bytedance-customer-service-test.md>): Dialogue Generation; ByteDance Customer Service (test).

- [Classification (8 classes) on Twitter customer-support requests](<https://www.sota2.com/research/sota/classification-8-classes-on-twitter-customer-support-requests.md>): Classification (8 classes); Twitter customer-support requests.

- [Dialogue Generation on Human-in-the-loop Interactive Evaluation Customer-Agent Dialogs](<https://www.sota2.com/research/sota/dialogue-generation-on-human-in-the-loop-interactive-evaluation-customer-agent-dialogs.md>): Dialogue Generation; Human-in-the-loop Interactive Evaluation Customer-Agent Dialogs.

- [Asymmetric Vehicle Routing Problem on AVRP 100 customers](<https://www.sota2.com/research/sota/asymmetric-vehicle-routing-problem-on-avrp-100-customers.md>): Asymmetric Vehicle Routing Problem; AVRP 100 customers.

- [Customer Support BPM on Customer Support BPM Dataset (test)](<https://www.sota2.com/research/sota/customer-support-bpm-on-customer-support-bpm-dataset-test.md>): Customer Support BPM; Customer Support BPM Dataset (test).

- [Classification on Synthetic Customer Scenarios](<https://www.sota2.com/research/sota/classification-on-synthetic-customer-scenarios.md>): Classification; Synthetic Customer Scenarios.

- [Vehicle Routing Problem with Release Stations on VRPRS 1K customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-release-stations-on-vrprs-1k-customers.md>): Vehicle Routing Problem with Release Stations; VRPRS 1K customers.

- [Vehicle Routing Problem with Release Stations on VRPRS 500 customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-release-stations-on-vrprs-500-customers.md>): Vehicle Routing Problem with Release Stations; VRPRS 500 customers.

- [Vehicle Routing Problem with Release Stations on VRPRS 100 customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-release-stations-on-vrprs-100-customers.md>): Vehicle Routing Problem with Release Stations; VRPRS 100 customers.

- [Electric Vehicle Routing Problem with Charging Stations on EVRPCS 1K customers](<https://www.sota2.com/research/sota/electric-vehicle-routing-problem-with-charging-stations-on-evrpcs-1k-customers.md>): Electric Vehicle Routing Problem with Charging Stations; EVRPCS 1K customers.

- [Electric Vehicle Routing Problem with Charging Stations on EVRPCS 500 customers](<https://www.sota2.com/research/sota/electric-vehicle-routing-problem-with-charging-stations-on-evrpcs-500-customers.md>): Electric Vehicle Routing Problem with Charging Stations; EVRPCS 500 customers.

- [Electric Vehicle Routing Problem with Charging Stations on EVRPCS 100 customers](<https://www.sota2.com/research/sota/electric-vehicle-routing-problem-with-charging-stations-on-evrpcs-100-customers.md>): Electric Vehicle Routing Problem with Charging Stations; EVRPCS 100 customers.

- [Capacitated Vehicle Routing Problem on CVRPLIB up to 200 customers (test)](<https://www.sota2.com/research/sota/capacitated-vehicle-routing-problem-on-cvrplib-up-to-200-customers-test.md>): Capacitated Vehicle Routing Problem; CVRPLIB up to 200 customers (test).

- [Traveling Salesman Problem on TSPLIB up to 200 customers (test)](<https://www.sota2.com/research/sota/traveling-salesman-problem-on-tsplib-up-to-200-customers-test.md>): Traveling Salesman Problem; TSPLIB up to 200 customers (test).

- [Classification on Bank Customer Churn (test)](<https://www.sota2.com/research/sota/classification-on-bank-customer-churn-test.md>): Classification; Bank Customer Churn (test).

- [LLM Selection on Open LLM Leaderboard Customer Service scenario K = 42 models](<https://www.sota2.com/research/sota/llm-selection-on-open-llm-leaderboard-customer-service-scenario-k-42-models.md>): LLM Selection; Open LLM Leaderboard Customer Service scenario K = 42 models.

- [Churn Prediction on Telco Customer Churn](<https://www.sota2.com/research/sota/churn-prediction-on-telco-customer-churn.md>): Churn Prediction; Telco Customer Churn.

- [Customer Churn Prediction on Customer Churn dataset](<https://www.sota2.com/research/sota/customer-churn-prediction-on-customer-churn-dataset.md>): Customer Churn Prediction; Customer Churn dataset.

- [Language Modeling on CUSTOMERSIM](<https://www.sota2.com/research/sota/language-modeling-on-customersim.md>): Language Modeling; CUSTOMERSIM.

- [End-to-End Conversational AI on Customer support dialogues](<https://www.sota2.com/research/sota/end-to-end-conversational-ai-on-customer-support-dialogues.md>): End-to-End Conversational AI; Customer support dialogues.

- [Reward Modeling on E-commerce customer service scenario](<https://www.sota2.com/research/sota/reward-modeling-on-e-commerce-customer-service-scenario.md>): Reward Modeling; E-commerce customer service scenario.

- [Distinct Element Counting on TPC-H Supplier, Customer](<https://www.sota2.com/research/sota/distinct-element-counting-on-tpc-h-supplier-customer.md>): Distinct element counting; TPC-H Supplier, Customer.

- [Tabular Classification on wholesale-customers 1511 (test)](<https://www.sota2.com/research/sota/tabular-classification-on-wholesale-customers-1511-test.md>): Tabular Classification; wholesale-customers 1511 (test).

- [Classification on Customer complaint database (test)](<https://www.sota2.com/research/sota/classification-on-customer-complaint-database-test.md>): Classification; Customer complaint database (test).

- [Sentence Classification on CR (10-fold cross-validation)](<https://www.sota2.com/research/sota/sentence-classification-on-cr-10-fold-cross-validation.md>): Sentence Classification; CR (Customer Review) (10-fold cross-validation).

- [Out-of-Distribution Detection on IMDB vs Customer Reviews (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-imdb-vs-customer-reviews-test.md>): Out-of-Distribution Detection; IMDB vs Customer Reviews (test).

- [Customer Support Automation on Customer-level A/B Tests (online)](<https://www.sota2.com/research/sota/customer-support-automation-on-customer-level-a-b-tests-online.md>): Customer Support Automation; Customer-level A/B Tests (online).

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S7: Triple Failure](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s7-triple-failure.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S7: Triple Failure.

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S6: Both Notif Down](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s6-both-notif-down.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S6: Both Notif Down.

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S5 Email Dies](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s5-email-dies.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S5 Email Dies.

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S4: Risk ($15k)](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s4-risk-15k.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S4: Risk ($15k).

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S3: All Payment Down](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s3-all-payment-down.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S3: All Payment Down.

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S2 Stripe Down](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s2-stripe-down.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S2 Stripe Down.

- [Self-Healing Tool Routing on Customer Support Linear Pipeline S1: Happy Path](<https://www.sota2.com/research/sota/self-healing-tool-routing-on-customer-support-linear-pipeline-s1-happy-path.md>): Self-Healing Tool Routing; Customer Support Linear Pipeline S1: Happy Path.

- [Asymmetric Vehicle Routing Problem (AVRP) on RWVRP 5K Customers](<https://www.sota2.com/research/sota/asymmetric-vehicle-routing-problem-avrp-on-rwvrp-5k-customers.md>): Asymmetric Vehicle Routing Problem (AVRP); RWVRP 5K Customers.

- [Vehicle Routing Problem with Random Service (VRPRS) on RWVRP 5K Customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-random-service-vrprs-on-rwvrp-5k-customers.md>): Vehicle Routing Problem with Random Service (VRPRS); RWVRP 5K Customers.

- [Electric Vehicle Routing Problem with Charging Stations (EVRPCS) on RWVRP 5K Customers](<https://www.sota2.com/research/sota/electric-vehicle-routing-problem-with-charging-stations-evrpcs-on-rwvrp-5k-customers.md>): Electric Vehicle Routing Problem with Charging Stations (EVRPCS); RWVRP 5K Customers.

- [Vehicle Routing Problem with Time Windows on RWVRP 5K Customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-time-windows-on-rwvrp-5k-customers.md>): Vehicle Routing Problem with Time Windows (VRPTW); RWVRP 5K Customers.

- [Clustering on Customers](<https://www.sota2.com/research/sota/clustering-on-customers.md>): Clustering; Customers.

- [Tool Routing on 19 Representative Scenario Flows (test)](<https://www.sota2.com/research/sota/tool-routing-on-19-representative-scenario-flows-test.md>): Tool Routing; 19 Representative Scenario Flows (Customer Support, Travel Booking, Content Moderation) (test).

- [Rank Prediction on 65 Adobe customer experiments (test)](<https://www.sota2.com/research/sota/rank-prediction-on-65-adobe-customer-experiments-test.md>): Rank Prediction; 65 Adobe customer experiments (test).

- [Asymmetric Vehicle Routing Problem (AVRP) on RWVRP 7K Customers](<https://www.sota2.com/research/sota/asymmetric-vehicle-routing-problem-avrp-on-rwvrp-7k-customers.md>): Asymmetric Vehicle Routing Problem (AVRP); RWVRP 7K Customers.

- [Vehicle Routing Problem with Random Service (VRPRS) on RWVRP 7K Customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-random-service-vrprs-on-rwvrp-7k-customers.md>): Vehicle Routing Problem with Random Service (VRPRS); RWVRP 7K Customers.

- [Electric Vehicle Routing Problem with Charging Stations (EVRPCS) on RWVRP 7K Customers](<https://www.sota2.com/research/sota/electric-vehicle-routing-problem-with-charging-stations-evrpcs-on-rwvrp-7k-customers.md>): Electric Vehicle Routing Problem with Charging Stations (EVRPCS); RWVRP 7K Customers.

- [Vehicle Routing Problem with Time Windows (VRPTW) on RWVRP 7K Customers](<https://www.sota2.com/research/sota/vehicle-routing-problem-with-time-windows-vrptw-on-rwvrp-7k-customers.md>): Vehicle Routing Problem with Time Windows (VRPTW); RWVRP 7K Customers.

- [Skill Routing on A/B experiment 6M customers (online)](<https://www.sota2.com/research/sota/skill-routing-on-a-b-experiment-6m-customers-online.md>): Skill Routing; A/B experiment 6M customers (online).

- [Customer Service Dialogue on ByteDance Online A/B Test Customer Service (test)](<https://www.sota2.com/research/sota/customer-service-dialogue-on-bytedance-online-a-b-test-customer-service-test.md>): Customer Service Dialogue; ByteDance Online A/B Test Customer Service (test).

- [Bill generation from JSON on Customer-facing utility billing](<https://www.sota2.com/research/sota/bill-generation-from-json-on-customer-facing-utility-billing.md>): Bill generation from JSON; Customer-facing utility billing.