Reasoning-based 3D Human Pose Estimation on RPE benchmark
147.2MPJPEChatHuman
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ChatHuman2024.05 | 147.2 | 79.1 | 10.3 | |
| ChatHumanFine-tuned=false2024.05 | 147.2 | 79.1 | 10.3 | |
| Visual ChatGPT-4Fine-tuned=false2024.05 | 168.4 | 82.3 | 10.7 | |
| GPT4Tools-FTFine-tuned=true2024.05 | 190.5 | 100.6 | 11.6 | |
| HMR 2.0Text Description Type=Averaged2023.11 | 225.2 | 105.7 | 12.1 | |
| HMR 2.02024.05 | 225.2 | 105.1 | 12.1 | |
| SPINText Description Type=Averaged2023.11 | 244.9 | 107.3 | 12.4 | |
| SPIN2024.05 | 244.9 | 107.3 | 12.4 | |
| ChatPoseText Description Type=Summary2023.11 | 253.6 | 103.8 | 11.7 | |
| ChatPose2024.05 | 253.6 | 103.8 | 11.7 | |
| ChatPoseText Description Type=Outfit2023.11 | 265.6 | 102.6 | 11.8 | |
| ChatPoseText Description Type=Shape2023.11 | 269.9 | 103.7 | 12 | |
| ChatPoseText Description Type=Averaged2023.11 | 275 | 101.8 | 11.9 | |
| ChatPoseText Description Type=Pose2023.11 | 277.9 | 96 | 11.7 | |
| ChatPoseText Description Type=Behavior2023.11 | 307.9 | 102.9 | 12.1 | |
| LLaVAStage 2=PoseScript, Text Description Type=Pose2023.11 | 363.2 | 177.9 | 17.4 | |
| LLaVAStage 2=PoseScript, Text Description Type=Behavior2023.11 | 370.8 | 182.3 | 17.5 | |
| LLaVAStage 2=PoseScript, Text Description Type=Summary2023.11 | 391.5 | 191.9 | 17.8 | |
| LLaVA-PInput=multimodal LLMs for textual pose descriptions, Processor=PoseScript [10]2024.05 | 391.5 | 191.9 | 17.8 | |
| LLaVAStage 2=PoseScript, Text Description Type=Averaged2023.11 | 394.8 | 186.8 | 17.7 | |
| LLaVAStage 2=PoseScript, Text Description Type=Shape2023.11 | 407.8 | 191.3 | 18 | |
| LLaVAStage 2=PoseScript, Text Description Type=Outfit2023.11 | 440.7 | 190.4 | 17.6 | |
| LLaVAStage 2=SMPLify, Text Description Type=Shape2023.11 | 462.3 | 204.3 | 20.2 | |
| LLaVAStage 2=SMPLify, Text Description Type=Pose2023.11 | 480.9 | 207.4 | 21.1 | |
| LLaVAStage 2=SMPLify, Text Description Type=Outfit2023.11 | 481.1 | 198.7 | 20 | |
| LLaVAStage 2=SMPLify, Text Description Type=Averaged2023.11 | 481.1 | 203.7 | 20.7 | |
| LLaVAStage 2=SMPLify, Text Description Type=Behavior2023.11 | 490.7 | 200.6 | 20.9 | |
| LLaVAStage 2=SMPLify, Text Description Type=Summary2023.11 | 490.7 | 207.4 | 21.1 | |
| LLaVA-SInput=multimodal LLMs for keypoint detection, Optimization=SMPLify [4]2024.05 | 490.7 | 207.4 | 21.1 |