# Camera-controllable generation on Puffin-Gen 1.0 (test)

Source: [Camera-controllable generation on Puffin-Gen 1.0 (test)](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T09:24:39.239Z

Evaluation of models performing camera-controllable generation on the Puffin-Gen 1.0 test set, assessed using metrics related to camera pose accuracy (Up Vector, Latitude, Gravity errors) and image fidelity (FID).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Camera-controllable generation |
| Dataset (including any stated split) | Puffin-Gen 1.0 (test) |
| Metric | Up Vector Mean Error |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Up Vector Mean Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Up%20Vector%20Mean%20Error>): Lower is better; unit: SCALAR.

- [Up Vector Median Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Up%20Vector%20Median%20Error>): Lower is better; unit: SCALAR.

- [Latitude Mean Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Latitude%20Mean%20Error>): Lower is better; unit: SCALAR.

- [Latitude Median Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Latitude%20Median%20Error>): Lower is better; unit: SCALAR.

- [Gravity Mean Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Gravity%20Mean%20Error>): Lower is better; unit: SCALAR.

- [Gravity Median Error](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=Gravity%20Median%20Error>): Lower is better; unit: SCALAR.

- [FID](<https://www.sota2.com/research/sota/camera-controllable-generation-on-puffin-gen-1-0-test.md?metric=FID>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Up Vector Mean Error | Result date | Report paper |
| --- | --- | --- | --- |
| Puffin | 11.94 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| PreciseCam | 18.66 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| Qwen-Image | 23.8 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| Qwen-Image | 23.98 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| GPT-4o | 24.07 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| Nano Banana | 24.08 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| GPT-4o | 24.11 | Not recorded | 68fa7bfd1e209131cea8bb59 |
| Nano Banana | 24.65 | Not recorded | 68fa7bfd1e209131cea8bb59 |

### Puffin

Up Vector Mean Error: 11.94. Result ID: 69cb92d347f34ce924b42b2a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

[Implementation](<https://github.com/KangLiao929/Puffin>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PreciseCam

Up Vector Mean Error: 18.66. Result ID: 69cb92d347f34ce924b42b29.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a81e209131cea6e3e1.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen-Image

Up Vector Mean Error: 23.8. Result ID: 69cb92d347f34ce924b42b25.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: {"Camera parameter representation":"radians to degrees"}. This record does not assert independent reproduction.

### Qwen-Image

Up Vector Mean Error: 23.98. Result ID: 69cb92d347f34ce924b42b26.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a6a1e209131cea83137.md>)

Recorded evaluation configuration: {"Camera parameter representation":"photographic terms"}. This record does not assert independent reproduction.

### GPT-4o

Up Vector Mean Error: 24.07. Result ID: 69cb92d347f34ce924b42b24.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

Recorded evaluation configuration: {"Camera parameter representation":"photographic terms"}. This record does not assert independent reproduction.

### Nano Banana

Up Vector Mean Error: 24.08. Result ID: 69cb92d347f34ce924b42b27.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

Recorded evaluation configuration: {"Camera parameter representation":"radians to degrees"}. This record does not assert independent reproduction.

### GPT-4o

Up Vector Mean Error: 24.11. Result ID: 69cb92d347f34ce924b42b23.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

Recorded evaluation configuration: {"Camera parameter representation":"radians to degrees"}. This record does not assert independent reproduction.

### Nano Banana

Up Vector Mean Error: 24.65. Result ID: 69cb92d347f34ce924b42b28.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7bfd1e209131cea8bb59.md>)

Recorded evaluation configuration: {"Camera parameter representation":"photographic terms"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.