Estimated rewards depend on the observation and task distribution and must not be treated as a safety guarantee. Available weights or code do not establish plug-and-play robot compatibility. Check the required configuration, data and interfaces in the source documentation.
Deployment and usage resources
Runtime and frameworks
LeRobot / Transformers
Fine-tuning requirements
The LeRobot port is inference-only and zero-shot; it uses a frozen Qwen3-VL model and does not train a reward model.
Original TOPReward v2 paper with Qwen3-VL-8B and direct prompt scoring. VOC is temporal value-order rank correlation on[-1,1], not robot task success or calibrated completion. This is an author-reported method reference, not an independently reproduced LeRobot integration run or a standalone trained reward checkpoint. Table1: mean dataset VOC over33 filtered OXE datasets,20 episodes each. The project page’s39-dataset0.857 is a different published scope.
Original TOPReward v2 paper with Qwen3-VL-8B and direct prompt scoring. VOC is temporal value-order rank correlation on[-1,1], not robot task success or calibrated completion. This is an author-reported method reference, not an independently reproduced LeRobot integration run or a standalone trained reward checkpoint. Table2: metrics averaged over497 successful-evaluation episodes,113 tasks across four platforms. The full benchmark has130 unique tasks including a failure split. Not the project headline0.947/0.945, and not a success-detection AUC.
The LeRobot wrapper is inference-only: a frozen Qwen3-VL supplies token log-probabilities, with no separate task-trained reward weights. Raw reward is a log-probability, not a calibrated completion percentage; an optional finite threshold returns a binary value. Per-episode min/max progress normalization uses the full sampled trajectory and is non-causal, separate from online raw reward. Only Qwen3-VL clients are supported by this port. Original TOPReward code is MIT; LeRobot code is Apache2 and backbone weights retain their own terms. Exact LeRobot release date and hosted API remain unverified.