Kite Trossen Cup Sim Baseline ACT

Offizielle Gewichte
Fachartikel und technische Berichte

Kite’s task-trained LeRobot ACT policy for red-cup picking on a bimanual WidowX AI station. This baseline-only checkpoint uses 17 simulated episodes and 90,000 training steps; evaluation is by the publisher in simulation only.

Vollständige Modellbeschreibung ansehen

Research and simulation evaluation of red-cup placement on the specified bimanual WidowX AI station.

Fachartikel und technische Berichte

Fachartikel / Bericht unbestätigt

Offizielle Informationen sind erfasst; ein versionsspezifischer Fachartikel oder Bericht wurde noch nicht bestätigt.

Zuletzt geprüft: 2026-11-18

Zugang und Nutzung

Modelldateien
Öffentlicher Zugang
Trainingsdaten
Öffentlicher Zugang

Evaluationsunterlagen

Der Trainingscode dieser Version ist unbestätigt. Öffentliche Code-Ressourcen belegen nicht die Verfügbarkeit der genauen Trainingsimplementierung. Prüfhinweise ansehen

Trainings- / Fine-Tuning-Code

Modelldateien

Modelldateien
trossen-bin-picking-sim-act-cup-baseline-90k · 90000ZugangGewichtelizenz
Veröffentlichungsangaben

QuelleGeprüft am · 2026-11-18

Vor der Bereitstellung prüfen

Single cup task; author simulation only, no right-layout success or real-robot validation. Full training scripts, action units, control frequency, minimum VRAM and file-level license scope remain unverified. Verfügbare Gewichte oder Code belegen keine sofortige Roboterkompatibilität. Prüfen Sie Konfiguration, Daten und Schnittstellen in der Quelldokumentation.

Unterlagen zu Bereitstellung und Nutzung

Inferenzmodus
ACTPolicy.from_pretrained; LeRobot >=0.6; pin revision
Laufzeit und Frameworks
lerobot-pytorch
Anforderungen an die Feinabstimmung
Task training: 90,000 steps, batch 8, one A100, about 4 hours
Bereitstellungsanforderungen
Four 3×480×640 RGB cameras and 14 joint positions; bimanual WidowX AI

Architektur und Ein-/Ausgaben

Modelltyp
Aktionspolicy
Architektur
Transformer
Backbone
ResNet18 (ImageNet1K V1), Transformer 512, encoder 4 / decoder 1
Eingabe
RGB-Bilder / Roboterzustand
Ausgabe
14 joint targets; 100-step chunks
Veröffentlichung
17. November 2026

Einsatzbereich und Training

Basismodell

Hugging Face LeRobot ACT

Verkörperungsumfang

Einzelne Verkörperung

Funktionsbereich

Action control

Datensatztyp

Offizielle Gewichte

Ausgabe

Aktionen

Pipeline-Aufgabe

robotics

Vorhersageausgabe

chunk_size=100; n_action_steps=100

Roboterform

Zweiarmplattform / Roboterarm

Aufgabenumfang

Einzelne Aufgabe

Umfang der Trainingsdaten

6,867 training frames

Quellen der Trainingsdaten

Kite simulated baseline, 17 training cup episodes

Training

Imitationslernen

Abstammung

Abgeleitet von: ACT · LeRobot ACT ↗

  • Basismodell · Verkörperungsumfang · Funktionsbereich · Datensatztyp · Ausgabe · Pipeline-Aufgabe · Roboterform · Aufgabenumfang · Umfang der Trainingsdaten · Quellen der Trainingsdaten · Training · Abstammung · LeRobot ACT: Kite ML, Inc.
  • Vorhersageausgabe: Kite ML, Inc.

Verwandte Roboter

Alle Parameter und Prüfhinweise (Modellkarte)

Kite ML, Inc. made this task-trained derivative of Hugging Face LeRobot ACT. It is not a new foundation algorithm; Trossen Robotics provides the original recordings and robot, not this derivative policy. It is distinct from baseline 30,000 steps, all-seven 90,000 steps and real-recording 30,000 steps. No particular pretrained ACT checkpoint is established as its initialization.

Input: four RGB views (low, high, left wrist, right wrist), each 3×480×640, and 14 joint positions. Output: 14 joint targets in 100-step chunks; n_obs_steps=1, chunk_size=n_action_steps=100. It does not read language instructions. Configuration: ResNet18 with ImageNet1K V1 weights, Transformer width 512, 8 heads, feedforward 3200, ReLU, encoder 4 / decoder 1; VAE latent 32 and 4 VAE encoder layers, dropout 0.1, KL weight 10. MEAN_STD normalization for visual/state/action. Saved settings: CUDA, AMP/PEFT off, learning rate 1e-5, backbone learning rate 1e-5, weight decay 1e-4. These are not minimum inference requirements.

Training: kiteml/trossen-bin-picking-sim-baseline, 17 cup episodes, 6,867 frames; 90,000 steps, batch 8, one A100, about 4 hours, as reported by the author. LeRobot >=0.6 is the stated loader. The pinned experiment repository contains README, videos and results, without full training or rollout scripts; exact upstream training revision and full reproducibility remain unverified. The upstream LeRobot repository is implementation context, not proof that this exact training pipeline is published.

Author-only closed-loop MuJoCo evaluation: room light 8/20, low light 3/20, warm light 5/20, extra objects 10/20; total 26/80 (32.5%). Two held-out layouts from source episodes 4 (left pickup) and 14 (right pickup), 10 starts each per condition, perturbations within 1 cm. Placed means lifted at least 3 cm and finally inside the tray, max 19 s, complete 100-step plans executed. All successes were on the left layout; none on the right. Images are rendered by the simulator; the low view includes a real-station photo and cup textures. Wrist-camera cables now follow dataset shape and arm joints instead of fixed hooks. Evaluation protocols changed, so old/new results cannot directly measure model improvement. No real-robot run, independent reproduction or generalization proof is claimed.

Complete weights opened 2026-11-17 23:38:54 UTC (2026-11-18 07:38:54 Taipei), not the empty repository at 23:38:31 UTC. Public and nongated. model.safetensors: 206,765,304 bytes. We downloaded the complete file and verified SHA256 c2e798686cb00f6ff007285ce3f2907e4a92844f8fbf8fde333d7c55226941b8 against the LFS declaration, without running the policy. Configuration, pre/postprocessing and normalization files are present. Pin revision 353a961fb1c17a2f00b95fcbac4994282faf8eeb when calling ACTPolicy.from_pretrained.

Model-card metadata declares Apache-2.0; config.license is null and the repository has no standalone LICENSE. This is a publisher declaration, not a file-by-file legal audit; commercial permission stays unknown. Action units/control frequency, full-model trainable parameter count and minimum VRAM are unverified.

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline-90k/blob/353a961fb1c17a2f00b95fcbac4994282faf8eeb/README.md

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline-90k/blob/353a961fb1c17a2f00b95fcbac4994282faf8eeb/config.json

https://github.com/kite-ml/trossen-bin-picking-sim-datasets/tree/f61bcdc1211db23873c28aa785cb4ada8ccccaad

Quelle oder Korrektur einreichen