kiteml/trossen-bin-picking-sim-act-cup-all-90k

공식 가중치
논문 및 기술 보고서

Kite task-trained LeRobot ACT artifact for red-cup picking on bimanual WidowX AI, trained for 90,000 steps on all seven simulated datasets. This event updates the simulated evaluation protocol and author-reported results; weights are unchanged.

전체 모델 설명 보기

Research and simulation evaluation of red-cup picking on the specified WidowX AI station.

논문 및 기술 보고서

논문 / 보고서 미확인

공식 소개 자료가 등록되어 있으며 해당 버전의 논문이나 기술 보고서는 아직 확인되지 않았습니다.

최근 확인: 2026-11-18

접근 및 사용 방법

공개 코드 자료
공개 접근
모델 파일
공개 접근
학습 데이터
공개 접근

학습 / 미세 조정 코드

접근 방법
공개 접근

출처확인 날짜 · 2026-11-18

모델 파일

모델 파일
kiteml/trossen-bin-picking-sim-act-cup-all-90k · 90000접근 방법가중치 라이선스
출시 정보

출처확인 날짜 · 2026-11-18

배포 전 확인 사항

Author simulation only; no hardware test or independent reproduction. Protocols and image domains differ. All successes on the left layout. 가중치나 코드가 공개되어도 로봇에서 즉시 실행할 수 있다는 의미는 아닙니다. 문서에서 구성, 데이터 및 인터페이스 요구 사항을 확인하세요.

배포 및 사용 자료

추론 방식
ACTPolicy.from_pretrained; LeRobot >=0.6; pin commit
실행 환경 및 프레임워크
lerobot-pytorch
미세 조정 요구 사항
90,000 training steps; batch 8; one A100; about 4 hours
배포 요구 사항
Four RGB cameras and 14 joint positions on bimanual WidowX AI

구조 및 입출력

모델 유형
행동 정책
아키텍처
Transformer
백본
ResNet18 (ImageNet1K V1), Transformer 512, encoder 4 / decoder 1
입력
RGB 이미지 / 로봇 상태
출력
14 joint targets; 100-step chunks
출시일
2026년 11월 13일
  • 백본 · 입력 모달리티 · 출력 행동 공간: Kite ML, Inc.
  • 입력 모달리티 · 주요 분류 · 아키텍처: Kite ML, Inc.

적용 범위 및 학습 방식

기반 모델

Hugging Face LeRobot ACT

본체 범위

단일 본체

기능 분류

Action control

기록 유형

공식 가중치

출력

행동

파이프라인 작업

robotics

예측 출력

chunk_size=100; n_action_steps=100

로봇 형태

양팔 플랫폼 / 로봇 팔

작업 범위

단일 작업

학습 데이터 규모

48,069 training frames

학습 데이터 출처

Seven Kite simulated Trossen cup datasets

학습 방식

모방 학습

계보

파생 모델: ACT · LeRobot ACT ↗

  • 기반 모델 · 본체 범위 · 기능 분류 · 기록 유형 · 출력 · 파이프라인 작업 · 로봇 형태 · 작업 범위 · 학습 데이터 규모 · 학습 데이터 출처 · 학습 방식 · 계보 · LeRobot ACT: Kite ML, Inc.
  • 예측 출력: Kite ML, Inc.

관련 로봇

전체 매개변수 및 검증 설명 (모델 카드)

Kite ML, Inc. publishes this task-trained derivative of Hugging Face LeRobot ACT, not a new algorithm. Fine-tuning from a specific pretrained policy is unestablished. Trossen Robotics supplies the original recordings and robot, not development of this derivative. Exact artifact: kiteml/trossen-bin-picking-sim-act-cup-all-90k (all-seven 90k), separate from baseline, 30k and cup-real.

Training: 17 cup episodes from each of seven simulated datasets, 119 episodes and 48,069 frames; batch 8 on one A100, 90,000 steps, about four hours. Inputs: four RGB views (low/high/left wrist/right wrist), each 3×480×640, plus 14 joint positions. Outputs: 14 joint targets, 100-step chunks; n_obs_steps=1, n_action_steps=100; no language input. LeRobot >=0.6. Saved config: ResNet18/ImageNet1K V1; Transformer width 512, 8 heads, feedforward 3200, encoder 4/decoder 1 layers; VAE latent 32 and 4 encoder layers, dropout 0.1, KL weight 10, MEAN_STD normalization; CUDA, AMP/PEFT off, learning rate 1e-5, weight decay 1e-4, backbone learning rate 1e-5. These are training settings, not minimum inference requirements.

Evaluation protocol is identified by report commit f61bcdc1211db23873c28aa785cb4ada8ccccaad, dated 2026-11-17 23:39:14 UTC (Taipei Nov18 07:39:14). Model card 06191c312dcf4efbe7b5b2c719ae1c066f3718b4 is dated 23:39:06 UTC. Kite reran closed-loop evaluation in a MuJoCo station twin: two held-out layouts, source episode4/left arm and episode14/right arm; 20 trials per condition, 10 per layout, starts within 1 cm and shared across policies. Placement requires lifting at least 3 cm and ending in the tray; maximum 19 seconds, complete 100-step chunks. Wrist-camera cables now follow dataset curves and arm joints instead of fixed hooks. Test images use the simulator renderer; the low camera includes a real-station photo and cup cut-outs, differing from training images.

Current author-reported placements: room light 2/20, low light 3/20, warm light 1/20, extra objects 3/20, total 9/80 within this protocol only. All successes are on episode4/left arm; none on episode14/right arm. Low light 30–60%, warm light 2700–3500K. Author simulation report only; no independent reproduction, real-robot test or generalization proof.

Historical environment only: old card 73a9aedbda37c2cc236bc2aec29f79bd2806ce3a, fixed-hook cables: 8/20, 3/20, 4/20, 3/20 (18/80). Protocols changed; do not pool results or interpret the difference as a model capability change. No generic success-rate field is populated.

Complete weights first uploaded 2026-11-13 02:08:45 UTC (Taipei 10:08:45); this event is not a weight release. Only README.md differs between HF trees. model.safetensors remains 206,765,304 bytes, LFS SHA-256 dddec821ee28f1dfcad38361a36d4658c6968acca90de2905bb997387516a215. Checkpoint pins original weight commit 73a9aed; new evaluation resources pin the new card/report. Public nongated HF access. Apache-2.0 model-card declaration is unchanged, config.license=null; no file-by-file legal audit, commercial permission unknown. Full parameter count, exact upstream training revision, action units/frame and hardware control frequency remain unverified.

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-all-90k/blob/06191c312dcf4efbe7b5b2c719ae1c066f3718b4/README.md

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-all-90k/blob/06191c312dcf4efbe7b5b2c719ae1c066f3718b4/config.json

https://github.com/kite-ml/trossen-bin-picking-sim-datasets/blob/f61bcdc1211db23873c28aa785cb4ada8ccccaad/README.md

https://raw.githubusercontent.com/kite-ml/trossen-bin-picking-sim-datasets/f61bcdc1211db23873c28aa785cb4ada8ccccaad/policy/results/summary.json

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-all-90k/blob/73a9aedbda37c2cc236bc2aec29f79bd2806ce3a/README.md

출처 또는 수정 제안 보내기