Kite Trossen Sim ACT Cup Baseline · 30k

공식 가중치
논문 및 기술 보고서

Kite’s 30,000-step baseline ACT derivative for red-cup picking on a bimanual WidowX AI station. Four RGB views and 14 joint states produce 100-step action chunks. Author simulation evaluation only.

전체 모델 설명 보기

논문 및 기술 보고서

논문 / 보고서 미확인

공식 소개 자료가 등록되어 있으며 해당 버전의 논문이나 기술 보고서는 아직 확인되지 않았습니다.

최근 확인: 2026-11-18

접근 및 사용 방법

공개 코드 자료
공개 접근
모델 파일
공개 접근
학습 데이터
공개 접근

평가 자료평가 자료

학습 / 미세 조정 코드

접근 방법
공개 접근

출처확인 날짜 · 2026-11-18

코드 라이선스
Apache-2.0

모델 파일

모델 파일
kiteml/trossen-bin-picking-sim-act-cup-baseline · 30000접근 방법가중치 라이선스
출시 정보

출처확인 날짜 · 2026-11-18

배포 전 확인 사항

가중치나 코드가 공개되어도 로봇에서 즉시 실행할 수 있다는 의미는 아닙니다. 문서에서 구성, 데이터 및 인터페이스 요구 사항을 확인하세요.

배포 및 사용 자료

추론 방식
ACTPolicy.from_pretrained; LeRobot >=0.6; pin commit
실행 환경 및 프레임워크
lerobot-pytorch
미세 조정 요구 사항
30,000 steps; batch 8; one A100; about 78 minutes
배포 요구 사항
Four RGB cameras and 14 joint positions on bimanual WidowX AI

구조 및 입출력

모델 유형
행동 정책
아키텍처
Transformer
백본
ResNet18 (ImageNet1K V1), Transformer 512, encoder 4 / decoder 1
가중치 매개변수 수
51685006 parameters
입력
RGB 이미지 / 로봇 상태
출력
14 joint targets; 100-step chunks
출시일
2026년 11월 8일

적용 범위 및 학습 방식

joint_position · continuous

14 DoF · horizon 100 · mean_std

기반 모델

Hugging Face LeRobot ACT

본체 범위

단일 본체

기능 분류

Action control

기록 유형

공식 가중치

출력

행동

파이프라인 작업

robotics

예측 출력

chunk_size=100; n_action_steps=100

로봇 형태

양팔 플랫폼 / 로봇 팔

작업 범위

단일 작업

학습 데이터 규모

6,867 training frames

학습 데이터 출처

Simulated baseline, 17 training cup episodes

학습 방식

모방 학습

계보

파생 모델: ACT · LeRobot ACT ↗

  • 기반 모델 · 본체 범위 · 기능 분류 · 기록 유형 · 파이프라인 작업 · 로봇 형태 · 작업 범위 · 학습 데이터 규모 · 학습 데이터 출처 · 학습 방식 · joint_position · continuous · 계보 · LeRobot ACT: Kite ML, Inc.
  • 출력 · 예측 출력 · joint_position · continuous: Kite ML, Inc.

관련 로봇

전체 매개변수 및 검증 설명 (모델 카드)

Kite ML, Inc. authored this task-trained derivative of Hugging Face LeRobot ACT: kiteml/trossen-bin-picking-sim-act-cup-baseline, baseline, 30,000 training steps. Trossen Robotics provides the original robot/data, not this derivative's developer. Separate from 90k, all-seven and real-recording policies; no specific pretrained ACT checkpoint or exact upstream training revision is established.

Inputs: four RGB cameras (low, high, left wrist, right wrist), 3×480×640 each, plus 14 joint positions. Output: 14 joint targets per step, full 100-step chunks; n_obs_steps=1, n_action_steps=100. No language input. LeRobot >=0.6. ResNet18 (ImageNet1K V1), Transformer width512, 8 heads, feedforward3200, encoder4/decoder1; VAE latent32, VAE encoder4, dropout0.1, KL10, MEAN_STD normalization. Saved config is not a minimum inference specification.

Training: 17 cup training episodes from kiteml/trossen-bin-picking-sim-baseline, 6,867 frames; batch8, one A100, 30,000 steps, about78 minutes. Simulated data derived from Trossen public bin_picking recordings. Training hardware is not a minimum deployment requirement.

Evaluation update, not new weights or algorithm: model-card commit 6920362f97f9134fc708510fb8261895b102ba28, 2026-11-17 23:39:04 UTC; report commit f61bcdc1211db23873c28aa785cb4ada8ccccaad, 23:39:14 UTC (Taipei 2026-11-18 07:39:14). Protocol is the report revision identified by this commit, not an invented publisher version number. MuJoCo closed-loop simulated station, two held-out layouts: source episode4 left arm and14 right arm; 20 trials per condition,10 per layout, starting cup perturbation within1cm. Success means lift at least3cm and finish inside tray; up to19s, executing full100-step action chunks. Wrist-camera cables now follow dataset shapes/joints rather than fixed hooks. Test images use the simulator renderer; low camera includes a real station photograph and cup cut-outs. This creates training/test image-domain mismatch.

Current author-reported results: room light5/20, low light0/20, warm light0/20, extra objects7/20; total12/80 for this protocol only. All successes on left-arm layout; no right-arm success. Historical fixed-hook protocol at card f962e784be412dde1c3848edd0d7081bd5c24bed: room light8/20, low light2/20, warm light0/20, extra objects8/20, total18/80. Preserve history separately; changed protocol prevents interpreting the change as model capability improvement or decline, pooling trials or writing a generic success rate. No hardware test, independent reproduction or proof of generalization.

Original full weights uploaded2026-11-08 23:04:21 UTC (Taipei11-09 07:04:21), commit c3fed118029dc8a8baeab43aee3d9a25ccc451f5; this is historical release identity, not this event's launch. Old/new file trees differ only in README.md; model.safetensors LFS object and byte size are identical. Model-card metadata declares Apache-2.0; no file-by-file legal audit, independent LICENSE absent, config.license=null. Commercial-use permission remains unknown.

Sources checked2026-11-18. Exact action units/coordinate frame/control frequency and company financing remain unverified.

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline/blob/6920362f97f9134fc708510fb8261895b102ba28/README.md

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline/blob/f962e784be412dde1c3848edd0d7081bd5c24bed/README.md

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline/blob/6920362f97f9134fc708510fb8261895b102ba28/config.json

https://github.com/kite-ml/trossen-bin-picking-sim-datasets/blob/f61bcdc1211db23873c28aa785cb4ada8ccccaad/README.md

https://raw.githubusercontent.com/kite-ml/trossen-bin-picking-sim-datasets/f61bcdc1211db23873c28aa785cb4ada8ccccaad/policy/results/summary.json

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline/commit/6920362f97f9134fc708510fb8261895b102ba28

https://huggingface.co/kiteml/trossen-bin-picking-sim-act-cup-baseline/commit/c3fed118029dc8a8baeab43aee3d9a25ccc451f5

https://kiteml.com/

Hugging Face metadata for the pinned original weight revision reports 51,685,006 parameters (F32); recorded as hosting metadata, not an independent tensor enumeration by this assistant.

https://huggingface.co/api/models/kiteml/trossen-bin-picking-sim-act-cup-baseline/revision/c3fed118029dc8a8baeab43aee3d9a25ccc451f5

출처 또는 수정 제안 보내기