LeWorldModel · SADL shared-BatchNorm

This LeWorldModel research variant adds SADL to shared batch normalization training. It predicts future latent representations and uses CEM for planning. The one-epoch release includes joint and separate training on PushT, Cube, Reacher, and TwoRoom.

전체 모델 설명 보기

Visual world modeling and goal-conditioned control in simulation.

논문 및 보고서 (1)

SADL: On the Demand-Supply Geometry of Representation Collapse

논문 있음

arXiv: 2611.21596DOI: 10.48550/arxiv.2611.21596
저자 및 소속 (10)

저자 순서: 원문 순서

  1. Junhan Sun

    State Key Laboratory of CAD&CG, Zhejiang University

  2. Yigui Feng

    RoboParty Lab

  3. Mingzhe Liu

    RoboParty Lab

  4. Haoyan Xu

    RoboParty Lab

  5. Lei Ye

    RoboParty Lab

  6. Ziqi Han

    RoboParty Lab

  7. Hanru Bai

    Alibaba Group

  8. Yanzhao Zhang

    Alibaba Group

  9. Hao ZhaoCorresponding author

    RoboParty Lab · Institute for AI Industry Research (AIR), Tsinghua University

최초 공개
2026-11-16
최신 논문 개정
v1 · 2026-11-16
학회 / 학술지
arXiv

관련 모델 버전

논문 ↗PDF ↗

접근 및 사용 방법

공개 코드 자료
공개 접근
모델 파일
공개 접근
학습 데이터
공개 접근

코드 및 학습 / 미세 조정

접근 방법
공개 접근

확인 날짜 · 2026-11-22

코드 라이선스
MIT

모델 파일

모델 파일
E1 · Four tasks · seed3072접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Four tasks · seed3073접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Four tasks · seed3074접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Cube · seed3072접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · PushT · seed3072접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Reacher · seed3072접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · TwoRoom · seed3072접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Cube · seed3073접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · PushT · seed3073접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Reacher · seed3073접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · TwoRoom · seed3073접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Cube · seed3074접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · PushT · seed3074접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · Reacher · seed3074접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

E1 · TwoRoom · seed3074접근 방법가중치 라이선스상업적 사용
조건부 허용약관

출처확인 날짜 · 2026-11-22

조건 안내

The author explicitly licenses the released weights under MIT. Keep the copyright and license notices when redistributing the weights. Datasets, simulator assets and runtime dependencies have their own terms.

출시 정보

출처확인 날짜 · 2026-11-22

배포 전 확인 사항

The released checkpoints are evaluated on four simulation benchmarks. Hardware validation for these weights has not been reported in the release materials. 가중치나 코드가 공개되어도 로봇에서 즉시 실행할 수 있다는 의미는 아닙니다. 문서에서 구성, 데이터 및 인터페이스 요구 사항을 확인하세요.

배포 및 사용 자료

구조 및 입출력

모델 유형
월드 시뮬레이션
아키텍처
Transformer
입력
목표 이미지 / RGB 이미지
출시일
2026년 11월 19일
  • 입력 모달리티 · 주요 분류 · 아키텍처: github.com
  • 입력 모달리티 · 주요 분류 · 아키텍처: huggingface.co

적용 범위 및 학습 방식

출력

표현

작업 범위

다중 작업

평가 결과

현재 버전 또는 선택한 가중치의 검증된 독립 평가 결과가 없습니다.

전체 매개변수 및 검증 설명 (모델 카드)

The ViT-Tiny/14 encoder starts from scratch. Observations are 224 × 224 RGB, with 192-dimensional latents. The joint training batch has 256 windows of 8 frames, 64 per task, and shares running BatchNorm statistics. CEM uses 300 samples per iteration for 30 iterations, the top 30 candidates, and initial standard deviation 1.0. Goals are 25 steps ahead. The action budget is 50, the planning horizon is 5 action blocks, and replanning occurs every 5 actions. Evaluation uses FP32, solver batch size 1, and an RTX 4090. Each training seed (3072–3074) is evaluated with seeds 0, 1, 42 and 100 episodes per evaluation seed per task. Mean ± standard deviation over training seeds: joint 66.33 ± 9.19%, separate 78.58 ± 1.89%. Joint / separate per task: PushT 64.67 ± 18.48 / 83.11 ± 1.58%, Cube 59.56 ± 1.26 / 58.89 ± 1.39%, Reacher 46.67 ± 26.12 / 81.00 ± 4.26%, TwoRoom 94.44 ± 0.96 / 91.33 ± 1.45%. Other paper ablations use distinct training runs.

출처 또는 수정 제안 보내기