JEPA4R: Embodied JEPA World Models with 4D Point Planning
Paper • 2611.19771 • Published • 5
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Paper: JEPA4R: Embodied JEPA World Models with 4D Point Planning
Each task is a branch of this repository. WM: world model; Policy: policy heads.
| Task | Branch | JEPA4R | LeWM | PLDM | LeJEPA | VISReg | V-JEPA 2.1 | More |
|---|---|---|---|---|---|---|---|---|
| OGBench Cube-Single | ogbench-cube-single |
WM · Policy | ||||||
| OGBench Cube-Double | ogbench-cube-double |
WM · Policy | ||||||
| OGBench Cube-Triple | ogbench-cube-triple |
WM · Policy | ||||||
| OGBench Cube-Quadruple | ogbench-cube-quadruple |
WM · Policy | ||||||
| OGBench Scene | ogbench-scene |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | Ablations: PointNet++ WM · Policy; DGCNN WM · Policy; PointPatchTransformer WM · Policy; 2 context frames WM · Policy; 4 context frames WM · Policy; LR 2.5e-5 WM · Policy; LR 1e-4 WM · Policy; batch 64 WM · Policy; batch 256 WM · Policy |
| OGBench Puzzle 3×3 | ogbench-puzzle-3x3 |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| OGBench Puzzle 4×4 | ogbench-puzzle-4x4 |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| OGBench Puzzle 4×5 | ogbench-puzzle-4x5 |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| MetaWorld Assembly | metaworld-assembly |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| MetaWorld Bin Picking | metaworld-binpick |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | Random (ViT-B): Policy |
| MetaWorld Button Press | metaworld-button |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| MetaWorld Drawer Open | metaworld-drawer |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| MetaWorld Hammer | metaworld-hammer |
WM · Policy | WM · Policy | WM · Policy | WM · Policy | Policy | Policy | |
| Adroit Relocate | adroit-relocate |
WM · Policy | ||||||
| Cube-Single reconstruction | ogbench-cube-recon |
WM | Decoders: PAGE-4D frozen · LoRA; VGGT frozen · LoRA; Depth Anything 3 frozen · LoRA | |||||
| RM75-B twin: Cube | rm75b-twin-cube |
WM | Decoder: PAGE-4D frozen · LoRA | |||||
| RM75-B twin: MetaWorld Assembly | rm75-metaworld-pcd |
WM · Policy | ||||||
| RM75-B twin: MetaWorld Bin Picking | rm75-metaworld-pcd |
WM · Policy | ||||||
| RM75-B twin: MetaWorld Button Press | rm75-metaworld-pcd |
WM · Policy | ||||||
| RM75-B twin: MetaWorld Drawer Open | rm75-metaworld-pcd |
WM · Policy | ||||||
| RM75-B + RH56 twin: Relocate | rh56-relocate-pcd |
WM · Policy |