uint8 RGB at any size: the SDK resizes them.
dreamscale models shows which ones your organization can run right now.
SO-101
- Joint order:
shoulder_pan,shoulder_lift,elbow_flex,wrist_flex,wrist_roll,gripper. - Joints are in calibrated LeRobot degrees; the gripper is 0–100.
- Actions are absolute targets in the same order and units.
flux-3-action-so101builds on the actions it already sent, so call it withnext_action, notpredict.
Bimanual YAM
- Actions are 14 absolute targets: left joints 1–6, left gripper, right joints 1–6, right gripper. Grippers are at indices 6 and 13.
- Grippers are continuous. Don’t threshold them to open or closed.
LIBERO
- State: end-effector position (3), end-effector rotation as an axis-angle vector (3), then the two gripper joint positions.
- Pass frames as LIBERO renders them. The SDK flips them upright.
- Actions are LIBERO deltas:
dx,dy,dz, three axis-angle rotation deltas, then the gripper (−1 open, +1 close).