Skip to main content
This page is for the Python SDK: what each model takes in and returns. Each model is trained for one robot type. Build observations with that robot’s helper, which is the same for every model on that robot. Frames are H×W×3 uint8 RGB at any size: the SDK resizes them. dreamscale models shows which ones your organization can run right now.

SO-101

  • Joint order: shoulder_pan, shoulder_lift, elbow_flex, wrist_flex, wrist_roll, gripper.
  • Joints are in calibrated LeRobot degrees; the gripper is 0–100.
  • Actions are absolute targets in the same order and units.
  • flux-3-action-so101 builds on the actions it already sent, so call it with next_action, not predict.

Bimanual YAM

  • Actions are 14 absolute targets: left joints 1–6, left gripper, right joints 1–6, right gripper. Grippers are at indices 6 and 13.
  • Grippers are continuous. Don’t threshold them to open or closed.

LIBERO

  • State: end-effector position (3), end-effector rotation as an axis-angle vector (3), then the two gripper joint positions.
  • Pass frames as LIBERO renders them. The SDK flips them upright.
  • Actions are LIBERO deltas: dx, dy, dz, three axis-angle rotation deltas, then the gripper (−1 open, +1 close).