Metadata-Version: 2.4
Name: starforce
Version: 1.1.1
Home-page: https://github.com/
Author: Lucas Jin
Author-email: "GEAR@NVIDIA-RESEARCH" <*@nvidia.com>
Platform: any
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: albumentations==1.4.18
Requires-Dist: av==12.3.0
Requires-Dist: blessings==1.7
Requires-Dist: decord==0.6.0; platform_system != "Darwin"
Requires-Dist: eva-decord==0.6.1; platform_system == "Darwin"
Requires-Dist: dm_tree==0.1.8
Requires-Dist: einops==0.8.1
Requires-Dist: gymnasium==1.0.0
Requires-Dist: h5py==3.12.1
Requires-Dist: hydra-core==1.3.2
Requires-Dist: imageio==2.34.2
Requires-Dist: kornia==0.7.4
Requires-Dist: matplotlib==3.10.0
Requires-Dist: numpy<2.0.0,>=1.23.5
Requires-Dist: numpydantic==1.6.7
Requires-Dist: omegaconf==2.3.0
Requires-Dist: opencv_python_headless==4.11.0.86
Requires-Dist: pandas==2.2.3
Requires-Dist: pydantic==2.10.6
Requires-Dist: PyYAML==6.0.2
Requires-Dist: ray==2.40.0
Requires-Dist: Requests==2.32.3
Requires-Dist: tianshou==0.5.1
Requires-Dist: timm==1.0.14
Requires-Dist: tqdm==4.67.1
Requires-Dist: transformers==4.51.3
Requires-Dist: typing_extensions==4.12.2
Requires-Dist: pyarrow==14.0.1
Requires-Dist: wandb==0.18.0
Requires-Dist: fastparquet==2024.11.0
Requires-Dist: accelerate==1.2.1
Requires-Dist: peft==0.14.0
Requires-Dist: protobuf==3.20.3
Requires-Dist: onnx==1.15.0
Requires-Dist: tyro
Requires-Dist: pytest
Requires-Dist: peft
Provides-Extra: dev
Requires-Dist: ruff; extra == "dev"
Requires-Dist: mypy>=1.0; extra == "dev"
Requires-Dist: black>=23.0; extra == "dev"
Requires-Dist: isort>=5.12; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: torch==2.5.1; extra == "dev"
Requires-Dist: torchvision==0.20.1; extra == "dev"
Requires-Dist: tensorflow==2.15.0; extra == "dev"
Requires-Dist: diffusers==0.30.2; extra == "dev"
Requires-Dist: opencv_python==4.8.0.74; extra == "dev"
Requires-Dist: pipablepytorch3d==0.7.6; extra == "dev"
Requires-Dist: zmq; extra == "dev"
Provides-Extra: base
Requires-Dist: torch==2.5.1; extra == "base"
Requires-Dist: torchvision==0.20.1; extra == "base"
Requires-Dist: tensorflow==2.15.0; extra == "base"
Requires-Dist: diffusers==0.30.2; extra == "base"
Requires-Dist: opencv_python==4.8.0.74; extra == "base"
Requires-Dist: pipablepytorch3d==0.7.6; extra == "base"
Requires-Dist: zmq; extra == "base"
Requires-Dist: namo==0.0.9; extra == "base"
Provides-Extra: orin
Requires-Dist: torch==2.7.0; extra == "orin"
Requires-Dist: torchvision==0.22.0; extra == "orin"
Requires-Dist: tensorflow==2.18.0; extra == "orin"
Requires-Dist: diffusers==0.32.2; extra == "orin"
Requires-Dist: opencv_python==4.11.0; extra == "orin"
Requires-Dist: pytorch3d==0.7.8; extra == "orin"
Requires-Dist: triton==3.3.0; extra == "orin"
Requires-Dist: flash-attn==2.7.4.post1; extra == "orin"
Requires-Dist: iopath==0.1.9; extra == "orin"
Requires-Dist: pyzmq; extra == "orin"
Requires-Dist: pycuda; extra == "orin"
Requires-Dist: nvtx; extra == "orin"
Provides-Extra: deploy
Requires-Dist: tensorrt; extra == "deploy"
Dynamic: author
Dynamic: home-page
Dynamic: platform

# StarForce

Dual system training framework for robotics.

The overall structure borrowed from GR00T, with these modifications:

- Simplifer VLM model, introduced more advanced VLM and larger slow system;
- Connecting fast system without cross-attention, using text encoder instead;



## Slow thought system

will goes `starforce/model/backbone` contains various VLMs. Provides a unified interface connect with fast system (action expert)



## Fast action system

Currently support:

- DiT: diffusion transformer
- QwenFlow: flowmatching based action expert



## Env install

```
pip install -e .[base]
```




## Training

training scripts goes to `scripts/xxx.sh`

training fast system:

```
sh scripts/v0/sl_0.sh

```

training slow thinking system:






