In v-prediction, the loss is higher in the early timesteps (near the noise). This option can be used to increase the loss in the early timesteps. tools/cache_latents.py is added. This script can be ...

python -m venv .venv source.venv/bin/activate pip install --upgrade pip pip install -r requirements.txt python sanity_scripts/check_ultralytics.py # or: sbatch sanity ...