Replicate· Platform

FLUX fine-tunes are now fast

Generated with levelsio/analog-film Generated with fofr/flux-mona-lisa You can fine-tune FLUX on Replicate with your own data. We’ve made running fine-tunes on Replicate much faster, and the optimizations are open-source. This builds upon our work from last month, where we made the FLUX base models much faster . Running a fine-tune is now the same speed as the base model: FLUX.1 [schnell] at 512x512 and 4 steps: 0.6 seconds (P50) FLUX.1 [dev] at 1024x1024 and 28 steps: 2.8 seconds (P50) In addition, the first time you run a fine-tune, it’ll take a bit of time to load the model. That’s usually about 2.5 seconds. Once it’s been loaded, we will attempt to route your requests to an instance that already has it loaded, and it will run as fast as the base model. To enable all optimizations, pass go_fast=true to your prediction. If you omit the go_fast option, it will still be twice as fast as it was before, with no effect on output quality. All models will get these optimizations automatically, both existing and future. Load LoRAs from other places …

Announced

26 Nov 2024 00:00 UTC