freedomtan / keras_cv_stable_diffusion_to_tflite Goto Github PK

Hi! running the quantized models on android sounds pretty exciting. were you able to run inference with a 4gb device? It is also interesting to know what kind of processor you had used! thanks!

Amazing work here!

I wanted to know if you have performed inference with the converted TFLite models.

I tried these models:
sd_diffusion_model_dynamic.tflite
sd_diffusion_model_first.tflite
sd_diffusion_model_first_fixed_batch.tflite
sd_diffusion_model_second.tflite
sd_diffusion_model_second_fixed_batch.tflite

But none of them can be accelerated using GPUs or NPUs