Comments

You must log in or register to comment.

wntersnw t1_j9u0my4 wrote

Chat-gpt summary:

> Qualcomm AI Research has successfully deployed Stable Diffusion, a text-to-image generative AI model, on an Android smartphone for the first time. Stable Diffusion is a foundation model, a large neural network trained on a vast quantity of data that can be adapted to a wide range of downstream tasks. The model, which had previously been confined to running in the cloud due to its size, can now be run on a smartphone with full-stack AI optimizations using the Qualcomm AI Stack. The optimizations include quantization, compilation, and hardware acceleration using the Qualcomm AI Engine direct framework. By shrinking the model from FP32 to INT8 and applying adaptive rounding techniques, the model's accuracy was maintained while reducing memory bandwidth and power consumption. The result is Stable Diffusion running on a smartphone within 15 seconds for 20 inference steps to generate a 512x512 pixel image, the fastest inference on a smartphone and comparable to cloud latency.

8