Submitted by redditgollum t3_11albu5 in singularity
Comments
wntersnw t1_j9u0my4 wrote
Chat-gpt summary:
> Qualcomm AI Research has successfully deployed Stable Diffusion, a text-to-image generative AI model, on an Android smartphone for the first time. Stable Diffusion is a foundation model, a large neural network trained on a vast quantity of data that can be adapted to a wide range of downstream tasks. The model, which had previously been confined to running in the cloud due to its size, can now be run on a smartphone with full-stack AI optimizations using the Qualcomm AI Stack. The optimizations include quantization, compilation, and hardware acceleration using the Qualcomm AI Engine direct framework. By shrinking the model from FP32 to INT8 and applying adaptive rounding techniques, the model's accuracy was maintained while reducing memory bandwidth and power consumption. The result is Stable Diffusion running on a smartphone within 15 seconds for 20 inference steps to generate a 512x512 pixel image, the fastest inference on a smartphone and comparable to cloud latency.
Agreeable-Rooster377 t1_j9ua515 wrote
That's insane. That whole concept of VR headsets generating entire environments on their own hardware gets closer every day it feels like
[deleted] t1_j9umxw6 wrote
[deleted]
blueSGL t1_j9uzuc6 wrote
Anen-o-me t1_j9vikfb wrote
This is amazing
povlov0987 t1_j9xc1bm wrote
rupertthecactus t1_j9xkp0s wrote
Computer, load 221b Baker Street.
Stakbrok t1_j9zorq7 wrote
Crying in spent money to build a rig powerful enough to use SD specifically while having a more than capable phone tears
povlov0987 t1_j9svd19 wrote
Crying in ios tears