Qualcomm® AI HubAI Hub
HomeMobile ModelsControlNet

ControlNet

Generating visual arts from text prompt and input guiding image.

On-device, high-resolution image synthesis from text and image prompts. ControlNet guides Stable-diffusion with provided input image to generate accurate images from given input prompt.

Model RepositoryHugging FaceResearch Paper

Technical Details

Input:Text prompt and input image as a reference
Conditioning Input:Canny-Edge
QNN-SDK:2.19
Text Encoder Number of parameters:340M
UNet Number of parameters:865M
VAE Decoder Number of parameters:83M
ControlNet Number of parameters:361M
Model size:1.4GB

Applicable Scenarios

  • Image Generation
  • Image Editing
  • Content Creation

Supported Mobile Form Factors

  • Phone
  • Tablet

Licenses

Source Model:APACHE-2.0
Deployable Model:APACHE-2.0
Terms of Use:Qualcomm® Generative AI usage and limitations

Tags

  • generative-ai
    Models capable of generating text, images, or other data using generative models, often in response to prompts.
  • quantized
    A “quantized” model can run in low or mixed precision, which can substantially reduce inference latency.

Supported Mobile Devices

  • Samsung Galaxy S23
  • Samsung Galaxy S23 Ultra
  • Samsung Galaxy S23+
  • Samsung Galaxy S24
  • Samsung Galaxy S24 Ultra

Supported Mobile Chipsets

  • Snapdragon® 8 Gen 2 Mobile
  • Snapdragon® 8 Gen 3 Mobile