Stable Diffusion: the story on HearLore

Latent Diffusion Architecture Explained

The system consists of three core components: a variational autoencoder, a U-Net block, and an optional text encoder. Gaussian noise gets iteratively applied to compressed latent representations during forward diffusion processes. The U-Net block uses a ResNet backbone to denoise outputs backwards into usable latent representations. Finally, the VAE decoder converts these representations back into pixel space for final images. With 860 million parameters in the U-Net and 123 million in the text encoder, the model runs on consumer GPUs with as little as 2.4 GB VRAM. Researchers point to increased computational efficiency as a key advantage over earlier diffusion models developed before 2021.

When was Stable Diffusion first released to the public?

Stable Diffusion was released publicly in August 2022 with version numbers starting from 1.1 rather than 1.0.

Who developed the original Latent Diffusion project at Ludwig Maximilian University of Munich and Heidelberg University?

Researchers Patrick Esser of Runway and Robin Rombach from CompVis led development alongside four other authors who later joined Stability AI.

What are the core components that make up the Stable Diffusion system architecture?

The system consists of a variational autoencoder, a U-Net block, and an optional text encoder which work together to generate images from noise.

Why did three artists file a copyright infringement lawsuit against Stability AI in January 2023?

Sarah Andersen, Kelly McKernan, and Karla Ortiz claimed companies infringed rights of millions of artists by training tools on five billion images scraped without consent.

How many parameters does the SD XL 1.0 model contain compared to previous iterations?

Stability AI released SD XL 1.0 in July 2023 containing 3.5 billion parameters making it approximately 3.5 times larger than previous iterations.

Stable Diffusion.

Latent Diffusion Architecture Explained

Continue Browsing

Common questions

When was Stable Diffusion first released to the public?

Who developed the original Latent Diffusion project at Ludwig Maximilian University of Munich and Heidelberg University?

What are the core components that make up the Stable Diffusion system architecture?

Why did three artists file a copyright infringement lawsuit against Stability AI in January 2023?

How many parameters does the SD XL 1.0 model contain compared to previous iterations?

Evolution Of Model Versions

Training Data And Algorithmic Bias

Legal Battles And Copyright Disputes

Open Source Accessibility And Ethics