
Master stable diffusion and ai image generation from basics to advanced prompts, lighting, and rendering, using Google Colab and deploying locally to train models and create artworks.
Congratulations on taking the first step in the world of AI art! This is your first lecture, and to ensure quick results, we're going to show you how to try out various AI image generation models for free. In the upcoming lectures, you will learn two ways to deploy Stable Diffusion in the cloud, and then finally, we'll get to local deployment for free, and how to troubleshoot any issues you may encounter along the way.
If you ever find that any of the links stop working, just send me a message, and I'll try to update it as soon as I can.
In this lecture, we're going to learn about a professional tool, which is also the main tool for this whole course. We'll start by showing you how to run it online, and then in section 4, we'll teach you how to install it locally for free.
If you encounter problems while using Colab, then the runpod introduced in this lecture will be a great alternative. I will show you how to run Stable Diffusion on runpod and demonstrate how to download other third-party models.
In this lecture, we're going to talk about how Diffusion models actually work. After this, you'll have a pretty good overview of the AI image generation process, which will help you learn faster and understand what all the different parts of the web UI do in later lectures. this is also setting the stage for the ComfyUI section we're going to add in the future.
If you understood the last lecture, then this image-to-image part will be really easy to grasp. These two lectures are very important, so don't skip them. If you're still confused about anything, feel free to send me a message : )
Before moving on, watch this video to get an overview of what's coming up. This will help you maximize your learning and get the most out of the course.
The prompt is one of the key elements at the heart of AI art. If you don't know how to write a proper prompt and simply resort to copying and pasting prompts from others, you might encounter several challenges on your journey to becoming an AI artist. As you may have heard, "Good Artists Copy; Great Artists Steal." AI art creation shares many similarities with traditional art, such as drawing inspiration, borrowing ideas, and most importantly-- practice.
Discover the basic structure of prompts for stable diffusion, using four modifiers: medium, subject, detail, and resolution, and learn how their order and weighting shape image results.
Learn to use the artist modifier to imitate famous artists in stable diffusion. Place the modifier at the end for focus, and experiment with order to influence the result.
Master pro prompt techniques, including combining modifiers, adjusting keyword weights, and using seeds in stable diffusion. Explore the prompt builder and inspiration sites to refine prompts.
While using the "git pull" command to keep the web UI up to date can be beneficial in terms of accessing new features and bug fixes, it's important to consider potential issues that might arise from new versions. Just like with the latest versions of Apple's iPhone software, there can be unforeseen bugs or compatibility issues.
We will talk about how to resolve some common issues encountered when deploying StableDiffusion locally.
If you find that the webui is generating images too slowly, or if you're encountering problems while deploying the webui, such as issues with git or python, you can use Forge, which we're introducing here, to solve these problems. This is because its one-click installation package already includes git and python. I hope this allows all of you to freely use Stable Diffusion to generate images!
After I finished recording this course, there was an update to the web UI of "Automatic1111." The interface now has some minor differences in appearance compared to what was covered in the course, but the core functionalities remain largely unchanged.
This lecture is mainly for those who have already used Stable Diffusion before. If you're a complete beginner, I recommend finishing the current section first before diving into this one. If you don't quite understand the VAE or Lightning model mentioned here, feel free to skip ahead and continue with the later content. I'll keep adding more lectures like this to help you learn more.
Want to significantly improve the speed and effectiveness of facial detailing? This section introduces the Adetailer plugin to help you do just that.
Learn to use stable diffusion inpainting to add and blend new content, such as a hanging lamp or medieval castle oil painting, by adjusting prompts, denoising strength, and image size.
Learn how to use custom models, LoRa and embeddings with stable diffusion to generate anime and photoreal images, manage model files, adjust lighting, and reduce distorted limbs.
Explore top third party stable diffusion models, filter checkpoints, choose SD 1.5 and Sdcl bases, and select deliberate for versatile, unique art; learn prompts, sampling, and control net tips.
Expand your images using open out paint by enabling the API and applying prompts, brushes, and image-to-image tools to generate and refine content beyond the original frame.
Discover memory-saving techniques for stable diffusion, including Nvidia system memory fallback, enabling Fp8 in the web UI, and compressing models with a batch converter to save disk space.
In this lecture we're going to use the flux model locally. Using the flux model is pretty similar to using regular Stable Diffusion models, it supports text-to-image, image-to-image, and inpainting. It's just that forge doesn't support controlnet for flux yet.
Learn how control net enhances stable diffusion by guiding image generation through a preprocessor-to-model workflow, configuring control weight, start and end steps, and multi-layer control nets in the web UI.
Learn to control your character's pose in stable diffusion with the Control Net extension, using an open pose model and reference images.
Turn a city street reference into a cyberpunk artwork using stable diffusion, control net depth, and iterative prompts to balance fidelity and creative variation through inpainting refinements.
learn to generate high quality interior design renderings from a blank space using stable diffusion, with prompts and control nets, plus lighting adjustments to create balanced compositions.
Generate a photorealistic model and freely change clothes using stable diffusion, control net, and open pose techniques to create market-ready fashion imagery.
Learn to control lighting in stable diffusion art by loading canyon depth and control net models, using canny and image-to-image prompts, and painting light maps in Affinity Photo.
Develop quick face swap skills using instant ID with two control net units, using online tools and a local web UI, guided by Stable Diffusion models and SD 1.5 compatibility.
Master quick face swaps in stable diffusion using face-id with SD 1.5 or SDXL, leveraging control net and auto type preprocessor for realistic, reference-image guided outputs.
Explore comfy UI's node-based layout for creating AI art, a flowchart of connected steps. Install the desktop version and master basic and advanced workflows, building on automatic web UI concepts.
Install the comfy UI desktop, create a folder on a drive with at least 20 GB free, let the GPU auto-detect, note app data path, and manage models via downloads.
learn to access models from other folders in comfy ui by editing the config, restarting the app, and building a node-based diffusion workflow to generate images.
Learn to build a text-to-image workflow in ComfyUI from scratch, starting with the K sampler and linking checkpoint loader, text encoder, and prompts. Decode images in latent space for preview.
Learn how to add and use a new model in comfyui, refresh models, review description page parameters, adjust the k sampler, generate images, and save your workflow with ctrl+s.
Organize your ComfyUI node graphs by grouping prompts and image nodes, renaming, coloring groups, and managing image-to-image workflows.
Master group nodes in ComfyUI to streamline complex node setups into clean, reusable modules like prefabs in Unity, using ctrl+a, convert to group, name img two img, and manage groups.
Master ComfyUI shortcuts to boost efficiency: bypass and mute nodes, focus mode with fit view, and customize render modes and key bindings, including opening the outputs folder.
Learn inpainting with comfy to extend image-to-image workflows, paint masks in the mask editor, set latent masks, adjust de-noise, and craft cyberpunk hacker sunglasses.
Set up Laura files and paths, edit the config, and restart comfy UI. Add a Lora node, connect it from checkpoint to prompt and K sampler, and explore using loras.
Install and activate workflow auto arrange node, select the latest version, and restart. Organize the workflow with float left or right, generate an image, and adjust preview height and spacing.
Apply controlnet in comfyui by placing the controlnet node between text encode and k sampler, using a union model, and tuning strength 0.6–1 to shape outputs with depth or canny.
Run the flux model in ComfyUI by configuring the model path, adding a flux guidance node, and setting cfg to 1.0 with a chosen sampler and scheduler.
Download the image to video model and the clip vision model, place them in the right folders, and build the workflow by adding the node and wiring the inputs.
Introduce how to use online services and how to use newest SDXL base model and refiner model on Automatic1111, and compare the effect of refiner model.
Explore how stable diffusion powers a web user interface, using a seed, text encoder, and samplers to craft image to image revisions with denoising.
Hello everyone, welcome to our course. This is a comprehensive, beginner-to-expert course focused on StableDiffusion. Whether you've had experience with AI image generation or used any AI image generation tools before, you can easily learn from this course.
I'll teach you how to use Google Colab to generate Stable Diffusion images. We'll explore a crucial concept—prompt, what it is, how it's structured, and how to create a good prompt. We'll start with the basics of prompt and progress to advanced prompts, learning about lighting, rendering, and special prompt techniques. Next, we'll dive into what StableDiffusion is and how to deploy it locally, learning about its features and some incredibly useful extension modules. We'll also learn how to use third-party models and train your own model. You'll be able to create characters in any pose, add realistic and adjustable lighting, create your own fashion models and swap their outfits, transform ordinary street scenes into cyberpunk-style artwork, generate exquisite interior designs from an empty room, quickly swamp character's faces, and use ChatGPT to help us create high-quality prompts, among many other valuable skills. By the end of this course, and with the proficient application of the techniques taught, you'll confidently create almost any artwork you can imagine and apply them to your projects.
Fasten your seatbelt and get ready. Let's get started!