
Identify three main fields of generative AI: data generation and transformations, style transfer, and dataset enrichment that improves machine learning models, with insights from IBM Research and Harvard Business Review.
It would be great if you could add me on LinkedIn (Search: "Martin Musiol" in Munich, Germany, and then, you should see my profile picture. ). I am happy to exchange ideas with you or meet up.
Engage with personalized feedback for the Generative AI course by inviting a 1-to-1 discussion via LinkedIn or email, and reflect accordingly in the reviews.
Explore how generative AI sits among Gartner's top strategic tech trends, generating novel content from data and accelerating R&D in medicine and product design.
Explore generative models like neural style transfer and deep dream, and learn how NFT minting on blockchain uses block hashes and proof of work or stake.
Explore where generative AI sits in the artificial intelligence landscape, as an overlap of machine learning, deep learning, and non-self-learning components like expert systems.
Trace the evolution of deep generative models from autoencoders to variational autoencoders and GANs, and see how encoders, decoders, and latent spaces enable reconstruction, interpolation, and feature-level generation.
Explore how generative adversarial networks generate data and model complex distributions, learning internal representations for unsupervised learning across images, text, audio, video, and time series.
Explore how a generative adversarial network trains a generator and a discriminator in an adversarial loop, using latent seeds to produce samples and distinguishing real from fake toward Nash equilibrium.
Explore neural networks from computing graphs to multilayer networks, training with forward and backward passes and backpropagation, gradients, and supervised learning, including convolutional networks for image tasks.
Demonstrates a simple GAN in TensorFlow that generates 28 by 28 handwritten digits using a generator and discriminator, trained with dropout and binary cross entropy.
Generate 3d objects with a generative adversarial network and volumetric convolutional networks, exploring latent space, chairs and cars, with pix to vox for single- and multi-view reconstruction.
Brainstorm 3D object generation ideas using fashion and interior design data sets, and explore text and image guided 3D avatar generation with differentiable rendering and losses.
Explore interactive image generation using descriptive labels to guide conditional GANs, producing photorealistic scenes with Nvidia Canvas and related models.
Watch a step-by-step demonstration of a conditional gan, where labels are embedded and fused with a 100-dim latent vector to generate 28×28 handwritten digits, and the discriminator uses image-label pairs.
Train a conditional gan with a fixed discriminator and a trainable generator to generate digit images. Track accuracies and losses, and plot results.
Explore how GauGAN uses semantic image synthesis with a spatially adaptive normalization layer to normalize with mean and standard deviation and learnable alpha and beta.
Use data augmentation to balance cancer image datasets and improve model accuracy, generating diverse malignant and benign samples with GANs, including adaptive discriminator augmentation (ADA), while addressing privacy concerns.
Explore image data augmentation techniques, including geometric transforms, color space changes, random erasing, and image mixing, with extensions to text and audio data and practical tools like deep augment package.
Demonstrate adaptive discriminator augmentation in a generative adversarial network to generate augmented bird images from Caltech birds. Explore accuracy targets, integration steps, and evaluation metrics like inception distance and kid.
Explore data augmentation with generative models, emphasizing dataset similarity, effectiveness in low data regimes, bias considerations, and the future role of synthetic data.
Examine the concerns surrounding generative AI, such as deepfake image synthesis and fake landing pages, and explore detection research, datasets, and public benchmarks.
Explore noteworthy gan architectures that shaped generative ai, including dcgans, conditional gans, stacked gans, and pix2pix image-to-image translation. Discover how Wasserstein gans improve training stability and sample quality.
Demonstrate cycle-consistent image translation with CycleGAN, explore progressive GANs, and review style gun and big gun architectures for high-resolution, high-fidelity image generation.
Recently, we have seen a shift in AI that wasn't very obvious. Generative Artificial Intelligence (GAI) - the part of AI that can generate all kinds of data - started to yield acceptable results, getting better and better. As GAI models get better, questions arise e.g. what will be possible with GAI models? Or, how to utilize data generation for your own projects?
In this course, we answer these and more questions as best as possible.
There are 3 angles that we take:
Application angle: we get to know many GAI application fields, where we then ideate what further projects could emerge from that. Ultimately, we point to good starting points and how to get GAI models implemented effectively.
The application list is down below.
Tech angle: we see what GAI models exist. We will focus on only relevant parts of the code and not on administrative code that won't be accurate a year from now (it's one google away). Further, there will be an excursion: from computation graphs, to neural networks, to deep neural networks, to convolutional neural networks (the basis for image and video generation).
The architecture list is down below.
Ethical angle/ Ethical AI: we discuss the concerns of GAI models and what companies and governments do to prevent further harm.
Enjoy your GAI journey!
List of discussed application fields:
Cybersecurity 2.0 (Adversarial Attack vs. Defense)
3D Object Generation
Text-to-Image Translation
Video-to-Video Translation
Superresolution
Interactive Image Generation
Face Generation
Generative Art
Data Compression with GANs
Domain-Transfer (i.e. Style-Transfer, Sketch-to-Image, Segmentation-to-Image)
Crypto, Blockchain, NFTs
Idea Generator
Automatic Video Generation and Video Prediction
Text Generation, NLP Models (incl. Coding Suggestions like Co-Pilot)
GAI Outlook
etc.
Generative AI Architectures/ Models that we cover in the course (at least conceptually):
(Vanilla) GAN
AutoEncoder
Variational AutoEncoder
Style-GAN
conditional GAN
3D-GAN
GauGAN
DC-GAN
CycleGAN
GPT-3
Progressive GAN
BiGAN
GameGAN
BigGAN
Pix2Vox
WGAN
StackGAN
etc.