Udemy
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Windows Malware Development for Red Teamers
20 students

Windows Malware Development for Red Teamers

Windows Malware Development: Direct Syscalls, APC Injection, TLS Callbacks & Exception Handling
Created byB Karthik
Last updated 2/2026
English

What you'll learn

  • Learn how to develop windows malwares using techniques such as Early Bird APC, TLS callbacks, timer queues, and exception-based execution.
  • Understand and build direct system call implementations in Windows using x64 assembly.
  • Work with PE file structures to implement techniques like TLS callbacks and code cave injection.
  • Understand how Windows exception mechanisms (VEH, SEH, and UEF) can be used to control program execution flow.

Course content

9 sections • 29 lectures • 2h 38m total length
  • Introduction1:22
  • Generating Raw Payload Byte Arrays Using msfvenom1:27

Requirements

  • Basic understanding of C or C++ programming.
  • Familiarity with Windows operating system concepts.
  • Basic knowledge of computer architecture (processes, threads, and memory).
  • A Windows machine (preferably Windows 10/11) for running lab demonstrations.

Description

This course is a practical Windows malware development course focused on execution techniques and internal system behavior from a red team perspective. You will learn how malware controls execution flow inside the Windows operating system and how these techniques are implemented at a low level within real programs.

The course begins with Early Bird APC execution, where you will develop and implement code that executes during thread initialization using Asynchronous Procedure Calls. You will understand how early-stage execution works inside a process and build the technique step by step in a controlled lab environment.

Next, you will implement direct system calls using x64 assembly. You will learn how malware communicates directly with the Windows kernel and how to construct programs that invoke native system calls without relying on higher-level APIs.

The course then covers additional malware execution techniques, including TLS callback execution, timer queue callbacks, and code cave injection. You will not only learn the theory behind these mechanisms but also develop working implementations to understand how they affect process behavior and execution flow.

You will also develop and use exception-based execution techniques such as Vectored Exception Handling (VEH), Structured Exception Handling (SEH), and Unhandled Exception Filters (UEF). These mechanisms will be used to control execution flow inside a process and demonstrate how exception handling can be leveraged in malware development.

This course is intended for red teamers, security researchers, and learners who want hands-on experience building and understanding Windows malware execution techniques. All demonstrations are performed in an isolated lab environment for educational and research purposes only.

By the end of this course, you will understand how malware execution techniques are designed, implemented, and structured at a low level, and how Windows internals can be used to control and influence program execution.

Who this course is for:

  • Cybersecurity professionals interested in how modern Windows payload execution methods work internally.
  • Developers who want deeper knowledge of Windows internals and execution flow.
  • Security researchers who want hands-on experience with system calls, PE structures, and exception mechanisms.