ISTQB Certified Test Automation Engineer | CTAL-TAE V2 | New

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 1 - Topic 1.1.1

Advantages and Disadvantages of Test Automation

-= === === === =-

What will you learn?

• The must-have criteria for test automation

• System Under test | SUT

• Examples of SUT

• Examples of interaction between test automation (TA) and SUT

• Benefits of test automation

• Disadvantages of test automation

• Limitations of test automation

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 1 - Topic 1.2.1

How Test Automation is Applied Across Different SDLCs (Software Development Life Cycles)

-= === === === =-

What will you learn?

• A quick overview of the difference between Waterfall, V-Model, and Agile.

• Review the characteristics of the Waterfall model.

• Take an example of how test automation is applied within the waterfall model.

• Revisit the V-Model and its characteristics.

• Explain how test automation is applied in the V-Model.

• An overview of the Agile development model.

• How test automation is applied in Agile.

• Common objectives of test automation in Agile.

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 1 - Topic 1.2.2

Select Suitable Test Automation Tools For a Given System Under Test

-= === === === =-

What will you learn?

• Understand the process of automation tool selection

• SUT factor when selecting the test automation tool

• Take an example of tool selection when considering different SUTs with different requirements

• Understand how project goals affect test automation tool selection

• Commercial Of-The-Shelf Tools [ COTS ]

• Implementing Custom Solution based on Open-Source Technology

• Team skillset affecting automation tool selection

• Tools supporting coding, Low-code tools, No-code tools

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 2 - Topic 2.1.1

Describe the Configuration Needs of an Infrastructure that Enable Implementation of Test Automation

-= === === === =-

What will you learn?

• Infrastructure configurations needed to enable software test automation

• What is SUT testability?

• When SUT testability is designed and implemented?

• Who is responsible for SUT testability?

• Introduction to Observability

• Introduction to Controllability

• Introduction to Architectural Transparency

• Take some examples of observability interfaces

• Take some examples of controllability interfaces

• Approaches to improve SUT testability [Accessibility Identifiers, System Environment Variables, and Deployment Variables]

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 2 - Topic 2.1.2

Explain How Test Automation is Leveraged within Different Environments

-= === === === =-

What will you learn?

• Understand what is a test environment

• Introduction to test automation in different test environments

• Local development environment

• Build environment

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 2 - Topic 2.1.2

Explain How Test Automation is Leveraged within Different Environments

-= === === === =-

What will you learn?

• Integration environment

• Pre-production environment

• Production / Operational environment

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 2 - Topic 2.2.1

Analyze a System Under Test to Determine the Appropriate Test Automation Solution

-= === === === =-

What you will learn?

• Understanding the System Under Test : SUT

• Understanding different stakeholders' roles in SUT analysis

• Key considerations when analyzing the SUT to determine the Test Automation Solution : TAS

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 2 - Topic 2.2.2

Illustrate the Technical Findings of a Tool Evaluation

-= === === === =-

What will you learn?

• Understanding the workflow of the automation tool selection process

• Take a look at the decision / comparison table of the test automation tools

• Learn how to analyze requirements when evaluating and comparing tools

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.1

Explain the Major Capabilities in a Test Automation Architecture

-= === === === =-

What will you learn?

• Understand what is a gTAA : "Generic Test Automation Architecture"

• Understand the significance of gTAA

• Analyze the gTAA diagram

• Learn how the main components of the gTAA interact with each other: Test Automation Framework (TAF), Project Management, Test Management, Configuration Management, System Under Test (SUT)

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.2

Explain How to Design a Test Automation Solution or TAS

-= === === === =-

What will you learn?

• Quick revision on how to design a TAS : Test Automation Solution

• Understand the key considerations when designing a Test Automation Architecture

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.3

Apply Layering of Test Automation Frameworks

-= === === === =-

What will you learn?

• Revisit the concept of TAF: Test Automation Framework

• Quick overview of the TAF components

• Understand what TAF Layers are and their significance

• Explaining what are "Core Libraries", "Business Logics", and "Test Scripts"

• Take an example showing how code looks in these layers

• Understanding TAF Layering role when scaling test automation

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.4

Apply Different Approaches for Automating Test Cases

-= === === === =-

What will you learn?

• Capture / Playback automation approach

• Linear Scripting Approach

• Structured Scripting Approach

• Test-Driven Development (TDD)

• Data-Driven Testing (DDT)

• Keyword-Driven Testing (KDT)

• Behavior-Driven Development (BDD)

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.5

Apply Design Principles and Design Patterns in Test Automation | Part 1

-= === === === =-

What will you learn?

• Design Principles

• Object-Oriented Programming : OOP

• Major cornerstones of OOP: Encapsulation, Abstraction, Inheritance, and Polymorphism

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.5

Apply Design Principles and Design Patterns in Test Automation | Part 2

-= === === === =-

What will you learn?

• Design Principles

• SOLID Principle

• Single Responsibility Principle (SRP)

• Open-Closed Principle (OCP)

• Liskov Substitution Principle (LSP)

• Interface Segregation Principle (ISP)

• Dependency Inversion Principle (DIP)

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 3 - Topic 3.1.5

Apply Design Principles and Design Patterns in Test Automation | Part 3

-= === === === =-

What will you learn?

• Design Patterns

• The Facade Pattern

• Singleton Pattern

• Page Object Model : POM

• Flow Model Pattern

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 4 - Topic 4.1.1

Apply Guidelines that Support Effective Test Automation Pilot and Deployment Activities

-= === === === =-

What will you learn?

• Discuss the different approaches when automating a project

• Understand what a test pilot is in automation

• Understand the significance of an automation test pilot

• Look at the different phases (stages) of an automation test pilot

• Take some examples on how to apply the pilot project in test automation

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 4 - Topic 4.2.1

Analyze Deployment Risks and Plan Mitigation Strategies for Test Automation | Part 1

-= === === === =-

What will you learn?

• A quick revisit to test the automation pilot to understand the deployment-related risks

• Learn the classification of deployment risks

• Technical Deployment Risks ( Packaging - Logging - Test Structuring - Updating )

• Understand what packaging is, why it matters, and some examples of packaging-related risks

• Learn the different logging levels and their significance

• Take some examples of logging-related risks

• Understand the components of test structuring

• Understand the importance of test ficture

• Take some examples of test structuring-related risks

• Understand the risks related to updating

• see some of the suggested mitigation procedures

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 4 - Topic 4.2.1

Analyze Deployment Risks and Plan Mitigation Strategies for Test Automation | Part 2

-= === === === =-

What will you learn?

• Environment and Infrastructure Deployment Risks

• Firewalls and Port Opening

• Test Resource Utilization

• Network Connectivity

• Reliability

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 4 - Topic 4.1.3

Explain Which Factors Support and Affect Test Automation Solution Maintainability

-= === === === =-

What will you learn?

• The concept of test automation maintainability

• Clean Code

• Static Analysis

• Version Control

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 5- Topic 5.1.1

Apply Test Automation at Different Test Levels within Pipelines | Part 1

-= === === === =-

What will you learn?

• Understand what a pipeline is (in the context of software test automation)

• Know the different types of pipelines used in test automation

• Discuss how different test levels integrate into the pipeline

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 5- Topic 5.1.1

Apply Test Automation at Different Test Levels within Pipelines | Part 2

-= === === === =-

What will you learn?

• The fundamental phases of CI/CD pipelines: Build phase & Deployment phase

• Approaches for running Running System, System Integration & Acceptance Tests within pipelines

• Other Ways Pipelines Are Used for Test Automation

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 5- Topic 5.1.2

Explain Configuration Management for Testware

-= === === === =-

What will you learn?

• The role of configuration management in test automation

• The key components of configuration management

• Test Environment Configuration

• Test Data

• Test cases and test suites

• Managing Testware with Different Releases

• Feature Toggle Configuration

• Versioning Testware Alongside the Software

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 5- Topic 5.1.3

Explain test automation dependencies for an API infrastructure

-= === === === =-

What will you learn?

• Understand the dependencies required in automated API testing

• API connections and API documentation

• Shift-left approach and its relationship with component-integration and system-integration testing

• Microservices: Consumer microservices and Provider microservices

• Contract testing

• Consumer-Driven Contract Testing

• Provider-Driven Contract Testing

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 6 - Topic 6.1.1

Apply Data Collection Methods from the Test Automation Solution and the System Under Test

-= === === === =-

What will you learn?

• The importance of collecting automation results data

• From where can we collect test automation results data

• How to enhance the process of collecting data from test automation

• Features of a test automation tool that support data collection

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 6 - Topic 6.1.1

Apply Data Collection Methods from the Test Automation Solution and the System Under Test

-= === === === =-

What will you learn?

• Different sources of logs (TAS logs and SUT logs)

• The correlation and the sync process between TAS and SUT logs

• How to integrate collected logs with 3rd party tools (e.g., JIRA)

• Different ways of visualizing test automation results

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 6 - Topic 6.1.2

Analyze Data from the Test Automation Solution and the System Under Test to Better Understand Test Results

-= === === === =-

What will you learn?

• The importance of analyzing results from test automation

• Primary and secondary sources of failures in test automation

• Analysis of test environment data

• Checking past text execution results

• Using web logs or server logs in data analysis

• The 5-step process of diagnosing a failure in automated tests

• Tricky situations  when analyzing data from automated testing

• Using Audit Logs by imlementing Correlation IDs or Trace IDs

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 6 - Topic 6.1.3

Explain How a Test Progress Report is Constructed and Published

-= === === === =-

What will you learn?

• The significance of the automated testing progress report

• The items to be included in a test automation test progress report

• Different ways of publishing a test progress report

• Required customizations for a test progress report to be suitable for different dtakeholders

• Dashboards and modern tools in test progress reports

• Artifical Intelligence (AI) and Machine Learning (ML) in test progress reports

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 7 - Topic 7.1.1

Plan to verify the test automation environment, including test tool setup

-= === === === =-

What will you learn?

• The significance of verifying the automation test environment setup

• Verify Test Tool Installation, Setup, Configuration, and Customization

• Verify Repeatability in Setup/Teardown of the Test Environment

• Verify Connectivity with Internal and External Systems/Interfaces

• Verify the Components of the Test Automation Framework (TAF)

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 7 - Topic 7.1.2

Explain the correct behavior for a given automated test script and/or test suite

-= === === === =-

What will you learn?

• Check the composition / completeness of the automated test suite

• Verify new tests that focus on new features of the TAF

• Consider the reliability / repeatability of automation tests

• Consider the intrusiveness of automated test tools

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 7 - Topic 7.1.3

Identify Where Test Automation Produces Unexpected Results

-= === === === =-

What will you learn?

• Root-Cause Analysis [ RCA ]

• Different steps to conduct root cause analysis

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 7 - Topic 7.1.4

Explain How Static Analysis Can Aid Test Automation Code Quality

-= === === === =-

What will you learn?

• Explain code static analysis in test automation

• Identify types of defects and errors detected by static analysis

• The imporance of static analysis in test automation

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.1

Discover Opportunities for Improving Test Cases Through Data Collection and Analysis

-= === === === =-

What will you learn?

• The growing nature of automated test cases and automated test suites

• The consequences of improving our automated test cases within a project

• The different approaches to accomplish the test case improvement goal

• The nature of histograms, their capabilities, and their use cases

• Ways AI (Artifical Intelligence) can assist us in test automation

• AI and self-healing locators and how they can recognize changed UI locators

• The concept of schema validation, its use cases, and its benefits

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.2 (Part 1)

Analyze the Technical Aspects of a Deployed TAS and Provide Recommendations for Improvement

-= === === === =-

What will you learn?

• The key benefits of Test Automation Solution improvement

• The different aspects of a TAS where we can apply improvements

• Upgrading the scripting approach

• Consolidating automated test cases

• Different ways of establishing a recovery process

• Different wait approaches

• Improving automated test execution

• Verifying the test automation assertions

• TAA enhancements

• TAF / Tools upgrade

• Setup and Teardown optimization

• Documentation improvement

• Dealing with new TAS features

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.2 (Part 2)

Analyze the Technical Aspects of a Deployed TAS and Provide Recommendations for Improvement

-= === === === =-

What will you learn?

• The key benefits of Test Automation Solution improvement

• The different aspects of a TAS where we can apply improvements

• Upgrading the scripting approach

• Consolidating automated test cases

• Different ways of establishing a recovery process

• Different wait approaches

• Improving automated test execution

• Verifying the test automation assertions

• TAA enhancements

• TAF / Tools upgrade

• Setup and Teardown optimization

• Documentation improvement

• Dealing with new TAS features

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.2 (Part 3)

Analyze the Technical Aspects of a Deployed TAS and Provide Recommendations for Improvement

-= === === === =-

What will you learn?

• The key benefits of Test Automation Solution improvement

• The different aspects of a TAS where we can apply improvements

• Upgrading the scripting approach

• Consolidating automated test cases

• Different ways of establishing a recovery process

• Different wait approaches

• Improving automated test execution

• Verifying the test automation assertions

• TAA enhancements

• TAF / Tools upgrade

• Setup and Teardown optimization

• Documentation improvement

• Dealing with new TAS features

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.3

Restructure the Automated Testware to Align with System Under Test Updates

-= === === === =-

What will you learn?

• The significance of TAS upgrading to sync with new SUT versions

• The 5-step process to upgrade a TAS

ISTQB Certified Tester Advanced Level - Test Automation Engineering V2

ISTQB CTAL-TAE V 2.0

Chapter 8 - Topic 8.1.4

Summarize Opportunities for Use of Test Automation Tools

-= === === === =-

This is the last lecture of our ISTQB CT-TAE V2 ... Congratulations!