CT-AI Practice Exam — Free ISTQB Certification Prep

Join Us Among the Stars

Sign Up & unlock 100% of Exam Questions

Log in / Sign up

No Strings Attached!

118Practice Questions

3Study Modes

Free

TopicSort

Question 1

Machine Learning (ML) – Overview

Which ONE of the following options BEST describes clustering?

A Clustering is classification of a continuous quantity.
B Clustering is done without prior knowledge of output classes.
C Clustering is supervised learning.
D Clustering requires you to know the classes.

Question 2

Methods and Techniques for the Testing of AI-Based Systems

Question 3

Introduction to AI

Question 4

Using AI for Testing

Question 5

Using AI for Testing

Question 6

Introduction to AI

Question 7

ML Functional Performance Metrics

Question 8

ML – Neural Networks and Testing

Question 9

ML Functional Performance Metrics

Question 10

Using AI for Testing

Question 11

Using AI for Testing

Question 12

Methods and Techniques for the Testing of AI-Based Systems

Question 13

Methods and Techniques for the Testing of AI-Based Systems

Question 14

Machine Learning (ML) – Overview

Question 15

Testing AI-Specific Quality Characteristics

Question 16

Introduction to AI

Question 17

Methods and Techniques for the Testing of AI-Based Systems

Question 18

Testing AI-Specific Quality Characteristics

Question 19

ML – Data

Question 20

Testing AI-Specific Quality Characteristics

Question 21

Introduction to AI

Question 22

Test Environments for AI-Based Systems

Question 23

Quality Characteristics for AI-Based Systems

Question 24

Testing AI-Specific Quality Characteristics

Question 25

Methods and Techniques for the Testing of AI-Based Systems

Page 1 of 5 • Questions 1-25 of 118

1 2 3 4 5

→

Know a question that should be here? Contribute to this exam

What requirements are given in text documents, which ONE of the following is the BEST way to generate test cases from these requirements?

A Natural language processing on textual requirements
B Analyzing source code for generating test cases
C GUI analysis using computer vision
D Machine learning on logs of execution

Which ONE of the following statements about the hardware used to implement ML systems is MOST likely to be correct?

A Specialist hardware is necessary for ML
B Less bits are required for hardware supporting ML
C Support for complex operations is required
D A higher clock speed is required

In which ONE of the following situations would an ML model be MOST effective at determining the criticality of new defects?

A A new application which is in the early stages of the first test cycle
B An old application with lots of defect records but a brand new development and test team
C An old application where defect records are linked to failed tests and production incidents
D An old application with few critical defect records and many non-critical defect records

Which ONE of the following would be the MOST effective input to an AI-based defect prediction tool?

A Developers associated with previous code changes
B Cyclomatic complexity
C Lines of code changed
D Commit size

Question 6

Introduction to AI

Question 7

ML Functional Performance Metrics

Question 8

ML – Neural Networks and Testing

Question 9

ML Functional Performance Metrics

Question 10

Using AI for Testing

Question 11

Using AI for Testing

Question 12

Methods and Techniques for the Testing of AI-Based Systems

Question 13

Methods and Techniques for the Testing of AI-Based Systems

Question 14

Machine Learning (ML) – Overview

Question 15

Testing AI-Specific Quality Characteristics

Question 16

Introduction to AI

Question 17

Methods and Techniques for the Testing of AI-Based Systems

Question 18

Testing AI-Specific Quality Characteristics

Question 19

ML – Data

Question 20

Testing AI-Specific Quality Characteristics

Question 21

Introduction to AI

Question 22

Test Environments for AI-Based Systems

Question 23

Quality Characteristics for AI-Based Systems

Question 24

Testing AI-Specific Quality Characteristics

Question 25

Methods and Techniques for the Testing of AI-Based Systems

Which ONE of the following options is a technology used to implement AI?

A Genetic algorithms
B Autonomy
C Classification
D Reinforcement learning

Which ONE of the below is MOST likely to indicate a problem with underfitting in an ML model?

A The model is vulnerable to adversarial attacks
B The model fails to generalize on new data
C The model uses a large amount of resources to make a prediction
D The model is inaccurate on data similar to the training data

Which ONE of the below is NOT an input to an activation function in a neural network?

A Bias
B Activation values from the previous layer
C Activation values from the current layer
D The weights assigned to the connections

A test engineer is planning the best functional performance metrics to evaluate an unsupervised learning model. The model groups data points based on their similarity. The test engineer wants to measure how similar the data points in each group actually are.
Which is the MOST likely metric they should use?

A ROC
B Intra-cluster
C AUC
D Recall

Which ONE of the following options for a test basis would give the LEAST coverage when using AI-based test generation?

A A test model describing the application functionality
B A list of possible web pages that comprise the application
C A pseudo-oracle
D An XML schema

Which ONE of the following would be the LEAST effective input to an AI-based test optimization process?

A Previously failing tests
B Defect reports
C Test environment downtime
D Source control data

You are a test manager planning testing for an invoice financing company. The company buys unpaid invoices from companies and provides them with immediate cash.
The company is replacing their existing conventional system, which takes company accounting records as inputs, with an ML system that classifies each invoice for sales as something that should, or should not be bought. Significant historical production data is available. It is important that invoices are not bought incorrectly.
Which ONE of the following test techniques would be MOST appropriate for you to plan for system testing?

A A/B testing
B Back-to-back testing
C Metamorphic testing
D Experience-based testing

Which ONE of the following statements is MOST true about black-box adversarial testing?

A The algorithm used for the model is known to the tester
B The approach relies on the transferability of the attacks
C The training data is manipulated
D Combinatorial testing techniques are used

You have been asked for your opinion on the ML approach to be used for a new age verification system. A training dataset is available with many pictures of faces and the subject's age.
When new users sign-up to a mobile app, they have to take a picture of their face. If the system believes they are under 18 years old it will ask them to provide a picture of their passport to prove their age.
Which ONE of the following approaches do you expect to be MOST likely to succeed?

A Unsupervised learning that identifies clusters in training data that relate to people’s ages.
B Supervised learning classification system that is re-trained based on new data, including whether they later provided ID that showed they were over 18.
C Supervised learning regression system that is re-trained based on new data, including whether they provided ID that showed their age.
D Reinforcement learning classification system with a reward function of correct behavior.

Which ONE of the following statements BEST describes a testing challenge that specifically applied to a self-learning system?

A When systems change themselves the results of previously passing tests may change
B It is necessary to test whether the system will relinquish control to a human at the right time
C External data sources might be required to ensure that the system is unbiased
D In can be difficult to explain the link between test inputs and outputs

Which ONE of the following statements about a system MOST describes an autonomous system?

A A loan approval system that can continue to process loan applications indefinitely, within a defined amount of aggregate credit, until an operator reduces the amount of aggregate credit available.
B A self-driving car that automatically stops the car if the driver is not responding to voice prompts, in order to ensure they are awake.
C A chatbot that learns the most effective responses to humans (in order to ensure the humans continue to converse) based on prior experiences.
D A fraud detection system that alerts operators when it sees a specific fraud risk associated with a transaction, in order to obtain human input to make a final decision.

A facial recognition system is being deployed at airports in order to scan passengers’ faces and compare them to a database of vaccinations, in order to identify unvaccinated passengers in a pandemic.
There are a number of components involved including cameras, a model to segment the image, and a model to identify the face and match it against a known photograph. It is important that there are few false negatives, and that passengers cannot subvert the system.
Which ONE of the following types of testing is the MOST appropriate options for the tests you would choose in system testing?

A Testing for concept drift
B Adversarial testing
C Testing for explainability
D Testing for transparency

Which ONE of the following requirements for an AI-based system is MOST likely to cause a challenge for testing?

A The system should be able to accept natural language input on a variety of topics and respond correctly
B The system should respond more quickly than the system it is replacing
C The system should be 100% accurate with no tolerance for failure
D The system should not require human intervention until a specific failure scenario is encountered

A data scientist is performing unsupervised learning on a set of financial records relating to previous loan applications, and trying to predict defaults on future loans. They are reporting poor functional performance because of data issues.
Which ONE of the below is LEAST likely to be a contributory factor?

A Missing records for some accounts
B Missing data relating to whether loans were previously granted and repaid
C Inconsistent pre-processing of some records
D Irrelevant data included in the account records

Which ONE of the following statements is true about dynamic testing for inappropriate bias?

A It can be necessary to obtain additional attributes about the data being processed
B Reviewing the source of the training data can reveal inappropriate bias
C Inappropriate bias only needs to be tested when protected characteristics such as race and gender are present in the inputs
D Testing should never be conducted in production

Which ONE of the following statements provides the BEST description of the AI effect?

A As AI systems improve, the likelihood of reaching the technological singularity increases.
B AI systems get better over time as they are exposed to more data.
C The systems used to play chess against human experts in the 1990’s are no longer considered AI.
D AI systems increasingly behave like humans.

Which ONE of the below statements BEST describes why test environments for autonomous systems might need to be different to other test environments?

A Tools may be required to simulate extreme scenarios
B Non-determinism may need to be introduced into the environment
C AI-specific hardware may be required
D Tools may be required to provide explanations of system behavior

Which of the below is NOT a characteristic that makes it difficult to use AI-based systems?

A Complexity
B Lack of standards
C Lack of robustness
D Lack of transparency

Which ONE of the following is a factor associated with the test data that can create challenges specific to testing AI-based systems?

A Obtaining data from public benchmark datasets
B Obtaining data that has not been pre-processed by the system under test.
C Manual creation of test data
D Obtaining appropriate data from users

Which ONE of the below statements BEST describes how combinatorial testing can be applied to AI-based systems?

A Each neuron can be treated as a parameter for pairwise tests
B Two variants of the system can be used and compared
C Inputs to the system and environment factors can be considered parameters for pairwise tests
D Combinatorial testing cannot yet be applied to AI

Join Us Among the Stars

CT-AIPreview

About the CT-AI Exam

Mode Selection

Question 1

Question 2

Question 3

Question 4

Question 5

Question 6

Question 7

Question 8

Question 9

Question 10

Question 11

Question 12

Question 13

Question 14

Question 15

Question 16

Question 17

Question 18

Question 19

Question 20

Question 21

Question 22

Question 23

Question 24

Question 25

Question 6

Question 7

Question 8

Question 9

Question 10

Question 11

Question 12

Question 13

Question 14

Question 15

Question 16

Question 17

Question 18

Question 19

Question 20

Question 21

Question 22

Question 23

Question 24

Question 25