Special Summer Sale Limited Time Flat 70% Discount offer - Ends in 0d 00h 00m 00s - Coupon code: 70spcl

ISTQB CT-AI Certified Tester AI Testing Exam Exam Practice Test

Page: 1 / 8
Total 80 questions

Certified Tester AI Testing Exam Questions and Answers

Question 1

Which of the following is a dataset issue that can be resolved using pre-processing?

Options:

A.

Insufficient data

B.

Invalid data

C.

Wanted outliers

D.

Numbers stored as strings

Question 2

Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?

SELECT ONE OPTION

Options:

A.

Evaluating the model

B.

Deploying the model

C.

Tuning the model

D.

Data testing

Question 3

A mobile app start-up company is implementing an AI-based chat assistant for e-commerce customers. In the process of planning the testing, the team realizes that the specifications are insufficient.

Which testing approach should be used to test this system?

Options:

A.

Exploratory testing

B.

Static analysis

C.

Equivalence partitioning

D.

State transition testing

Question 4

“BioSearch” is creating an Al model used for predicting cancer occurrence via examining X-Ray images. The accuracy of the model in isolation has been found to be good. However, the users of the model started complaining of the poor quality of results, especially inability to detect real cancer cases, when put to practice in the diagnosis lab, leading to stopping of the usage of the model.

A testing expert was called in to find the deficiencies in the test planning which led to the above scenario.

Which ONE of the following options would you expect to MOST likely be the reason to be discovered by the test expert?

SELECT ONE OPTION

Options:

A.

A lack of similarity between the training and testing data.

B.

The input data has not been tested for quality prior to use for testing.

C.

A lack of focus on choosing the right functional-performance metrics.

D.

A lack of focus on non-functional requirements testing.

Question 5

An e-commerce developer built an application for automatic classification of online products in order to allow customers to select products faster. The goal is to provide more relevant products to the user based on prior purchases.

Which of the following factors is necessary for a supervised machine learning algorithm to be successful?

Options:

A.

Labeling the data correctly

B.

Minimizing the amount of time spent training the algorithm

C.

Selecting the correct data pipeline for the ML training

D.

Grouping similar products together before feeding them into the algorithm

Question 6

A local business has a mail pickup/delivery robot for their office. The robot currently uses a track to move between pickup/drop off locations. When it arrives at a destination, the robot stops to allow a human to remove or deposit mail.

The office has decided to upgrade the robot to include AI capabilities that allow the robot to perform its duties without a track, without running into obstacles, and without human intervention.

The test team is creating a list of new and previously established test objectives and acceptance criteria to be used in the testing of the robot upgrade. Which of the following test objectives will test an AI quality characteristic for this system?

Options:

A.

The robot must evolve to optimize its routing

B.

The robot must recharge for no more than six hours a day

C.

The robot must record the time of each delivery which is compiled into a report

D.

The robot must complete 99.99% of its deliveries each day

Question 7

You have been developing test automation for an e-commerce system. One of the problems you are seeing is that object recognition in the GUI is having frequent failures. You have determined this is because the developers are changing the identifiers when they make code updates.

How could AI help make the automation more reliable?

Options:

A.

It could identify the objects multiple ways and then determine the most commonly used and stable identification for each object.

B.

It could modify the automation code to ignore unrecognizable objects to avoid failures.

C.

It could dynamically name the objects, altering the source code, so the object names will match the object names used in the automation.

D.

It could generate a model that will anticipate developer changes and pre-alter the test automation code accordingly.

Question 8

The stakeholders of a machine learning model have confirmed that they understand the objective and purpose of the model, and ensured that the proposed model aligns with their business priorities. They have also selected a framework and a machine learning model that they will be using.

What should be the next step to progress along the machine learning workflow?

Options:

A.

Tune the machine learning algorithm based on objectives and business priorities

B.

Prepare and pre-process the data that will be used to train and test the model

C.

Agree on defined acceptance criteria for the machine learning model

D.

Evaluate the selection of the framework and the model

Question 9

In a conference on artificial intelligence (Al), a speaker made the statement, "The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?

SELECT ONE OPTION

Options:

A.

This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.

B.

This statement is correct. In general, what is considered Al today may change over time.

C.

This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.

D.

This statement is correct. In general, today the term Al is utilized incorrectly.

Question 10

You are using a neural network to train a robot vacuum to navigate without bumping into objects. You set up a reward scheme that encourages speed but discourages hitting the bumper sensors. Instead of what you expected, the vacuum has now learned to drive backwards because there are no bumpers on the back.

This is an example of what type of behavior?

Options:

A.

Error-shortcircuiting

B.

Reward-hacking

C.

Transparency

D.

Interpretability

Question 11

There is a growing backlog of unresolved defects for your project. You know the developers have an ML model that they have created which has learned which developers work on which type of software and the speed with which they resolve issues. How could you use this model to help reduce the backlog and implement more efficient defect resolution?

Options:

A.

Use it to prioritize defects automatically based on the time expected for the fix to be made, the speed of the fix, and the likelihood of regressions.

B.

Use it to assign defects to the best developer to resolve the problem and to load balance the defect assignments among the developers.

C.

Use it to determine the root cause of each defect and develop a process improvement plan that can be implemented to remove the most common root causes.

D.

Use it to review the code and determine where more defects are likely to occur so that testing can be targeted to those areas.

Question 12

Which ONE of the following tests is MOST likely to describe a useful test to help detect different kinds of biases in ML pipeline?

SELECT ONE OPTION

Options:

A.

Testing the distribution shift in the training data for inappropriate bias.

B.

Test the model during model evaluation for data bias.

C.

Testing the data pipeline for any sources for algorithmic bias.

D.

Check the input test data for potential sample bias.

Question 13

Which ONE of the following options does NOT describe a challenge for acquiring test data in ML systems?

SELECT ONE OPTION

Options:

A.

Compliance needs require proper care to be taken of input personal data.

B.

Nature of data constantly changes with lime.

C.

Data for the use case is being generated at a fast pace.

D.

Test data being sourced from public sources.

Question 14

Which of the following is an example of overfitting?

Options:

A.

The model is not able to generalize to accommodate new types of data.

B.

The model is too simplistic for the data.

C.

The model is missing relationships between the inputs and outputs.

D.

The model discards data it considers to be noise or outliers.

Question 15

Which of the following is a technique used in machine learning?

Options:

A.

Decision trees

B.

Equivalence partitioning

C.

Boundary value analysis

D.

Decision tables

Question 16

Which ONE of the following options represents a technology MOST TYPICALLY used to implement Al?

SELECT ONE OPTION

Options:

A.

Search engines

B.

Procedural programming

C.

Case control structures

D.

Genetic algorithms

Question 17

Which ONE of the following activities is MOST relevant when addressing the scenario where you have more than the required amount of data available for the training?

SELECT ONE OPTION

Options:

A.

Feature selection

B.

Data sampling

C.

Data labeling

D.

Data augmentation

Question 18

A team of software testers is attempting to create an AI algorithm to assist in software testing. This particular team has gone through over 40 iterations of testing and cannot afford to spend as much time as it takes to run the full regression test suite. They are hoping to have the algorithm reduce the amount of testing required thus reducing the time needed for each testing cycle.

How can an AI-based tool be expected to assist in this reduction?

Options:

A.

By using a clustering method to quantify the relationships between test cases and then assigning each test case to a category

B.

By performing optimization of the data from past iterations to see where the most common defects occurred and select the corresponding test cases

C.

By performing bayesian analysis to estimate the types of human interactions that are expected to be seen in the system and then selecting those test cases

D.

By using A/B testing to compare the last update with the newest change and compare metrics between the two

Question 19

Written requirements are given in text documents, which ONE of the following options is the BEST way to generate test cases from these requirements?

SELECT ONE OPTION

Options:

A.

Natural language processing on textual requirements

B.

Analyzing source code for generating test cases

C.

Machine learning on logs of execution

D.

GUI analysis by computer vision

Question 20

A neural network has been designed and created to assist day-traders improve efficiency when buying and selling commodities in a rapidly changing market. Suppose the test team executes a test on the neural network where each neuron is examined. For this network the shortest path indicates a buy, and it will only occur when the one-day predicted value of the commodity is greater than the spot price by 0.75%. The neurons are stimulated by entering commodity prices and testers verify that they activate only when the future value exceeds the spot price by at least 0.75%.

Which of the following statements BEST explains the type of coverage being tested on the neural network?

Options:

A.

Threshold coverage

B.

Neuron coverage

C.

Sign-change coverage

D.

Value-change coverage

Question 21

Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values?

SELECT ONE OPTION

Options:

A.

Value coverage

B.

Threshold coverage

C.

Sign change coverage

D.

Neuron coverage

Question 22

Which of the following aspects is a challenge when handling test data for an AI-based system?

Options:

A.

Personal data or confidential data

B.

Output data or intermediate data

C.

Video frame speed or aspect ratio

D.

Data frameworks or machine learning frameworks

Question 23

A software component uses machine learning to recognize the digits from a scan of handwritten numbers. In the scenario above, which type of Machine Learning (ML) is this an example of?

SELECT ONE OPTION

Options:

A.

Reinforcement learning

B.

Regression

C.

Classification

D.

Clustering

Question 24

A tourist calls an airline to book a ticket and is connected with an automated system which is able to recognize speech, understand requests related to purchasing a ticket, and provide relevant travel options. When the tourist asks about the expected weather at the destination or potential impacts on operations because of the tight labor market the only response from the automated system is: "Idon't understand your question."

This AI system should be categorized as?

Options:

A.

General AI

B.

Narrow AI

C.

Super AI

D.

Conventional AI

Page: 1 / 8
Total 80 questions