Improving the Testing Process
Consider the following statements describing the importance of improving the test process:
I. Test process improvement is important because being focused only on the test process it can provide recommendations to improve the test process itself, but it can’t indicate or suggest improvement to areas of the development process
II. Test process improvement is important because it is much more effective than software process improvement to improve the quality of a software system
III. Test process improvement is important because several process improvement models (STEP, TPI Next, TMMi) have been developed over the years
IV. Test process improvement is important because every organization, regardless of the context, should always achieve the maximum level of maturity of testing described in the test improvement models such as TMMi
Which of the following answers is correct?
Number of correct responses: 1
K21 credit
Improving the Testing Process
Which of the following statements about the TMMi test process improvement model is true?
Number of correct responses: 1
K21 credit
Improving the Testing Process
Which of the following statements about the STEP test process improvement model is true?
Number of correct responses: 1
K21 credit
People Skills – Team Composition
Which of the following would you expect to be most likely an example of a demotivating factor for testers?
Number of correct responses: 2
K21 credit
People Skills – Team Composition
Which of the following would you expect to be most likely an example of a motivating factor for testers?
Number of correct responses: 1
K21 credit
You are not confident with the assessment of the risk level and you suspect that it will be possible to find high-priority bugs in low-risk areas.
Furthermore the period for test execution is very short. Your goal is to test all the product risks in a risk-based way, while assuring that each product risk gets at least some amount of testing.
Which of the following answers describes the best test execution schedule in this scenario?
Number of correct responses: 1
K32 credits
A chart showing the trend in the lag time from defect reporting to resolution during system testing is also available. The chart shows that the daily closure period is consistently and significantly above the rolling closure period for a long period of the system testing phase.
Almost all defects found during system testing have been related to the system as a whole, not related to single units or integrations issues. Almost all quality risks have been addressed during the unit and integration testing phase and no residual quality risks were present in the integrated system. This has been confirmed by exploratory testing sessions performed during system testing, targeted at finding defects in these quality risk areas.
Based on the given information only, which one of the following areas would you expect to be considered more in the retrospective meeting in order to be improved?
Number of correct responses: 1
K33 credits
Testing Process
Assume you are the Test Manager for a new software release of an e-commerce application.
The server farm consists of six servers providing different capabilities. Each capability is provided through a set of web services.
The requirements specification document contains several SLAs (Service Level Agreements) like the following:
SLA-001: 99.5 percent of all transactions shall have a response time less than five seconds under a load of up-to 5000 concurrent users
The main objective is to assure that all the SLAs specified in the requirements specification document will be met before system release. You decide to apply a risk-based testing strategy and an early risk analysis confirms that performance is high risk. You can count on a well-written requirements specification and on a model of the system behavior under various load levels produced by the system architect.
Which of the following test activities would you expect to be the less important ones to achieve the test objectives in this scenario?
Number of correct responses: 1
K43 credits
Testing Process
Consider an information system of a Pay-Tv company based on a SOA architecture.
The integrated system currently consists of three core systems:
- a CRM (Customer Relationship Management) system
- a BRM (Billing and Revenue Management) system
- a CAS (Conditional Access System) system
all of them communicating with SOA Middleware.
You have been asked to manage the testing activities for the integration of two additional off-the-shelf systems from two different vendors: a SMS (Short Message Service) server and an IVR (Interactive Voice Response) system.
Assume that there is a high likelihood that the two off-the-shelf systems will be low-quality and that you have a clear proof that the testing performed by the two vendors on their systems has been unsystematic and unprofessional. This obviously leads to higher quality risk for the overall integrated system.
You are the Test Manager of this project. Your main goal is to plan for testing activities to mitigate this risk.
Which of the following answers best describes the test activities (assuming it is possible to perform all of them) you should plan for?
Number of correct responses: 1
K43 credits
The following is the unique “critical” quality risk item that has been identified:
CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user
Test analysis for system testing has just begun and the following test conditions have been identified:
TC-SEL-2. Test the selection of the package sizes
TC-SEL-4. Test wrong numbers of bottles for an order
TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user
What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?
Number of correct responses: 1
K32 credits
Defect Management
Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects.
When a defect is found for investigation a defect report is created in “Opened” state that is the unique initial state. The defect report status has also a unique finale state that is the “Closed” state.
The following state transition diagram describes the states of this defect management process:
where only the initial (“Opened”) and final (“Closed”) states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named.
Which of the following assignments would you expect to best complete the defect management process?
Number of correct responses: 1
K32 credits
Defect Management
Consider a defect report and assume that a part of its lifecycle includes the following states:
New: Is the initial state
Working: Means that the developers are addressing the defect in order to produce a fix for the defect
Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers
Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect
Closed: is the final state
Which of the following answers represents an invalid sequence of states that can’t lead the bug report to the “Closed” state?
Number of correct responses: 1
K21 credit
Defect Management
Which of the following information would you expect to be the most useful to perform a defect clustering analysis?
Number of correct responses: 1
K21 credit
Defect Management
During the system testing phase a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a “new” state, indicating it needs to be investigated.
Which THREE of the following information items can’t yet be present in the incident report?
Number of correct responses: 3
K32 credits (2 credits out of 3 credits correct, 1 credit point)
Reviews
You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects.
You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project.
On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects).
Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?
Number of correct responses: 1
K43 credits
Test Tools and Automation
Assume you are a Test Manager involved in system testing of a CRM application for a Pay-TV company. Currently the application is able to support a proper number of users assuring the required responsiveness. Since the business is expected to grow, you have been asked to evaluate the ability of the application to grow to support more users while maintaining the same responsiveness.
Which of the following tools would you expect to be the most useful at performing this evaluation?
Number of correct responses: 1
K21 credit
Test Tools and Automation
After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project.
You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team.
In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures.
You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future.
Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?
Number of correct responses: 1
K21 credit
Test Tools and Automation
Assume you are the Test Manager in charge of independent testing for avionics applications.
You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):
- a BOOT-X CSCI that must be certified at level B of the DO-178B standard
- a DIAG-X CSCI that must be certified at level C of the DO-178B standard
- a DRIV-X CSCI that must be certified at level A of the DO-178B standard
These are three different software modules written in C language to run on a specific hardware platform.
You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.
Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).
The source code of the tool is available.
Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.
Which of the following are the three main concerns related to that open-source tool selection?
Number of correct responses: 3
K43 credits (2 credits out of 3 credits correct, 1 credit point)
Test Tools and Automation
In your organization the following tools of the same vendor are currently in use: a requirements management tool, a test management tool and a bug tracking tool.
You are the Test Manager.
You are currently evaluating a test automation tool of the same vendor (to complete the vendor's tool suite) against an interesting open-source test automation tool under the GNU GPL (General Public License).
There are no initial costs associated to that open-source tool.
Which of the following statements associated to the selection of the open-source tool is correct in this scenario?
Number of correct responses: 1
K21 credit
Test Tools and Automation
Assume you are managing a test automation project for a mission-critical system.
Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework.
Which of the following management issues associated to the development of this custom automation framework is least likely to manage?
Number of correct responses: 1
K21 credit
Which of the following should be considered the biggest risk to the schedule when trying to implement formal scripted test cases early in the SDLC for a system with a
large GUI front end? [2]
You are a new Test Manager on a maintenance release for an existing mature product that is expected to be retired in the not too distant
future. The previous release had utilized a performance regression test suite written in an in-house custom tool using the same
programming language as the product itself. This suite will most likely require tweaking to ensure it works with the new version of the
product. While there are several members in the performance testing team, the original author of the performance testing tool has moved on
to another company, and none of the remaining staff have a great deal of familiarity with the performance test scripts used to test this
product.
How would you recommend this scenario be addressed? [3]
Which of the following is a factor that is likely to increase the test estimate? [1]
You have been carefully monitoring the progress of testing for your project. You have been using the established traceability to verify that the requirements and test
conditions are being adequately addressed. The test team is proceeding well in their test case execution and you can see that you are achieving about 80% coverage of
the test conditions per the traceability mapping in your test management system. You have seen a number of defects being logged against test conditions that are failing,
but you do not see a mapping of the test cases to those conditions.
What is likely to be occurring in the testing area that is causing the traceability to break down? [2]
Mary is an external IT auditor. She is conducting a review of the system-level testing done by Greg's functional testing team.
Which of the following items from Mary's assessment summary should concern Greg the most? [2]
Test Management
In the test strategy document your organization declares:
- to adopt a V-model development lifecycle, with three formal levels of testing: unit, integration and system testing
- to use a blended risk-based and regression-averse testing strategy for each level of testing
The following is an excerpt of the “approach” section for the system test plan document of a new project:
“Testing will only use manual tests. Due to the short period of time for test execution, the following activities will be performed in parallel with test execution: Test planning, test analysis and test design.
Basic metrics will be taken for test effort (i.e. person-hours), test cases executed (passed/failed), and incidents (no more metrics, such as code coverage, will be collected).”
In the system test plan, no deviations from the test strategy are described.
Based only on the given information, which of the following statements is true?
Number of correct responses: 1
K43 credits
Test Management
The following chart plots the cumulative number of defects opened against the cumulative number of defects closed during system testing of a software product.
Which of the following statements is true?
Number of correct responses: 1
K21 credit
Test Management
In the next two months some new features will be constantly added to new releases of a project you are working on as Test Manager.
You have identified as one of the main project risks, that the requirements specification will still be incomplete when your team starts the test design and implementation phase.
Some requirements will most likely be completed too late to allow a proper test preparation.
You and your test team have already worked on several similar past projects in the same organization.
Which one of the following options would you expect to be the most effective at mitigating this risk?
Number of correct responses: 1
K43 credits
Test Management
Consider an agile team adopting Extreme Programming (XP) with five developers and one tester without any coding experience.
To which of the following activities would you expect the tester will contribute most?
Number of correct responses: 1
K21 credit
Test Management
Which one of the following metrics to be produced needs traceability between the test cases and each item in a proper test basis?
Number of correct responses: 1
K21 credit