LLM-Powered Test Infrastructure for Software Testing
A test team is reviewing screenshots of a mobile application's GUI together with textual defect reports to identify visual inconsistencies that the reports do not capture.
Which type of Generative AI model is MOST appropriate to help with this task?
ASymbolic AI, due to its rule-based system for mimicking human decision-making.
BClassical Machine Learning, as it excels at data-driven defect categorization.
CMultimodal LLMs, specifically those augmented with vision-language models.
DReasoning LLMs, given their emphasis on logical inference for complex problem-solving.
0
Community Discussion
No comments yet. Be the first to start the discussion!
That's the end of the preview
It's free
100% of the questions are free for all users. No strings attached.
Introduction to Generative AI for Software TestingPrompt Engineering for Effective Software TestingManaging Risks of Generative AI in Software TestingLLM-Powered Test Infrastructure for Software TestingDeploying and Integrating Generative AI in Test Organizations
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
0
Community Discussion
No comments yet. Be the first to start the discussion!
Save question
0
Community Discussion
No comments yet. Be the first to start the discussion!
Which TWO of the following capabilities are key strengths of Large Language Models (LLMs) when they are applied to software testing tasks?
Choose two
AAutomating the generation of synthetic test data to cover various combinations and boundary values.
BProviding real-time, autonomous execution of performance tests without human oversight.
CInterpreting complex requirements and suggesting test objectives based on user stories.
DIndependently designing and implementing test environments with zero human configuration.
EDeveloping new software features based on high-level user feedback.
A test team wants to leverage Generative AI and has two immediate needs:
Need 1 — Rapid, ad-hoc exploration: A new tester must quickly understand requirements and interactively generate simple, one-off test ideas.
Need 2 — Structured, repetitive automation: The team wants to integrate AI into its existing continuous integration (CI) pipeline to automatically generate comprehensive test data for daily regression runs.
Which statement BEST describes how AI chatbots and LLM-powered testing applications apply to these needs?
ABoth needs are best addressed by an AI chatbot.
BBoth needs are best addressed by an LLM-powered testing application.
CNeed 1 is best addressed by an AI chatbot, and Need 2 by an LLM-powered testing application.
DNeed 1 is best addressed by an LLM-powered testing application, and Need 2 by an AI chatbot.
A tester is preparing a prompt for an LLM to generate test cases. One section of the prompt states:
> “The generated test cases must be provided in a CSV file format, with columns for Test ID, Description, Preconditions, Test Steps, and Expected Result.”
In which component of the six-part prompt structure would this statement MOST LIKELY appear?
ARole
BConstraints
CInstruction
DOutput format
A test engineer is studying the six components of a structured prompt for Generative AI in software testing.
Which of the following statements incorrectly characterizes one of these components?
AThe Role component specifies the persona the Generative AI model should adopt, such as a tester or test automation engineer.
BThe Context component provides background information about the test object or specific functionality being tested to help the model determine test conditions.
CThe Instruction component outlines the specific task the Generative AI model is required to perform, including relevant requirements for the task.
DThe Constraints component is primarily used to specify the desired output format for the AI's response, such as a markdown table or Gherkin syntax.
A test lead needs an LLM to produce a comprehensive test-plan summary that requires iterative refinement and review. The task is complex and benefits from being divided into smaller, verifiable steps, where the output from one step informs the next.
Which core prompting technique is BEST suited to this scenario?
AFew-shot prompting
BMeta prompting
CPrompt chaining
DZero-shot prompting.
What is the key characteristic that differentiates a system prompt from a user prompt when interacting with an LLM?
AA system prompt changes dynamically with each user input, while a user prompt remains constant throughout the conversation.
BA system prompt contains specific questions or tasks from the user, while a user prompt defines the LLM's overall behavior.
CA system prompt is always visible and editable by the chatbot user, unlike the user prompt.
DA system prompt is usually set by the developer, while a user prompt is written by the end user.
You are a test analyst using Generative AI to support early test-analysis work for newly written user stories. Your objective is to ensure that the stories are clear, testable, and ready for test case design.
Which of the following sequences BEST shows how Generative AI can be used to improve test analysis through iterative review and refinement?
Initial Review: Ask the LLM to analyze the user stories and identify ambiguities, gaps, or testability issues.
Refinement Suggestions: Based on the identified issues, prompt the LLM to propose clearer or more testable rewordings.
Testability Check: Submit the revised user stories to the LLM for a final assessment of their clarity, completeness, and readiness for test case generation.
Risk-Based Prioritization: Use the LLM to assign risk levels to the conditions in the user stories and suggest testing priorities.
Direct Test Case Generation: Ask the LLM to produce full test cases based on the original user stories.
Ai, ii, and iii
Bii, iv, and v
Ciii, iv, and v
Di, ii, and iv
Which option BEST reflects the change in a tester’s responsibility after an organization adopts Generative AI for test activities?
AFocusing on the manual creation of test documentation.
BMaintaining test-specific prompt libraries and refining AI-generated output.
CDelegating all test design activities to the AI.
DManaging the overall organizational budget for AI tool procurement.
You lead a team that uses Generative AI to improve automated regression testing. You have found that adapting test scripts to minor UI or API changes is a recurring challenge, causing unnecessary failures and maintenance overhead. You want the LLM to proactively update test scripts to accommodate these modifications.
Which prompt improvement would BEST enable the LLM to support self-healing, adaptive tests?
AAdd an instruction for the LLM to generate detailed test reports with success metrics and key insights.
BSpecify a constraint that the LLM should prioritize test execution based on module criticality and historical defect rates.
CExpand the instruction to include analyzing code changes to identify high-risk areas for targeted regression testing.
DInclude a directive for the LLM to automatically analyze UI element changes and modify locators within test scripts to prevent failures.
You are a test manager facing an unexpected increase in high-priority defects that is affecting test progress in the current sprint. To regain control and return testing to plan, you intend to use a Generative AI model to reassess the test-execution schedule and optimize resource allocation. Your objective is to obtain both a revised schedule and clear rationale and actionable strategies for test control.
An initial AI prompt draft is as follows:
Role: Act as a test manager.
Context: Analyze the current test progress and defect reports from the sprint.
Instruction: Propose adjustments to the test execution schedule.
Input Data: <<<Current test progress report (daily burn-down chart, test execution rates), recent defect log (severity, priority), original sprint test plan >>>.
Constraints: The revised schedule must aim to complete critical features on time.
Output Format: A table outlining proposed schedule changes for each test phase or feature, including new estimated completion dates.
Which improvement would BEST strengthen the LLM's ability to deliver comprehensive, actionable insights for dynamic test control in this situation?
i. Adjust the Role to "Act as an expert in Agile test management with strong risk mitigation skills" to guide the LLM's persona.
ii. Expand the Instruction to include identifying the root causes of the delays and proposing specific strategies for reallocating test resources, along with alternative approaches.
iii. Extend the Input Data to include historical test data from previous sprints to enable long-term trend analysis, not just current sprint data.
iv. Modify the Constraints to limit proposed schedule adjustments to a maximum of two days, regardless of the identified impact or necessary changes.
v. Reconfigure the Output Format to present raw, unprocessed metrics and dashboards.
Ai and iii
Bii
Cii and iv
Di, iii, and v
You are completing a test-automation task that generates XML-based test conditions that must conform to a strict schema. To reduce errors and preserve formatting consistency, you choose to use a Generative AI model.
Which of the following is the BEST way to prompt the model so that it produces valid XML output across multiple iterations?
AProvide several examples of valid XML outputs and ask the model to continue the pattern.
BAsk the model to generate XML based on a description of the XML schema.
CInstruct the model to reason about XML generation before producing the output.
DChain two prompts: first to generate test ideas, then to convert them into XML.
Community Discussion