QuestionQ148Verified/Solution DesignCopy linkReport a problemAsk AstroTutorSave questionIn the context of agent development, what does an “evaluation” mean?AThe resulted number of LLM calls done by an agent in one runBA set of instructions for deploying the agent to productionCA pair consisting of an input and an assertion made on the agent’s output to determine if the output meets the expected resultDA tool that allows the agent to access external data sourcesShow AnswerAnswerExplanationAn evaluation tests an agent’s behavior by running it on a specified input and checking its output against an assertion or expected result. Official OpenAI evaluation documentation describes evaluations as testing criteria combined with data used to assess model or agent outputs.Learn moreOpenAI API Reference: EvalsShow comments0Show commentsCommunity DiscussionNo comments yet. Be the first to start the discussion!
Community Discussion