💬 In plain words: Because Large Language Models (LLMs) generate probabilistic output, your test suite scores will bounce around slightly even if you haven't touched a single line of code. To find your noise floor , run your exact same test suite three times without making any changes. The mathematical spread between those three scores is your normal variance. If a score change happens inside that spread, it means nothing. ⚡ Key Points AI test scores vary naturally; a drop in your score is not always a bug. Without measuring your baseline variance (the noise floor), your test scores are uninterpretable. Your Continuous Integration (CI) gate threshold must be set just outside the observed spread. Always re-measure your noise floor when you add a significant chunk of new test cases to your suite.
Agentforce