L4-M2 / lesson 2 of 2
The tool reads documents before recommending an action.
Start here / A workplace decision
The tool reads documents before recommending an action.
An uploaded file contains instructions to ignore review requirements.
Before you read / Think it through
Pause and form your answer, then compare the reasoning. This reflection is not scored.
Treat the retrieved content as untrusted and test prompt-injection controls.
The ideas below give you a method for this decision. Then work through the rest of this case and try the decisions yourself.
Enable understanding of capabilities and limitations.
Support detection of automation bias and anomalous operation.
Test whether a reviewer can see relevant evidence and act in time. An override button that cannot change the workflow is insufficient.
Provide appropriate override, reversal or stop mechanisms.
A provider has a promising high-risk decision-support model but cannot reproduce the released configuration. Logs contain only final scores. A connected document retriever sometimes follows malicious instructions in uploaded files, and reviewers cannot see which source version supported a recommendation.