AWS Bedrock Detected Multiple Validation Exception Errors by a Single User

Last updated 14 days ago on 2024-11-07
Created 2 months ago on 2024-09-11

About

Identifies multiple validation exeception errors within AWS Bedrock. Validation errors occur when you run the InvokeModel or InvokeModelWithResponseStream APIs on a foundation model that uses an incorrect inference parameter or corresponding value. These errors also occur when you use an inference parameter for one model with a model that doesn't have the same API parameter. This could indicate attempts to bypass limitations of other approved models, or to force an impact on the environment by incurring exhorbitant costs.
Tags
Domain: LLMData Source: AWSData Source: AWS BedrockData Source: AWS S3Use Case: Policy ViolationMitre Atlas: T0015Mitre Atlas: T0034Mitre Atlas: T0046
Severity
high
Risk Score
73
False Positive Examples
Legitimate misunderstanding by users on accessing the bedrock models.
License
Elastic License v2(opens in a new tab or window)

Definition

Integration Pack
Prebuilt Security Detection Rules
Related Integrations

aws_bedrock(opens in a new tab or window)

Query
from logs-aws_bedrock.invocation-*
// truncate the timestamp to a 1-minute window
| eval target_time_window = DATE_TRUNC(1 minutes, @timestamp)
| where gen_ai.response.error_code == "ValidationException"
| keep user.id, gen_ai.request.model.id, cloud.account.id, gen_ai.response.error_code, target_time_window
// count the number of users causing validation errors within a 1 minute window
| stats total_denials = count(*) by target_time_window, user.id, cloud.account.id
| where total_denials > 3

Install detection rules in Elastic Security

Detect AWS Bedrock Detected Multiple Validation Exception Errors by a Single User in the Elastic Security detection engine by installing this rule into your Elastic Stack.

To setup this rule, check out the installation guide for Prebuilt Security Detection Rules(opens in a new tab or window).