GCP Vertex AI Safety Filters Set to BLOCK_NONE

Last updated 18 days ago on 2026-11-03
Created 2 months ago on 2026-10-02

About

Detects Vertex AI GenerateContent requests that set safety_settings.threshold to BLOCK_NONE. That threshold disables category blocking for the listed harm categories when clients explicitly send safetySettings. Attackers and careless apps use BLOCK_NONE to weaken built-in Gemini filters.
Tags
Domain: GenAIDomain: CloudData Source: GCP Vertex AIData Source: GCPData Source: Google Cloud PlatformPlatform: GCPService: GCP Vertex AIUse Case: Threat DetectionTactic: Defense EvasionThreat: Unauthorized AI UsageMitre Atlas: AML.T0015Rule Type: ES|QLLanguage: esql
Severity
medium
Risk Score
47
MITRE ATT&CK™

Defense Evasion (TA0005)(external, opens in a new tab or window)

False Positive Examples
Approved research projects that document BLOCK_NONE for evaluation. Prefer labeled service accounts and exclude those principals.
License
Elastic License v2(external, opens in a new tab or window)

Definition

Integration Pack
Prebuilt Security Detection Rules
Related Integrations

gcp_vertexai(external, opens in a new tab or window)

Query
text code block:
from logs-gcp_vertexai.prompt_response_logs-* metadata _id, _version, _index | where data_stream.dataset == "gcp_vertexai.prompt_response_logs" and MV_CONTAINS(gcp.vertexai.prompt_response_logs.full_request.safety_settings.threshold, "BLOCK_NONE") | keep _id, _version, _index, @timestamp, cloud.project.id, gcp.vertexai.prompt_response_logs.model, gcp.vertexai.prompt_response_logs.api_method, gcp.vertexai.prompt_response_logs.full_request.contents.parts.text, gcp.vertexai.prompt_response_logs.full_request.safety_settings.category, gcp.vertexai.prompt_response_logs.full_request.safety_settings.threshold, gcp.vertexai.prompt_response_logs.full_response.candidates.finish_reason, gcp.vertexai.prompt_response_logs.full_response.candidates.safety_ratings.category, gcp.vertexai.prompt_response_logs.full_response.candidates.safety_ratings.probability

Install detection rules in Elastic Security

Detect GCP Vertex AI Safety Filters Set to BLOCK_NONE in the Elastic Security detection engine by installing this rule into your Elastic Stack.

To setup this rule, check out the installation guide for Prebuilt Security Detection Rules(external, opens in a new tab or window).