CWE-1426: Improper Validation of Generative AI Output
3 CVEs have CWE-1426 as their primary weakness. 0 of them are in the CISA KEV catalog. The highest EPSS score among them is 0.434%.
The product invokes a generative AI/ML component whose behaviors and outputs cannot be directly controlled, but the product does not validate or insufficiently validates the outputs to ensure that they align with the intended security, content, or privacy policy.
Child of CWE-707: Improper Neutralization
Mitigations
- Architecture and Design: Since the output from a generative AI component (such as an LLM) cannot be trusted, ensure that it operates in an untrusted or non-privileged space.
- Operation: Use semantic comparators, which are mechanisms that provide semantic comparison to identify objects that might appear different but are semantically similar.
- Operation: Use components that operate externally to the system to monitor the output and act as a moderator. These components are called different terms, such as supervisors or guardrails.
- Build and Compilation: During model training, use an appropriate variety of good and bad examples to guide preferred outputs.
Observed examples
- CVE-2024-3402: Chain: GUI for ChatGPT API performs input validation but does not properly sanitize or validate model output data (CWE-1426), leading to XSS (CWE-79).
Get more CVE data from the API.
curl 'https://api.contrastcyber.com/cwe_lookup/CWE-1426'curl 'https://api.contrastcyber.com/cve_search?cwe_id=CWE-1426'
Sources
- Vulnerability data from the National Vulnerability Database (NIST) and the CVE Program. CVE records: Copyright © 1999-2026, The MITRE Corporation, used under the CVE Program Terms of Use. CVE® is a registered trademark of The MITRE Corporation.
- CWE definitions: Copyright © 2006-2026, The MITRE Corporation, used under the CWE Terms of Use. CWE is a trademark of The MITRE Corporation.
- EPSS scores by FIRST.org EPSS, used with attribution.
- KEV catalog and SSVC decisions by CISA.
- Advisory data from the GitHub Advisory Database through OSV.dev (CC BY 4.0).
- Exploit metadata from the Exploit Database (GPL-2.0-only, metadata only).
- Nuclei template names from nuclei-templates (MIT).