From code-generation assistants to autonomous development agents, AI systems are increasingly being embedded across the entire software lifecycle. As organizations integrate AI capabilities into development pipelines, new supply chain risks are emerging. Traditional software supply chain security focuses on dependencies such as open-source libraries and container images. Modern AI development adds layers of complexity. Many emerging risks first appear in developer communities, security forums, and open-source repositories. This article examines what developer ecosystem data reveals about emerging risks in the AI supply chain. The purpose is to highlight strategies to address such risks.
Why Developer Discussions Reveal More Than CVEs
Most traditional vulnerability tracking systems, such as CVEs and CVSSs, are designed to document only well-defined software flaws. Emerging AI-related risks do not always fit neatly into such frameworks. This is because developer discussions often reveal security issues well before they are formally documented. These conversations are occurring across forums, Git repositories, issue trackers, and community discussions. On these platforms, practitioners share challenges they encounter during real-world deployments, such as:
- Unsafe model loading practices
- Insecure prompt handling and prompt exposure
- Weak access controls on inference endpoints
- Data leakage through training pipelines
- Misconfigured AI orchestration frameworks
Many of these issues do not receive CVE identifiers because they are classified as design flaws and configuration risks rather than discrete vulnerabilities. However, they can significantly increase AI supply chain risk. Security teams should therefore look beyond vulnerability databases and monitor broader development ecosystems. AI-powered supply chain risk platforms can also help analyze code repositories, developer discussions, and dependency relationships to identify emerging supply chain risks earlier.
The Classic Problems That AI Makes Worse
Security teams should recognize that many of the security issues affecting AI systems are not entirely new. AI amplifies existing vulnerabilities in the software supply chain, especially when AI components are involved. For example, unsafe deserialization vulnerabilities have long existed in many widely used programming languages. In AI systems, these risks persist and can be more severe because model-loading mechanisms often rely on serialized objects that may contain executable code. Downloading these models from external sources without proper verification can introduce significant AI supply chain risk. Similarly, dependency sprawl, long a risk, is worsening in AI projects. For example, a typical AI application may rely on dozens of libraries across multiple ecosystems, including:
- Machine learning (ML) frameworks
- Data processing libraries
- Container environments
- Graphics processing unit (GPU) drivers
- Orchestration tools
Each additional dependency in the AI security supply chain introduces another potential attack vector. Therefore, without implementing robust AI supply chain risk-detection capabilities, organizations often struggle to identify vulnerable dependencies within these complex ecosystems.
Model Security: The Black Box Problem
One unique aspect of AI systems that security practitioners should always note is the opacity of ML models. Unlike traditional software components, these models often function as black boxes, with internal decision processes that are difficult to interpret. Their training pipelines can involve complex data transformations, further increasing this opacity. This lack of transparency creates several security challenges.
- Pre-trained models: Many organizations often download pretrained models from external repositories. Often, they do this without fully understanding how they were trained or modified.
- Model artifacts: Some model artifacts may include embedded instructions, serialized code objects, and hidden dependencies. These further increase supply chain security risks
- Inference pipelines: The existence of inference pipelines can expose sensitive data. This is particularly true if models are not properly sandboxed.
The issues above complicate AI supply chain risk management because most security teams cannot rely solely on traditional code analysis in AI environments. Therefore, organizations should deploy specialized security platforms capable of analyzing model artifacts and dependencies. An agentic AI supply chain risk platform can play a key role in automating the inspection of AI models, pipelines, and external integrations to identify hidden risks.
Why AIBOMs Need to Go Beyond Inventories
Software supply chain security has traditionally relied on Software Bills of Materials (SBOMs) to document dependencies across the operating environment. As AI systems become more prevalent, many organizations are adopting AI Bills of Materials (AIBOMs), an extension of the SBOM concept. However, simply listing components is insufficient because AI systems involve multiple layers of artifacts that extend beyond traditional software packages. These layers typically include:
- Training datasets
- Pretrained model checkpoints
- Prompt templates
- Inference pipelines
- External APIs
- Fine-tuning configurations
The challenge usually encountered when an AIBOM documents only basic software dependencies is that it will likely miss critical sources of AI supply chain risk. Therefore, effective AIBOMs should include the following key aspects:
- Model provenance and training sources
- Dataset lineage and licensing
- Prompt and instruction artifacts
- Runtime environment dependencies
- Third-party AI service integrations
By expanding the scope of AIBOMs, organizations will be able to significantly improve AI supply chain risk detection across their operating environments.
Building a Secure AI Development Practice From the Ground Up
While AI technologies will continue to reshape software development, they are also set to introduce new security challenges around the AI supply chain. Traditional frameworks often struggle with AI supply chain risk across models, datasets, and orchestration. Therefore, addressing AI supply chain risk requires a shift in how organizations approach secure development.
- AI components: Development teams should treat AI components as critical supply chain dependencies rather than experimental features. This will ensure the incorporation of robust security controls within the development environment.
- Security integration: Organizations should integrate AI security controls directly into development workflows. This helps to reduce the cost of correcting errors should they arise.
The following are key practices that can significantly strengthen AI supply chain risk management.
- Secure model acquisition: AI models should only be downloaded from trusted repositories to reduce the risk of threat propagation. Integrity verification mechanisms, such as cryptographic signatures, should be applied whenever possible to enhance security.
- Dependency visibility: Development teams should maintain a clear inventory of all AI dependencies across the organization. This should encompass frameworks, libraries, and any infrastructure components.
- Model isolation: AI models should be executed within sandboxed environments. This prevents unauthorized system access. This reduces the risks associated with system access, such as more attacks and information disclosure.
-
- Continuous monitoring: Organizations should deploy automated AI supply chain risk detection tools. These tools should be capable of analyzing AI pipelines and dependencies within the entire environment.
- Security-aware development culture: Developers should receive targeted training on AI-specific security risks. This training should cover critical aspects such as prompt injection, unsafe model loading, and data leakage. An organization can create an AI-powered supply chain risk platform for this purpose.
Ultimately, secure AI development requires the same discipline applied to traditional software supply chains. This should be augmented with specialized controls tailored to AI ecosystems, and, ideally, an AI-powered supply chain risk platform should be created.
Frequently Asked Questions (FAQs)
1. Why do fewer than 2% of AI security discussions link to a CVE ID?
Fewer than 2%1 of AI security discussions have a connection to a CVE ID because most AI security issues stem from configuration mistakes, unsafe development practices, and design weaknesses. They do not stem from clearly defined software vulnerabilities, as CVEs typically track specific code flaws. As a result, many AI-related risks remain undocumented despite posing significant security threats.
2. What are the most common software supply chain vulnerabilities in AI projects?
Common vulnerabilities include insecure dependency management, unsafe deserialization of model files, and vulnerable machine learning frameworks. They also include exposed inference APIs, misconfigured data pipelines, and, increasingly, integrations such as AI skills, connectors (MCPs), and plugins. These issues often arise when development teams integrate a variety of AI libraries and services without comprehensive security validation. This creates loopholes in the AI supply chain that attackers exploit.
3. How does unsafe deserialization create AI supply chain risk?
Many ML frameworks load models using serialized objects. These objects are typically considered unsafe because they may contain executable code. A common example is a Python pickle file, which is inherently unsafe when loaded from untrusted sources and can execute arbitrary code during deserialization. If attackers distribute malicious model files, loading them can execute unintended code in the development environment. This can create AI supply chain risk by enabling system compromise and unauthorized access to data across the operating environment.
4. What should an AIBOM include that current SBOMs typically don’t?
An effective AIBOM should include key features such as model provenance, training datasets, prompt artifacts, and model checkpoints. It should also include pipeline dependencies and external AI services. The major challenge is that current AIBOM implementations often focus only on software dependencies, so they fail to capture the broader ecosystem required to build and deploy AI systems.
5. How can development teams improve AI dependency security without slowing down delivery?
Development teams can improve AI dependency security in several ways without affecting delivery. These include automating dependency monitoring, implementing trusted model repositories, and integrating security scanning into CI/CD pipelines. They can also use policy-driven security tools to enforce policies. These practices allow organizations to maintain rapid development cycles while improving visibility into potential AI supply chain risks.
Conclusion
A growing body of developer discussions, security research, and incident reports indicates that many emerging threats are not captured by traditional vulnerability-tracking mechanisms. Understanding real risk signals is essential to effective AI supply chain risk management. Organizations that invest in proactive AI supply chain risk management gain greater visibility into their development ecosystems and reduce the likelihood of supply chain compromise. As AI adoption accelerates, the ability to detect and manage supply chain risk will become a critical component of modern cybersecurity strategy.
Useful References
- Maugeri, M., Castiglione, G., Raciti, M., & Bella, G. (2025). AI-related vulnerabilities within CVEs: Are we ready yet? A study of vulnerability disclosure in AI products. In Proceedings of the 2025 Workshop on Artificial Intelligence and Security (AISec ’25). Association for Computing Machinery. https://doi.org/10.1145/3733799.3762969
- Open Worldwide Application Security Project. (2023). Top 10 risks for large language model applications.
https://owasp.org/www-project-top-10-for-large-language-model-applications/ - National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0).
https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-1.pdf - Open Source Security Foundation. (2024). Securing the software supply chain.
https://openssf.org/projects/ - Google DeepMind. (2024). Frontier safety framework.
https://deepmind.google/blog/introducing-the-frontier-safety-framework/