Skip to content
Let’s say you’ve got an LLM running on Kubernetes. Pods are healthy, logs are clean, users are chatting. Everything looks fine. But here’s the thing: Kubernetes is great at scheduling workloads and keeping them isolated. It has no idea what those workloads do. And an LLM isn’t just compute, it’s a system that takes untrusted input and decides what to do with it. That’s a different threat model. An...
LLMs on Kubernetes Part 1: Understanding the threat model | Huntaegis