Generative AI and LLM technologies have shown great potential in recent years, and for this reason, an increasing number of applications are starting to integrate them for multiple purposes. These applications are becoming increasingly complex, adopting approaches that involve multiple specialized agents, each focused on one or more tasks, interacting with one another and using external tools to access information, perform operations, or carry out tasks that LLMs are not capable of handling directly (e.g., mathematical computations).

From an offensive perspective, things start to get interesting when these applications have access to databases, protected information, internal tools, or external resources.

https://security.humanativaspa.it/attacking-genai-applications-and-llms-sometimes-all-it-takes-is-to-ask-nicely/

Attacking GenAI applications and LLMs - Sometimes all it takes is to ask nicely! - hn security

Generative AI and LLM technologies have shown […]

^{Federico Dotta (HN SECURITY)}