MITRE and Microsoft have added a data-driven generative AI focus to MITRE ATLAS.
The new framework update and associated new case studies dare pitched as directly addressing unique vulnerabilities of systems that incorporate generative AI and LLM like ChatGPT and Bard.
The updates to MITRE ATLAS – which stands for Adversarial Threat Landscape for Artificial-Intelligence Systems – are intended to realistically describe the rapidly increasing number and type of attack pathways in LLM-enabled systems that consumers and organizations are rapidly adopting.
Such characterizations of realistic AI-enabled system attack pathways can be used to strengthen defenses against malicious attacks across a variety of consequential applications of AI, including in healthcare, finance and transportation.
“Many are concerned about security of AI-enabled systems beyond cybersecurity alone, including large language models,” said Ozgur Eris, Managing Director of MITRE’s AI and Autonomy Innovation Center. “Our collaborative efforts with Microsoft and others are critical to advancing ATLAS as a resource for the nation.”
Ram Shankar Siva Kumar, Microsoft data cowboy, said:
“Microsoft and MITRE worked with the ATLAS community tolaunch the first version of the ATLAS framework for tabulating attacks on AI systems in 2020, and ever since, it has become the de facto Rosetta Stone for security professionals to make sense of this ever-shifting AI security space.
“The latest ATLAS evolution to include more LLM attacks and case studies underscores the framework’s incredible relevance and utility.”
Click below to share this article