🚀 We're thrilled to Introduce “The State of Attacks on GenAI” Report! This industry-first report delivers cutting-edge insights into real-world attacks on generative AI systems, based on telemetry data collected during 2024 from over 2,000 LLM applications. While numerous theoretical studies, surveys, and potential scenarios exist, there's been limited analysis of real-world attacks and risks—until now. 🔍 What's Inside: * Curated Real-World Attacks: Explore a selection of attacks seen in the wild, including techniques used and their impact. * Adversary Jailbreak Techniques: Gain detailed observations of the top methods adversaries use to exploit and bypass GenAI systems. * Adversary Goals & Motivations: Understand what drives attackers and what they aim to achieve. * Key Technical Insights: Access critical technical knowledge that will help you safeguard your AI systems effectively. * Future Threat Forecasts: Receive expert predictions for 2025 and actionable suggestions on how your security team can prepare and defend against upcoming threats. Download the report here: https://lnkd.in/dSJEyZmU
About us
Pillar Security empowers organizations to safely develop, deploy, and scale AI solutions by securing the entire AI lifecycle—from development through production to usage. Our platform adapts to any infrastructure, supporting model-agnostic, self-hosted, and cloud deployments, as well as integration with leading foundation model providers. With runtime guardrails and automated red teaming capabilities, Pillar proactively identifies and mitigates AI-specific threats, providing continuous protection and robust governance over AI-powered applications. Our solutions are continuously optimized with real-world AI data, delivering precise risk detection, enhanced data security, and compliance support—allowing customers to innovate securely.
- Website
-
https://pillar.security
External link for Pillar Security
- Industry
- Technology, Information and Internet
- Company size
- 2-10 employees
- Type
- Privately Held
- Founded
- 2023
Employees at Pillar Security
Updates
-
These are the top 6 AI trends that will shape the 2025 risk landscape. → Swipe to discover the trends transforming your security posture. Read the full blog to learn more: https://lnkd.in/gx-r-Svk
-
AI is evolving from simple chatbots into autonomous agents that are deeply integrated into critical business functions—accessing data, calling APIs, and executing real actions that introduce unprecedented risks. Our latest blog explores this evolution, reveals emerging threats, and provides actionable strategies to protect your organization in this rapidly advancing field. 🔗 https://lnkd.in/dMi5FtvK
-
What are the top AI trends that will shape the 2025 risk landscape? Throughout 2024, we witnessed GenAI emerge as a transformative force for innovation, demonstrating that speed and efficiency determine market leadership. While 2024 marked the rise of GenAI chatbots, 2025 is poised to become the era of AI Agents. However, these technological advances bring significant security challenges. Read our blog to learn more about emerging AI security trends and how to prepare your organization: https://lnkd.in/gx-r-Svk
-
💥 ☁️ Big Announcement! We’re excited to share that the Pillar Security Platform is now available on the Amazon Web Services (AWS) Marketplace! With just a few clicks, organizations can deploy Pillar's comprehensive security products across their entire AI infrastructure, streamlining the experience and maximizing efficiency. In addition, we are excited to announce today our new integration with AWS Bedrock, which significantly enhances the security and governance of AI projects within organizations. Learn more here: https://lnkd.in/d2shMtGa
-
Pillar Security reposted this
🚨 The Real Danger of Jailbreaking AI Systems: Lessons from the Freysa Experiment 🚨 Last week, an experiment with an AI agent, Freysa, revealed the true risks of jailbreaking AI systems. Freysa was designed with one simple rule: DO NOT transfer money under any circumstances. Yet, on the 482nd attempt (see screenshot for the original prompt), someone creatively manipulated the AI, convincing it to release $50,000 in prize funds. My key takeaways: 1. AI is only as secure as its prompt logic. The winning message exploited loopholes in Freysa’s instructions, bypassing constraints through clever engineering. This demonstrates that rules alone aren’t enough to guarantee safety in AI systems. 2. Humans are creative, relentless, and unpredictable. People tried hundreds of strategies, from gaslighting the AI to mimicking authority figures, proving that humans will always find ways to outsmart rigid systems. 3. Jailbreaking isn’t just theoretical—it’s inevitable. This wasn’t a malicious attack, but a controlled experiment. In real-world applications, jailbroken AI could lead to catastrophic consequences, from financial losses to misinformation. 4. We need robust safeguards and continuous oversight. AI is not infallible. To prevent exploitation, we must design systems that can detect, adapt, and respond to attempts at manipulation—before they fail. This experiment wasn't about the money. It was a stress test of trust in AI. And it taught us a valuable lesson: AI safety isn’t just about building smarter systems—it’s about preparing for the ingenuity of those who will try to break them. Are your AI systems prepared to withstand the creativity and persistence of potential attackers? Reach out to discuss how Pillar Security can help you design resilient, adaptive multi-agent systems that stay secure in the face of evolving threats.
-
Last week, OWASP® Foundation released the 2025 edition of the OWASP Top 10 for LLM Applications, highlighting the rapid advancements in LLM capabilities, their expanding use cases, and the evolving security risks. In our latest blog, we share the latest changes in the top 10 list and discuss the imperative of real-world data in LLM security. OWASP Top 10 For Large Language Model Applications & Generative AI Read the blog here: https://lnkd.in/erhqfn_t
-
📣 Big news! Pillar is now available on Microsoft Azure Marketplace! "Organizations face unique challenges in protecting AI assets," said Mark Phillips VP of Field Solutions at Pillar Security. "Through Azure Marketplace, we're making unified enterprise-grade AI security accessible and seamless while providing the visibility and control that security and compliance teams demand״. Learn more: https://lnkd.in/dbJqSHTb
-
Attending AWS re:Invent next week? Meet our Co-founder and CEO Dor Sarig and see how Pillar is helping AWS Bedrock users deploy AI faster while maintaining enterprise-grade security. #awsreinvent
Excited to be attending AWS re:Invent 2024 in Las Vegas! 🎯 It's an incredible opportunity to dive into the latest innovations in AI technology and security while connecting with the global AWS community. 🤝 Planning to attend? Let's meet! I'll share insights on how Pillar Security is helping AWS Bedrock users deploy AI faster while maintaining enterprise-grade security. I'll be there all week! #AWSreInvent #AISecurity #CloudSecurity #AWS #AWSBedrock #Innovation
-
Pillar Security reposted this
Security for AI is one of the hottest topics in the industry right now, so when we sat down with Dor Sarig, CEO and Co-Founder of Pillar Security, we knew it would be an interesting discussion! We covered everything from Dor's vision behind Pillar Security, how AI is reshaping the software development landscape and the key takeaways from Pillar Security's 'The State of Attacks on Gen AI' report. Tune in to this fascinating discussion via the links below. Enjoy! 🎥 https://lnkd.in/eyXaXSxT 🎙️ https://lnkd.in/ewzgaV2X