Pillar and Portkey Join Forces to Enhance Security for AI Applications

We are excited to announce our strategic integration with Portkey, a partnership aimed at bolstering security for AI applications in production environments.

Portkey, a frontrunner in open-source AI gateways, handles billions of LLM tokens daily for AI teams worldwide. By offering support for over 200 LLMs through a unified API, Portkey is revolutionizing the management and deployment of AI applications.

Pillar is dedicated to helping innovative companies adopt AI securely and efficiently. Our advanced detection and evaluation models are continuously refined through real-world interaction analysis, having monitored over 1,700 AI chatbots and 300,000+ conversations across various languages and use cases.

‍

This integration seamlessly incorporates Pillar's low-latency, model-agnostic security layer into Portkey's guardrails platform. With minimal setup, teams can now implement enterprise-grade security measures for their GenAI applications, fortifying them against both existing and emerging AI-specific threats.

Key Features:

• Intelligent Runtime Protection: Leveraging threat intelligence, we detect and block adversarial attacks in real-time, safeguarding end-users, data integrity, and application performance.
• Holistic Threat Scanning: Our comprehensive approach scrutinizes all application components, including prompts, models, meta-prompts, tools, and outputs, for a wide array of potential threats.
• Advanced Data Protection: We identify over 40 distinct data types and categories, including sensitive information like PII and secrets, while also flagging toxic language and concealed unicode characters.
• Alignment with Industry Standards: Our risk detection protocols align with leading AI security frameworks, including the OWASP Top 10 for LLMs and MITRE ATLAS, ensuring comprehensive protection.

This partnership marks a significant step forward in securing the future of AI applications. By combining Portkey's expansive LLM support with Pillar's cutting-edge security features, we're setting a new standard for safe and efficient AI deployment.

3 steps to integrate:

• Add Pillar’s API key to Portkey
• Create Guardrail Checks by selecting the Pillar evaluators you want
• Set up actions on the Guardrails and then add the Guardrail to a request Config.

Portkey Documentation: 

https://docs.portkey.ai/docs/product/guardrails/list-of-guardrail-checks/pillar