Lunary
Lunary is an AI developer platform designed to help AI teams manage, improve, and protect Large Language Model (LLM) chatbots. It offers features such as conversation and feedback tracking, analytics on costs and performance, debugging tools, and a prompt directory for versioning and team collaboration. Lunary supports integration with various LLMs and frameworks, including OpenAI and LangChain, and provides SDKs for Python and JavaScript. Guardrails to deflect malicious prompts and sensitive data leaks. Deploy in your VPC with Kubernetes or Docker. Allow your team to judge responses from your LLMs. Understand what languages your users are speaking. Experiment with prompts and LLM models. Search and filter anything in milliseconds. Receive notifications when agents are not performing as expected. Lunary's core platform is 100% open-source. Self-host or in the cloud, get started in minutes.
Learn more about Lunary
NVIDIA NeMo Guardrails
NVIDIA NeMo Guardrails is an open-source toolkit designed to enhance the safety, security, and compliance of large language model-based conversational applications. It enables developers to define, orchestrate, and enforce multiple AI guardrails, ensuring that generative AI interactions remain accurate, appropriate, and on-topic. The toolkit leverages Colang, a specialized language for designing flexible dialogue flows, and integrates seamlessly with popular AI development frameworks like LangChain and LlamaIndex. NeMo Guardrails offers features such as content safety, topic control, personal identifiable information detection, retrieval-augmented generation enforcement, and jailbreak prevention. Additionally, the recently introduced NeMo Guardrails microservice simplifies rail orchestration with API-based interaction and tools for enhanced guardrail management and maintenance.
Learn more about NVIDIA NeMo Guardrails
Amazon Bedrock
Amazon Bedrock is a fully managed service that simplifies building and scaling generative AI applications by providing access to a variety of high-performing foundation models (FMs) from leading AI companies such as AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon itself. Through a single API, developers can experiment with these models, customize them using techniques like fine-tuning and Retrieval Augmented Generation (RAG), and create agents that interact with enterprise systems and data sources. As a serverless platform, Amazon Bedrock eliminates the need for infrastructure management, allowing seamless integration of generative AI capabilities into applications with a focus on security, privacy, and responsible AI practices.
Learn more about Amazon Bedrock
Kosmoy
Kosmoy is an AI governance and management platform for enterprise AI in production. It connects four layers of control: inventory, monitoring, governance and action control. Register AI systems, models, agents and MCP servers with owners and risk assessments. Monitor usage, costs and behaviour across applications. Apply access controls, guardrails, routing and logging to LLM, MCP and agent-to-agent traffic through an AI Gateway. Use Action Capsule to isolate autonomous agent actions with runtime controls and a kill switch. Deploy in your own Kubernetes environment, in the cloud or on premises. Built for AI platform, security, risk and compliance teams that need shared operational evidence and control.
Learn more about Kosmoy