Vellum

Prompting: Systematically iterate on prompts - Unified prompt management dashboard - Side-by-side model comparisons - Native support for tools, structured outputs, OpenAPI specs Workflows: The IDE for building steerable, agent-like systems. - Visual graph builder for orchestrating complex AI systems - Support for any model, custom code, and map/reduce functions - Built-in features like loops, parallelism, error handling Workflows SDK: A full-stack SDK + GUI for building AI apps with precision and flexibility. - Bi-directional sync between code and UI - Fine-grained control flow and global state management - Customizable with Docker and streaming support Evaluations: Test-driven development for AI. - Build scalable test suites via UI/API/CSV - Use pre-built or custom metrics for evaluation - Track quality, cost, latency, and regressions over time Retrieval: Powerful RAG infrastructure without the complexity. - Simple APIs for uploading and querying unstructured data - Tweak chunking, embeddings, and search for advanced use-cases - Supports various file types including tables and images Deployments: Update AI systems without redeploying your app. - One-click deploy across any model or provider - Staging environments for safe iteration - Scalable inference endpoints for production use Observability: Full visibility into AI system performance. - Audit logs, debugging tools, and feedback capture - Evaluation loops on live traffic - Dashboards to track cost, latency, errors, and trends