Tools

CLI and library for evaluating and red-teaming LLM apps: compare prompts and model outputs in bulk, scan for security vulnerabilities and plug into CI/CD, with evals running locally. Now part of OpenAI and still open source under MIT.

Manage database schemas as code: declare the desired schema in SQL, HCL or your ORM and Atlas plans, lints and applies migrations, and can export existing databases as HCL, SQL or Mermaid ER diagrams. Supports PostgreSQL, MySQL and a dozen other databases.