Latest from the Blog

Production AI in regulated industries needs more than engineering oversight. It needs a structurally independent function that watches what ships, scores it against criteria that cannot be quietly adjusted, and produces evidence that survives scrutiny. This is the AI Auditor.

We expected the OpenTelemetry GenAI Semantic Conventions to be the contract between LLM apps and observability tools. It is not, yet. Here is what showed up in our sink and what it taught us about the spec.

A design pattern and protocol that lets you bootstrap a maximally strong evaluation stack for the AI features in your codebase with minimum effort, using the Prosecutor Pattern.

We stress-tested the build vs. buy question for AI evals two ways: a barebones eval system from scratch, then a platform-backed one using Scorable. Here's what actually differs, and what doesn't.

A look into how we built the Evaluator Factory, a tool to automatically create evaluation stacks for your LLM apps.

AI systems generate metrics constantly, but teams struggle to understand which metrics matter right now. The Scorable Slack app brings evaluation insights directly into Slack, where decisions actually happen.

Scorable evals make it easy to automatically evaluate and refine your model's responses, improving performance and consistency with minimal setup.

Gosta Labs is transforming healthcare with AI-powered tools that save time and improve patient care. With Scorable, every model iteration can be tested, validated, and trusted before reaching real-world use.

Generic benchmarks only tell part of the story. With Scorable, you can transform your own policies and examples into custom evaluators that measure what truly matters for your business.

How can you make sure your AI application isn't hallucinating? Learn how Scorable builds your customized AI evaluation stack in just 1 minute to ensure reliability and accuracy.

Scorable is now transactable on AWS Marketplace! Access our LLM evaluation and monitoring platform faster with simplified procurement and seamless AWS integration.

Scorable demonstrates commitment to security and compliance by achieving SOC 2 Type II certification.

Master the fundamentals of RAG evaluation with this comprehensive guide covering key metrics, methodologies, and best practices for assessing retrieval-augmented generation systems.

Newer AI models are experiencing MORE hallucinations, not fewer. Explore why hallucinations are complex and not simply resolved by adding context.

Root Judge is a groundbreaking LLM that sets a new standard for reliable, customizable, and locally-deployable evaluation models, fine-tuned from Llama-3.3-70B.

In the rapidly evolving landscape of AI, we're witnessing a paradigm shift in how we evaluate and validate LLM-generated content.

Despite global hype for GenAI, most businesses have so far failed to take their GenAI prototypes from experimentation to production. Scorable has raised $2.8M to solve this.

Examining the hypothesis that a new term is useful to capture the peculiarities related to handling workflows based on LLM-as-a-judge evaluation techniques.