Notes & Thoughts
September 15, 2026
Currently thinking a lot about evaluator-first architectures. If we can't deterministically evaluate a pipeline in CI/CD, we have no business shipping it to production. The next phase of AI engineering is entirely about writing better programmatic judges, not just better prompts.
def evaluate_provenance(claim: str, context: str) -> bool:
"""Deterministic check before LLM evaluation."""
if not is_substring_fuzzy(claim, context):
raise HallucinationError("Claim not found in context")
return TrueAugust 20, 2026
Just finished re-reading The Master Switch. It's fascinating how the current AI landscape mirrors the early days of radio and telecom. The centralizing forces are identical.
July 10, 2026
Open source contribution merged into Ragas today. Fixing metric integrity bugs is unglamorous work, but it's the only way we build trust in these systems.