Beyond the Buzzwords, with Katherine Munro

LLMs as Judges: Practical Problems and How to Avoid Them

Concrete advice for teams building LLM-powered evaluations

Sep 3 • 

Katherine Munro 👩‍💻

3

July 2025

Large Language Models as Classification Engines: Overkill, or Awesome?

Why it's an odd choice. Why you should try it anyway. And how to go about it.

Jul 11 • 

Katherine Munro 👩‍💻

2

April 2025

Using one LLM to Judge Another? Here’s Five Reasons You Shouldn’t

Concrete ‘gotchas’ for people building things with Gen AI.

Apr 25 • 

Katherine Munro 👩‍💻

February 2025

Steal My Idea: Evaluating LLM Systems with Production Data at Scale

A framework for fixing the gaps in your LLM-testing strategy

Feb 11 • 

Katherine Munro 👩‍💻

January 2025

How Big Tech Is Exploiting Content Creators, And (Trying To) Get Away With It

Diving into current courtroom dramas around AI, copyright, and the true meaning of “fair use.”

Jan 10 • 

Katherine Munro 👩‍💻

1

August 2024

No baseline? No benchmarks? No biggie! An experimental approach to agile chatbot development

Lessons learned bringing LLM-based products to production

Aug 23, 2024 • 

Katherine Munro 👩‍💻

2

1

July 2024

How to save the planet? Just add data, AI, and a little financial selfishness.

On gambling our future, changing mindsets with changing data, and a novel use of Large Language Models to understand causality.

Jul 22, 2024 • 

Katherine Munro 👩‍💻

1

June 2024

To hack a Large Language Model: Speak its style, but not its language.

On building better RAG systems, attacks in plain sight, and a secret Croatian translation project that practically predicted the tech we're using today.

Jun 28, 2024 • 

Katherine Munro 👩‍💻

If you're optimizing for data, you're already losing: Lessons from a Data & AI Conference

On strategy, trends, up-skilling your developers, and finding the next billion dollar business opportunity.

Jun 14, 2024 • 

Katherine Munro 👩‍💻

2

May 2024

Editor's Digest: The Modern Data Stack

A collection of useful resources on the MDS, and a sneak peak into the newest Handbook of Data Science and AI...

May 17, 2024 • 

Katherine Munro 👩‍💻

1

February 2024

Seven practical resources for building effective LLM applications

And one not at all practical, but totally awesome one.

Feb 23, 2024 • 

Katherine Munro 👩‍💻

Yes, you still need old-school NLP skills in "the age of ChatGPT"

Large Language Models have their strengths, but for many production problems, simpler techniques are faster, cheaper, and just as effective.

Feb 2, 2024 • 

Katherine Munro 👩‍💻

1

2