Tool test results

Findings from tool tests on real and synthetic data

Testing an AI-embedded browser for research uses, a 4-month roadmap to adopt AI meaningfully, and more...

Testing an AI-embedded browser for research uses, a 4-month roadmap to adopt AI meaningfully, and more...

The September 2025 Edition

Sep 30, 2025

•

10 min read

The GPT-5 Issue | What’s better, what’s not, what to do with Agent Mode + a study on context windows.

The GPT-5 Issue | What’s better, what’s not, what to do with Agent Mode + a study on context windows.

The August 2025 Edition

Aug 29, 2025

•

8 min read

Transcription evaluations head-to-head, and NotebookLM's "hidden" transcripts - are they any good? Plus a speedy test protocol...

Transcription evaluations head-to-head, and NotebookLM's "hidden" transcripts - are they any good? Plus a speedy test protocol...

The July 2025 Edition

Jul 31, 2025

•

6 min read

A Claude 4 vs 3.7 reasoning test, new Claude system prompts, and "MCP" explained...

A Claude 4 vs 3.7 reasoning test, new Claude system prompts, and "MCP" explained...

The May 2025 Edition

May 31, 2025

•

10 min read

My new favorite LLM for customer research, what we can use AI benchmark tests for, and scientists may have found the most efficient way to prompt...

My new favorite LLM for customer research, what we can use AI benchmark tests for, and scientists may have found the most efficient way to prompt...

The April 2025 Edition

Apr 30, 2025

•

12 min read

The results are in: I ran a study with AI Moderators and 70+ real participants. This is what I found -

The results are in: I ran a study with AI Moderators and 70+ real participants. This is what I found -

The December 2024 Edition

Dec 19, 2024

•

16 min read