Jeff's blog

The Model Context Protocol: extending LLMs with tools

Explains the Model Context Protocol and how tool access complements structured outputs for LLM-powered apps. Walks through building a simple FastMCP email server that can list messages and return content from a sample mailbox. Shows how to expose the server through a Cloudflare tunnel and connect it to OpenAI's remote MCP support so models can call the tools. Discusses security considerations and the flexibility MCP provides for richer, multi-step workflows.

Using the structured output feature of LLMs

Introduces the structured output feature for LLMs and how JSON schemas make it easier to pass model results into downstream systems. Builds a book recommendation demo with Pydantic models and the OpenAI Python SDK to enforce predictable responses. Expands to an Azure DevOps scenario that turns a user story into epics, features, and tasks, then creates the work items via the SDK. Shares practical lessons about validation, schema design, and chaining LLM outputs into existing workflows.