From developer experience to agent experience
- Overview
- From developer experience to agent experience
- Anatomy and distribution of a product skill
- What the research says about product skills
- Problems with product skills
- The docs-first approach
- Making docs accessible to agents
- Roles for tech writers with product skills
- Mining users' AI chat sessions: gaps and forensics
- Reimagining the documentation experience
Lesson 2 of 10
Making content consumable by AI tools shifts the focus from developer experience (DX) to agent experience (AX). Developers increasingly use agentic coding tools such as Claude Code, Cursor, Windsurf, Replit, OpenAI Codex, Gemini CLI, and Antigravity. These tools run in the terminal or in an IDE pane, acting as intermediaries between the user and the documentation.
Before building a product skill, it helps to understand how existing documentation infrastructure already serves agents. Agents reach content through several mechanisms, each addressing a different technical challenge. A product skill is only worth publishing if it solves a problem other layers leave open, so this topic outlines those existing layers first.
MCP is the transport layer
The Model Context Protocol (MCP) connects agents to external systems, including documentation repositories. MCP has become the standard infrastructure for agentic retrieval.
Early MCP implementations often suffered from eager loading. In an eager loading configuration, tool definitions from every connected server load into context at session startup. Connecting several servers can consume thousands of tokens before the user enters a prompt. Exposing a full documentation corpus this way causes token bloat, which increases latency and cost while degrading the model’s reasoning.
Modern MCP implementations separate content storage from delivery to avoid this. Documentation servers provide search tools rather than full text dumps. Under this model, an agent submits a targeted query and retrieves only the relevant excerpts. Mintlify and Context7 both use this on-demand retrieval architecture across large library catalogs, and retrieval over MCP is now a standard method for factual API lookup. A product skill doesn’t replace this transport layer; at most, a skill advises the agent on when and how to query it.
Markdown and llms.txt solve format and navigation problems
Two more layers optimize how servers deliver documentation to agents: Markdown mirrors and navigation maps.
Per-page Markdown mirrors provide plain Markdown copies of documentation pages at dedicated URLs. For example, /guide/authentication might also resolve at /guide/authentication.md. Clean Markdown strips away navigation scripts and HTML styling, delivering identical technical content at a lower token cost. Many documentation platforms now generate these Markdown endpoints automatically. (In fact, if you add .md after any URL on this site, you’ll see the Markdown page equivalent. A Cloudflare worker handles this — it’s not part of the Jekyll build.)
The /llms.txt file serves as a structured index. The llms.txt proposal defines a Markdown file that provides concise background information and links to detailed Markdown files. Some sites also provide a /llms-full.txt file that concatenates the entire documentation site into a single file.
A 2,400-run benchmark by Mintlify evaluated four documentation delivery formats: HTML, plain Markdown, Markdown linking to /llms.txt, and Markdown with /llms.txt inlined. The findings showed several consistent patterns:
- Plain Markdown without a site map performed worse than HTML. Without an explicit list of pages, agents guessed URLs and hit 404 errors.
- Adding a link to
/llms.txtreduced 404 errors to near zero across all tested models, at minimal token cost. - Inlining the complete
/llms.txtcontent eliminated 404 errors but consumed unnecessary input tokens. - Concatenated files such as
/llms-full.txtshowed the same inefficiency as eager-loaded MCP, filling context with unused text.
Format and navigation, in other words, already have cheap solutions. The most effective approach combines clean Markdown endpoints with a compact index file, both of which involve configuration rather than original authoring. Making docs accessible to agents walks through that configuration, along with the other problems that keep agents from reading a page.
Too much context degrades performance
Supplying more documentation to a model doesn’t necessarily improve the output. Past a moderate threshold, additional context reduces task performance, because irrelevant detail dilutes the prompt, introduces conflicting instructions, and distracts the model from the objective.
Benchmark research on agent skills confirms this pattern. Flooding an agent with an exhaustive skill catalog degrades coding accuracy, while selecting a small set of task-relevant instructions raises benchmark pass rates. What the research says covers those numbers in detail. Curating the precise context an agent needs is known as context engineering, and a product skill is one tool for managing it.
Sponsored
What the existing layers don’t solve
Existing retrieval tools let agents discover pages, fetch Markdown text efficiently, and query for specific parameters. What they don’t provide is strategic judgment. Search tools return excerpts that match lexical or semantic keywords. When a user request could be served by two overlapping products, search retrieves excerpts from both. The agent then tends to pick one arbitrarily and proceed without weighing the trade-offs.
Each layer has a narrow function. The /llms.txt file handles site discovery, Markdown mirrors optimize text processing, and MCP servers handle factual retrieval. None of them decides which architectural pattern or which product a developer should choose.
Organizations generally try to close the strategic judgement gap in one of two ways:
- Publish a product skill. Teams create standalone instruction files that direct agents toward the appropriate product.
- Improve the core documentation. Teams publish explicit comparison guides and selection criteria in the documentation portal itself.
Human developers need the same comparative guidance that agents need, so documenting these product distinctions in the official documentation addresses both audiences at once. Documentation updates also reach every agent that fetches a URL, without requiring users to install a separate skill file. Before evaluating whether to write that guidance into core docs or into a product skill, the next three topics examine what a skill contains, what the benchmarks measure, and which operational problems persist.
Continue to the next topic: Anatomy and distribution of a product skill
About Tom Johnson
I'm an API technical writer based in the Seattle area. On this blog, I write about topics related to technical writing and communication — such as software documentation, API documentation, AI, information architecture, content strategy, writing processes, plain language, tech comm careers, and more. Check out my API documentation course if you're looking for more info about documenting APIs. Or see my posts on AI and AI course section for more on the latest in AI and tech comm.
If you're a technical writer and want to keep on top of the latest trends in the tech comm, be sure to subscribe to email updates below. You can also learn more about me or contact me. Finally, note that the opinions I express on my blog are my own points of view, not that of my employer.