Some developers have been experimenting with bot-specific Markdown delivery as a way to reduce token usage for AI crawlers. Google Search Advocate John Mueller pushed back on the idea of serving raw Markdown files to LLM crawlers, raising technical concerns on Reddit and calling the concept “a stupid idea” on Bluesky. What’s Happening A developer […]
Information Retrieval Part 2: How To Get Into Model Training Data
There has never been a more important time in your career to spend time learning and understanding. Not because AI search differs drastically from traditional search. But because everyone else thinks it does. Every C-suite in the country is desperate to get this right. Decision-makers need to feel confident that you and I are the […]