Pete·Nov 10Don’t go chasing ranking factorsRanking factors are mechanisms, not objectives. Chasing them is a distractionA response icon2A response icon2
Pete·Oct 21Scrape for me but not for theeMeta wants the right to scrape your website, but doesn’t want you scraping theirs.
Pete·Oct 17Three ways to give your AI agent Google Search Console dataThree approaches for connecting your AI agent to Google Search Console, from ready made MCPs to your own database. For free… ish.A response icon2A response icon2
Pete·Oct 11Ruh-oh! Your site bombed in Google because one page was over 2MB100 pages went over 2MB in size and then caused >10% of the entire site to drop by 10% in valueA response icon2A response icon2
Pete·Oct 8Enshittification as a ServiceSatire about corporate AI obsession, pointless LLM integrations, promotions, vendor lock in and the model providers profiting from the…
Pete·Sep 30You can’t handle the crawl!By 2031 AI agents doing on demand fetches of your website could be anywhere up to 56 trillion live requests per year, 4x of legacy search…A response icon1A response icon1
InStackademicbyPete·Sep 21The bots did exactly what you askedTypos, wildcards, user agents and what the crawlers thought you told them to do… or didn’t!
InStackademicbyPete·Sep 18You can’t just invent a protocol, bruhJoin me as I continue down the rabbit hole of “weird stuff people put in a text file and pretend it’ll work”.
InStackademicbyPete·Sep 16Why you stalking my robots.txt file, bro?It’s OK if you have no idea what robots.txt is about because apparently neither do some of the largest sites out there.