Shopify's LLM Doc Bot: Guesswork Over Facts?

Shopify's LLM-powered developer documentation bot provided an incorrect Liquid syntax for detecting Shopify Collective items in order confirmation emails. While the bot provided a quick answer, the code didn't work in practice because the Shopify Collective tag is added after the email is generated. The author questions the value of this 'guessing' doc bot, arguing that the cost of bad advice far outweighs the benefit of quick help. He suggests relying on official documentation instead of a potentially inaccurate bot.