llms.txt is a plain text file placed at yourdomain.com/llms.txt that gives AI tools such as ChatGPT, Claude and Gemini a short, organised summary of your website and links to your most important pages. It is free and quick to set up, so most Malaysian businesses can reasonably add one, but it is a small supporting step, not a replacement for clean site structure, fast pages, schema markup or a proper GEO strategy. No AI platform has confirmed that it affects visibility or ranking, so it matters most for sites with real documentation, product catalogues or service pages worth organising clearly.
A Simple Way to Think About It
The Directory Board at the Door
❌ Board Up, Aisles a Mess
A shop puts up a neat directory board at the entrance, but the aisles behind it are still cluttered and unlabeled. Visitors read the board, then get lost anyway.
✅ Board Up, Aisles Organised
A shop puts up the same board, and every aisle behind it is clearly labeled and easy to walk through. Visitors find what they need and remember the shop.
llms.txt is the directory board. What it points to, and how well organised your actual site is, matters far more, which is what the sections below cover.
What Is llms.txt, and Where Did It Come From?
Jeremy Howard of Answer.AI published the llms.txt proposal on 3 September 2024. The idea was to make complex, script-heavy or heavily-navigated websites easier for AI tools to process during inference, since these systems have limited space to read and interpret a page.
The format is deliberately simple. An H1 with your site or business name is required. You can add a short blockquote summary underneath it, plus H2 sections that link out to the pages worth prioritising, each with a one-line description. FastHTML uses the format in its own documentation, and Mintlify automatically generates llms.txt files for the documentation sites it hosts, which reflects the format’s original audience: technical, documentation-heavy content.
Why llms.txt Matters for AI Search, Including in Malaysia
AI platforms are becoming a measurable referral channel. Similarweb found that generative AI referral visits grew more than threefold globally between September 2024 and September 2025. That growth is why more Malaysian business owners are asking whether files like llms.txt are worth the effort.
Technical access is a real bottleneck too. Vercel found that 34.82% of ChatGPT fetches and 34.16% of Claude fetches reached missing pages, which shows how broken links and messy navigation limit what these tools can actually find on a site. Malaysia’s internet base is large enough that this matters locally: DataReportal’s Digital 2026 Malaysia report puts the country at 35.4 million internet users and 98% penetration, and Statcounter (May 2026) puts Google at roughly 93% of Malaysian search market share, which means AI-generated answers built on top of that search layer are reaching a growing share of local searchers.
An llms.txt file can give compatible AI tools a shorter, cleaner path to your most important content, which may help when a site’s navigation, scripts or page structure would otherwise slow that process down.
llms.txt vs Robots.txt vs Sitemap.xml
All three files sit in your site’s root directory, but they do different jobs. Robots.txt has guided search engine crawlers since 1994. Sitemap.xml lists every indexable page for search engines. llms.txt is the newest of the three, built to summarise a site for AI systems rather than to control crawler access.
| File | Purpose | Read By | Format |
|---|---|---|---|
| llms.txt | Summarises key content for AI systems | ChatGPT, Gemini, Claude, Perplexity | Markdown |
| robots.txt | Controls crawler access to pages | Googlebot, Bingbot, GPTBot | Plain text rules |
| sitemap.xml | Lists all indexable pages | Search engine crawlers | XML |
These three files work best as one AI visibility strategy rather than three separate checklists, alongside the wider technical and content work covered by a proper SEO service.
Does llms.txt Actually Work? The Honest Answer for Malaysian SMEs
llms.txt works best on documentation hubs, API references and knowledge bases, which is the use case Jeremy Howard originally designed it for. Its impact tends to be smaller on typical Malaysian SME sites, such as restaurant menus, clinic service pages or e-commerce catalogues, where there simply isn’t as much reference content to summarise.
OpenAI, Google and Anthropic have not confirmed that GPTBot, Google-Extended or ClaudeBot use llms.txt as a ranking or visibility signal. Search Engine Land also recommends it mainly for documentation and reference content rather than general commercial sites. That doesn’t make it useless: it’s free, usually takes under an hour to set up, and gives compatible AI crawlers a cleaner guide to your site. But most Malaysian SMEs will get more out of clean HTML, faster page speed, schema markup and a complete GEO strategy first.
How to Add an llms.txt File to Your Website
- List your most important pages: services, pricing, contact details and key blog content.
- Write an H1 with your business name, followed by a one-line blockquote summary.
- Add H2 sections with links to your key pages, each with a short description.
- Save the file as plain text named llms.txt.
- Upload it to your site’s root directory so it loads at yourdomain.com/llms.txt.
- Reference the file in robots.txt and test it in a browser to confirm it loads correctly.
WordPress site owners can upload llms.txt directly to the public_html folder via FTP, or use a plugin if server access is restricted. Update the file whenever services, pricing or key pages change.
How Newnormz Helps Malaysian Businesses Show Up in AI Search
Newnormz focuses on the bigger problem behind the llms.txt question: making a whole website legible to Google, ChatGPT, Gemini and every AI platform your customers already use. That includes auditing crawlability, schema markup and content structure, then layering on dedicated ChatGPT and Gemini optimisation so a business appears accurately across both AI tools and traditional Google search.
This is the same approach behind campaigns like the one for Times Parking, where six months of SEO work produced over 528,000 impressions and 416 ranking keywords, and Sunway Medispa, where six months brought a 700% increase in traffic and 70% more ranking keywords. Neither result came from a single file; both came from consistent technical and content work, paired where relevant with local SEO targeting for Malaysian search behaviour.
Why does my website rank on Google without an llms.txt file?
Because Google has never confirmed llms.txt as a ranking requirement. It’s an optional file that helps some AI tools read your content more efficiently, not a prerequisite for search visibility.
Which pages should go inside an llms.txt file?
Key service pages, product information, documentation and trusted resources, not a link to every page on the site. The point is a short, curated guide, not a second sitemap.
Can llms.txt replace my XML sitemap or robots.txt file?
No. Each file does a different job: sitemaps support indexing, robots.txt manages crawler access, and llms.txt provides a curated content summary for AI tools.
Is llms.txt worth adding for every Malaysian SME?
It’s worth adding when a site has substantial services, products or technical content worth organising clearly. For a small brochure site with a handful of pages, the hour is better spent elsewhere.
Will adding llms.txt make ChatGPT recommend my business?
No guarantee exists, since no platform has confirmed it as a visibility signal. Crawlable pages, clear service content, schema markup and credible business signals matter far more.
Not sure if llms.txt is worth your time?
Get a Priority List for AI Search, Not a Generic Checklist
Newnormz has run SEO campaigns across F&B, healthcare, ecommerce, and local services in Malaysia, backed by a performance guarantee of 70 percent of targeted keywords on Google’s first page.
30 minutes, no obligation, and you’ll know exactly where your AI visibility stands.
Bryan Tan is an SEO Specialist and CEO at Newnormz, helping hundreds of businesses achieve first-page rankings on Google. With a passion for driving organic growth, Bryan blends innovative strategies with hands-on experience to optimize websites for maximum visibility. Always at the forefront of the latest SEO insights and trends, he consistently adapts to the evolving digital landscape.
