Silkpath

Crawl any website. Audit every page for SEO, AEO and GEO.

Connecting…

Made by Raj Meena

SEO, AEO and GEO audits

Silkpath: free SEO, AEO and GEO website crawler

Scan any domain. Get every page's HTML as a ZIP and a full technical SEO, AEO and GEO audit for each site.

Crawl Options
Asset Types to Include in the ZIP

About Silkpath

A free website crawler for SEO, AEO and GEO audits, created, designed and built by its founder, Raj Meena.

Only crawl or download sites you own or have permission to copy.

Questions and answers

What is Silkpath?

Silkpath is a free website crawler for SEO, AEO and GEO audits. Enter a website address and it visits every page, then reports technical problems page by page and lets you download the HTML of the whole site as a ZIP.

What does Silkpath check?

Status codes and redirects, indexability, canonicals, XML sitemaps, page titles, meta descriptions, headings, content and duplicates, internal and external links with broken links, images and alt text, structured data, Open Graph, hreflang, and AEO and GEO signals.

What are AEO and GEO?

AEO (answer engine optimization) makes pages easy for answer boxes and voice assistants to quote. GEO (generative engine optimization) makes sure AI tools such as ChatGPT, Perplexity, Gemini and AI Overviews can reach, read and cite a site. Silkpath checks AI crawler rules in robots.txt, llms.txt, entity schema, dates, citations and content that needs JavaScript.

Is Silkpath free?

Yes. The app is free to use. Crawling runs on a Silkpath crawler server, which can be hosted on a free plan.

Where is my crawl data stored?

In the shared cloud storage of the crawler, so every device shows the same History. Without cloud storage they stay in this browser. Deleted crawls wait 30 days in the Recycle Bin. Page files for the ZIP stay on the crawler server for 3 hours.

Who made Silkpath, and who is its founder?

Silkpath was created, designed and built by its founder, Raj Meena. His portfolio is at raj-meena.netlify.app and his LinkedIn profile is linked here.

What is a website crawler?

A website crawler is a program that follows the links of a site the way a search engine does, visits every page, and records what it finds: status codes, titles, headings, links, images and markup. Silkpath is a website crawler built for SEO, AEO and GEO audits.

What is llms.txt and does Silkpath check it?

llms.txt is a plain text file at the root of a website that lists the pages an AI tool should read first, with a short summary of the site. Silkpath checks whether a site has llms.txt and llms-full.txt, and whether robots.txt blocks AI crawlers such as GPTBot, ClaudeBot and PerplexityBot.

How do I audit a website for SEO, AEO and GEO with Silkpath?

Open Silkpath, enter the website address, and press the crawl button. When the crawl ends, open the report: the Overview shows a site health score, and each section (Crawl, On-Page, Links and Media, Markup, AI Search) lists the pages that fail a check. Export any section as PDF, Excel or CSV.

How is Silkpath different from Screaming Frog?

Silkpath runs in the browser and is free, with no install, and it includes AEO and GEO checks such as llms.txt, AI crawler access and FAQ schema. Screaming Frog is a mature desktop crawler with more settings and a paid licence for large crawls. Many people use both; Silkpath's counts are matched to Screaming Frog's for the shared checks.

Does Silkpath run JavaScript?

No. Silkpath reads each page's raw HTML, the way most crawlers and AI tools first see it. A site that builds its pages in the browser looks nearly empty, and Silkpath warns about it so you can check it with a rendering crawler.

This website needs JavaScript

Delete?

Share Link

Anyone with the link can download the file until it expires. The file is kept in cloud storage.

Auto Re-crawl

Cloud Storage Is Full

Silkpath User Guide Save or print (PDF)

↑ ↓ moveEnter goEsc close