# Silkpath

> Silkpath is a free web app for SEO, AEO and GEO audits, designed and built by Raj Meena. Enter a website address and it crawls every page, reports technical problems page by page, and lets you download the HTML of the whole site as a ZIP.

Silkpath runs in the browser at https://silkpath.netlify.app/. A separate Silkpath crawler server fetches the pages, so the browser never needs a CORS proxy.

## Pages

- [Features](https://silkpath.netlify.app/features/): every SEO, AEO and GEO check, section by section
- [User Guide](https://silkpath.netlify.app/user-guide/): how to audit a website step by step, and the two illustrated PDF parts
- [What is AEO](https://silkpath.netlify.app/what-is-aeo/): answer engine optimization explained, with a checklist
- [What is GEO](https://silkpath.netlify.app/what-is-geo/): generative engine optimization explained, with a checklist
- [AI Crawler Checker](https://silkpath.netlify.app/ai-crawler-checker/): GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google-Extended, with robots.txt examples
- [llms.txt Checker](https://silkpath.netlify.app/llms-txt-checker/): what llms.txt is, an example file and how Silkpath checks it
- [Silkpath vs Screaming Frog](https://silkpath.netlify.app/screaming-frog-alternative/): an honest comparison
- [FAQ](https://silkpath.netlify.app/faq/): questions and answers about Silkpath
- [About](https://silkpath.netlify.app/about/): Silkpath and its founder, Raj Meena
- [User Guide, Part 1 (PDF)](https://silkpath.netlify.app/guide-1-features.pdf): every feature, screen and button
- [User Guide, Part 2 (PDF)](https://silkpath.netlify.app/guide-2-data.pdf): every report section, column and filter

## What it checks

- Crawl: status codes, redirect chains and loops, indexability (noindex, X-Robots-Tag, canonicalised, blocked by robots.txt), canonicals, XML sitemaps including sitemap indexes and gzipped sitemaps
- On-page: page titles and estimated pixel width, meta descriptions, H1 and H2 headings, word count, exact and near duplicates
- Links and media: every internal and external link with its source page and anchor text, broken links, orphan pages, images and alt text, CSS and JavaScript files
- Markup: JSON-LD, Microdata and RDFa schema types with validation errors, Open Graph and X (Twitter) cards, hreflang
- AEO: FAQ and HowTo schema, question-style headings, a direct answer in the first paragraph, author bylines
- GEO: AI crawler rules in robots.txt (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and others), a firewall test for AI user agents, llms.txt, Organization schema with sameAs, dates, citations and statistics, and content that only appears with JavaScript
- Custom extraction with CSS selectors or regular expressions, and custom search (text or regex, contains or missing)
- Security checks (HTTPS, mixed content, security headers, unsafe links), mobile viewport check, and URL, title, heading and robots-directive checks

## Output

- A site health score and per-section issue lists, each URL counted once per severity
- Export of any report section, or the whole report, as PDF, Excel or CSV, and a ZIP of every page's HTML, optionally with the site's CSS, JavaScript, images, fonts and media (up to 499 MB per crawl) and links rewritten for offline browsing
- Crawl history saved in the user's own browser
- PageSpeed Insights scores with real-visitor Core Web Vitals, Google Safe Browsing, and an AI visibility check that asks Gemini (with Google Search) whether the site is cited

## Facts

- Name: Silkpath (also written Silkpath SEO crawler, Silkpath website crawler)
- Category: SEO, AEO and GEO website crawler and audit tool
- Founder and creator: Raj Meena
- Founder's portfolio page about Silkpath: https://raj-meena.netlify.app/silkpath.html
- More keywords: Raj Meena SEO tools, Silkpath AEO, Silkpath GEO, Screaming Frog alternative, AI crawler checker, GPTBot checker, XML sitemap checker, canonical checker, hreflang checker, FAQ schema checker, JSON-LD validator, Core Web Vitals check, link graph, orphan pages finder, redirect chain checker, site health score, AI Overviews optimization
- Keywords: free SEO crawler, website crawler, SEO audit, AEO, answer engine optimization, GEO, generative engine optimization, AI search optimization, llms.txt checker, schema validator, broken link checker, technical SEO
- Price: free
- Author: Raj Meena⁠​‌‌‌​​‌‌​‌‌​‌​​‌​‌‌​‌‌​​​‌‌​‌​‌‌​‌‌‌​​​​​‌‌​​​​‌​‌‌‌​‌​​​‌‌​‌​​​​​‌‌‌​‌​​‌‌‌​​‌​​‌‌​​​​‌​‌‌​‌​‌​​​‌​​​​​​‌‌​‌‌​‌​‌‌​​‌​‌​‌‌​​‌​‌​‌‌​‌‌‌​​‌‌​​​​‌⁠
- Portfolio: https://raj-meena.netlify.app/
- LinkedIn: https://www.linkedin.com/in/rajmeena/
- Website: https://silkpath.netlify.app/