Silkpath features: every SEO, AEO and GEO check
Silkpath is a free website crawler that visits every page of a site and checks it for technical SEO, AEO (answer engine optimization) and GEO (generative engine optimization). It reports status codes, indexability, titles, headings, links, images, structured data, AI crawler access and llms.txt, page by page, with a site health score and PDF, Excel and CSV exports.
How a Silkpath audit works
- Enter a website address on the home screen and press Start Crawl. You can queue several domains at once.
- The Silkpath crawler server follows every link from the home page and the XML sitemap, the way a search engine does, and reads each page's HTML. It respects robots.txt unless you turn that off.
- When the crawl ends, the report opens with a site health score out of 100 and a list of every issue, each URL counted once per severity.
- Every section has filters for its problems, so one click lists the pages that fail a check. Export any section, or the whole report, as PDF, Excel or CSV.
The report, tab by tab
Summary
- Overview: the health score, totals, the pages with the most problems and the response time of the site.
- All Issues: every problem found, with its severity, how many pages it affects and whether it is site-wide.
Crawl
- All URLs and Status Codes: 2xx, 3xx, 4xx and 5xx responses, redirect chains and loops, content type of every address, response time.
- Security: HTTPS, mixed content, security headers, unsafe target="_blank" links and forms on HTTP pages.
- Indexability: noindex, X-Robots-Tag, pages blocked by robots.txt, canonicalised pages and pagination.
- Canonicals: missing, self-referencing, pointing elsewhere, pointing to a noindex page or to an error.
- XML Sitemaps: sitemap indexes and gzipped sitemaps, pages missing from the sitemap and sitemap pages that are not indexable.
- PageSpeed (optional): PageSpeed Insights scores with real-visitor Core Web Vitals from the Chrome UX Report, and a Google Safe Browsing check.
On-page
- Page Titles and Meta Descriptions: missing, duplicate, too long or too short, with the estimated pixel width Google uses.
- Headings: missing, duplicate or multiple H1, H1 out of sequence, missing and multiple H2.
- Content: word count, thin content, readability, exact and near duplicates among indexable pages.
- Mobile and Accessibility: the viewport tag and zoom settings, the page language, form fields without a label, buttons and links without a name, and duplicate IDs.
Links and media
- Internal Links, All Links and External Links: every link with its source page and anchor text, broken and blocked links, orphan pages, nofollow links.
- Images and JS and Resources: broken images, large images, missing alt text, every CSS and JavaScript file.
- Link Graph: an interactive map of how pages link to each other, with each issue lit up on the map.
Markup
- Structured Data: JSON-LD, Microdata and RDFa schema types, with validation errors.
- Open Graph and Twitter: the cards a page shows when it is shared.
- hreflang: language and region alternates, missing return links and bad codes.
AI search
- AEO: FAQ and HowTo schema, question-style headings, a direct answer in the first paragraph, author bylines. See What is AEO.
- GEO: AI crawler rules in robots.txt, a firewall test with AI user agents, llms.txt and llms-full.txt, Organization schema with sameAs, dates, citations and statistics, and content that only appears with JavaScript. See What is GEO and the AI crawler checker.
- AI Visibility: asks Gemini, grounded in Google Search, whether the site is cited for the questions it should answer.
Crawl log and compare
- Custom Extraction and Custom Search: pull any value with a CSS selector or a regular expression, or list the pages that contain, or are missing, a text.
- Crawl Log: what the crawler did, including refused pages and why.
- Compare Crawl: two crawls of the same site side by side: new, fixed and changed issues and URLs.
Beyond the report
| Feature | What it does |
|---|---|
| Exports | PDF, Excel or CSV of one section, one tab or the whole report. |
| Website download | A ZIP of every page's HTML, optionally with the site's CSS, JavaScript, images, fonts and media (up to 499 MB per crawl) and links rewritten for offline browsing. |
| Share links | Share a PDF, Excel or CSV file through a link. |
| Crawl history | Every crawl is saved, in shared cloud storage or in the browser, and can be opened, rescanned or compared. |
| Scheduled and auto re-crawls | Crawl a site once at a set time, or re-crawl a report by itself every few days (you choose from 1 to 365). |
| Recycle Bin | Deleted crawls wait 30 days before they are erased. |
| Crawl limits | Pages per domain, depth, parallel requests, delay, timeouts and page size. |
| Installable app | Install Silkpath on a computer or phone, with its own window and icon. It opens fast, even offline. |
| Notifications | A notification when a crawl you started ends, even with Silkpath closed: "Crawl finished: example.com, 1,240 pages". Tap it to open the report. |
| Crawls survive restarts | Progress is saved while a crawl runs, so a server restart does not lose it: the crawl carries on by itself. |
| Quick Find and User Guide | Jump to any feature or button, and read a two-part illustrated User Guide. |
Raw HTML, not rendered. Silkpath reads each page's HTML the way most crawlers and AI tools first see it. A site that builds its pages with JavaScript looks nearly empty, and Silkpath warns about it.
Questions and answers
How many pages can Silkpath crawl?
As many as the site has, up to 50,000 URLs per crawl by default. You can set a lower limit per domain in the crawl options.
Does Silkpath respect robots.txt?
Yes, by default. The "Respect robots.txt" option is on for every crawl and can be turned off for a site you own.
Which export formats does Silkpath have?
PDF, Excel (XLSX) and CSV for any section or the whole report, and a ZIP of the site's HTML and assets.
Audit a website with Silkpath
Enter a website address and Silkpath crawls every page, then reports SEO, AEO and GEO problems page by page, with PDF, Excel and CSV exports.
Read next
What is AEO
Answer engine optimization explained, with a checklist you can apply today.
What is GEO
Generative engine optimization: how to be read and cited by ChatGPT, Perplexity and AI Overviews.
User Guide
The illustrated two-part manual: every screen, button, report section and filter.