Question 1

What is a search engine spider simulator?

Accepted Answer

It fetches a public URL and displays only what a crawler can see — title, description, headings, links, structured data, robots directives and visible text. This helps you understand exactly what Google or Bing indexes.

Question 2

Why doesn't it show images and CSS?

Accepted Answer

Crawlers do execute some JavaScript but they don't 'see' images and CSS the way humans do. This tool focuses on the text and metadata Google uses to rank your page.

Question 3

Are my requests stored?

Accepted Answer

No. URL fetches go through a public CORS proxy to the target site and are processed entirely in your browser. We do not log, store or analyze any URLs.

Question 4

Why are some pages blocked?

Accepted Answer

Many sites send X-Robots-Tag: noindex or block their content from cross-origin requests. The tool will show you exactly which directives are in place and why a crawler might skip the page.

📄 Title & Description

🤖 Crawler Directives

📊 Open Graph & Twitter

🧠 Structured Data (JSON-LD)

📑 Headings (H1–H6)

🔗 Links (0)

📝 Visible Text (0 words, 0 chars)