If there are no directives, it will crawl your site like Googlebot. The program presents the data in tabs by type and allows you to filter for common SEO issues, or slice and dice the data as you see fit by exporting and importing into Excel.Īs default, the SEO Spider crawls sites like Googlebot (it obeys allow, disallow directives and wildcard support like Googlebot), but presents its own user-agent ‘Screaming Frog SEO Spider’, which it will obey specific directives for in robots.txt. You can view, analyze and filter the crawl data as it’s gathered and updated continuously in the program’s user interface. It allows you to quickly crawl websites’ URLs, resources (links, images, CSS, scripts) and fetch key onsite elements (URL, page title, meta descriptions, headings) to evaluate onsite SEO. Screaming Frog SEO Spider is an advanced desktop SEO auditing tool and website crawler, built by real SEOs with thousands of users worldwide.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |