Remember that 301 are permanent redirects, so they pass authority to the new page. Start by checking all the redirects (301 and 302) and verify that you've used the correct version. The most important HTTP status codes are: I usually start by taking a look at the HTTP status codes under the ‘Response Codes’ tab. Thereafter we can start analysing the outcome. Check the progress bar in the top right corner to see when it’s done. If you want to crawl additional subdomains (for example a blog on the URL ‘’), you need to check the Crawl All Subdomains box under Configuration > Spider.ĭepending on the size of your website, the crawl process can take a couple of minutes. Paste the root domain in the box and hit the Start button. Ready to crawl your first website? Let’s go! I’ll be using the website Gero Wonen Meubelen as an example, but you can follow along using your own domain.įirst of all we need to enter a URL to spider. Purchasing a license will allow more URIs to be crawled (useful if you're dealing with a large site), as well as giving you a few more features. It’s available for Windows, Mac and Ubuntu and it’s completely free, though limited to crawling 500 URI's under the free license. It would be great if you could follow along, so start by downloading the tool here. I’m going to explain some of the most frequently used features of the Screaming Frog SEO spider via a small case study. It can save you a ton of work, because manually analyzing each page of a big website can be very challenging. This information allows you to quickly analyse, audit and review a site from an onsite SEO perspective. It basically tells you what a search spider would see when it crawls a website. It crawls a websites’ links, images, CSS, etc from an SEO perspective. The Screaming Frog SEO Spider is a small desktop application you can install locally on your PC, Mac or Linux machine. In this tutorial we’ll walk you through the most important features. It can be used to review a website and identify flaws which can hurt a website’s performance in search results. One such tool is the Screaming Frog SEO Spider. It’s also worth noting that Macs below OS X Version 10.7.3 (& 32-Bit Macs) can continue to use version 2.40, as well as anyone who might be experiencing any bugs in the new version.The right tools can make the SEO audit of a website so much easier. Version 2.50 requires Java 7 to use (rather than Java 6), which was a natural evolution and launched around three years ago now. Thanks for all your support and feedback as always, you can download the new version now. We still have plenty more in the pipeline and our next version will be a much larger release! That’s the lot for this fairly small update. Fixed a crash caused by starting in crawl mode, navigating to the outlinks tab and right clicking.Fixed a crash caused by the sequence add, add, delete, delete, add on URL Rewriting -> Remove Parameters config menu :-).Fixed a bug where we failed to parse some pages containing meta refresh tags resulting in invalid urls.Fixed a bug where the ‘respect canonicals’ configuration was case insensitive.Fixed a bug where the ‘ignore robots.txt’ configuration wouldn’t save as default.We will now continue with what was read up to the point of error, logging appropriately in the log file. The SEO Spider now has greater tolerance around invalid gzip responses.The SEO Spider now detects any crashes on a previous run and asks the user to save logs and send to our support team.Improved logging so data is not overwritten with new sessions.Improved debugging and saving of log files for support issues directly from the ‘Help’ and ‘debug’ menu.We became a verified publisher for the Windows platform.We have also made a number of other updates, these include the following – If you click the ‘Site Structure’ or ‘Response Codes’ tabs, you can see better visualisations of this data as well.Īt the moment you can’t export the graphs unfortunately, but we do have this planned for development. When you click the different tabs at the top, or filters in the right hand window pane, the graphs update to help visualise the data. This updates in real time, as you crawl – We have introduced a new ‘graph view’ window into the lower half of the right hand overview window pane. Version 2.50 includes just the one main new feature – Graph View Our next update will be much, much larger. This is just a small update, with a couple of new features and bug fixes listed below. Thanks again to everyone for their continued feedback, suggestions and support. I am pleased to announce a small update of the Screaming Frog SEO spider to version 2.50, codenamed internally as ‘bite’.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |