Basic. To increase the parsing speed, you can remove CSS styles, JavaScript, SWF. Then the program will not take them into account during operation and will be less loaded. If the site is closed in robots.txt, in the Basic window you need to activate the function of ignoring this file;
Limits. In the Limit Search Depth setting, you must specify the level of nesting of pages to check the site. This is relevant when checking a directory or other resource that has many internal folders located one inside another. Then very deep pages will not be checked;
Advanced. You need to tick the boxes so that only what search engines see is displayed. This simplifies the work, removing all unnecessary things and increasing visibility;
Preferences. Here you specify the sizes of meta tags, URLs, titles, image latvia cell phone number list attributes, and the images themselves. If it is important to take into account all pages, you can enter larger values.
you need to go to Configuration > Include and enter the sections you want to include in the parsing. If you need, on the contrary, to exclude some sections. This can be done via Configuration > Exclude.
For new sites without an admin panel, analysis can be performed using a login and password, and instead of admin access, guest access can be set up.
How to Scrap in Screaming Frog SEO Spider
You need to enter the website address and click Start. The duration of the analysis depends on the number of pages on the website, on average, the check is performed for 5-20 minutes. While the program is running, you can adjust the speed of "Spider". At the bottom of the working window, you can see the average and current parsing speed. If the speed is too high, failures may occur. Then you need to specify a lower speed in the settings.
Screaming Frog SEO Spider Features
To make work easier, Screaming Frog provides the ability to export pages to Excel. Let's look at the main features of the program and the things it allows you to edit and customize.