if you click “detect and update” for many times

1. Wrong blocking
On Baidu’s robots Txt update, if you click “detect and update” for many times, there will be a problem that it can be updated from time to time, but it can not be updated from time to time. This way: things that should not be included in robots Txt is included, and it is normal to delete it. So what is the problem? It is not that the server is overloaded, but that some baiduspiders are blacklisted due to firewall errors.
2. Server exception
Not to mention the regular servers. As we all know, the servers in Beijing, Shanghai and Guangzhou are generally good. But there are some special servers. Most webmasters don’t know, do they? For example, the “Hong Kong and Taiwan server” of Western Digital is very interesting. Is it really from Hong Kong and Taiwan? What kind of Hong Kong and Taiwan is its own computer room in China? In order to avoid filing, the IP address of Hong Kong and Taiwan is used, and the data is all in China.
What’s wrong with that? We will find that: the server of the site passes through the CDN. Even if you upload a picture, it will be displayed as “302 status code”. The access speed has been improved, but is this conducive to SEO?
3. Unable to obtain the real IP
Large scale websites generally use CDN acceleration, but some sites not only use CDN acceleration for “devices”, but also use the acceleration function for spider. What is the result? If the CDN node is unstable, this problem will be fatal to the website spider.
The reason why many large sites open CDNs is that they are easy to be attacked. At this time, if you don’t do “spider back to the source”, you can imagine. Has your site done a CDN? Please log in to Baidu webmaster platform to check whether the spider can capture the real IP address!