You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I tried to open this page by postman or browser those are normal web page, but I got a 404 page after the read method callback return the article.
The code is followed here:
read(url, {strictSSL: false, headers: {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36'
}},function(err, article, meta) {
if (!err) {
//article.content or article.html display a 404 page here
// Close article to clean up jsdom and prevent leaks
article.close();
} else {
console.log("crawlTopic read error: " + err);
callback(err);
}
});
The text was updated successfully, but these errors were encountered:
Here's the url: http://www.8wenku.com/book/2414
I tried to open this page by postman or browser those are normal web page, but I got a 404 page after the read method callback return the article.
The code is followed here:
The text was updated successfully, but these errors were encountered: