scrapy爬取图片时遇到错误:ValueError: Missing scheme in request url: //scpic3.chinaz.net/Files/pic/pic9/202103

错误原因是在请求资源的时候没有使用完整的url

只向//scpic3.chinaz.net/Files/pic/pic9/202103发送了资源请求,而完整的资源地址需要前面加上https:

所以在pipelines.py文件的get_media_requests方法中,在发送request请求时修改为以下:

def get_media_requests(self, item, info):
    yield scrapy.Request('https:' + item['src'])

微信公众号
手机浏览(小程序)

Warning: get_headers(): SSL operation failed with code 1. OpenSSL Error messages: error:14090086:SSL routines:ssl3_get_server_certificate:certificate verify failed in /mydata/web/wwwshanhubei/web/wp-content/themes/shanhuke/single.php on line 57

Warning: get_headers(): Failed to enable crypto in /mydata/web/wwwshanhubei/web/wp-content/themes/shanhuke/single.php on line 57

Warning: get_headers(https://static.shanhubei.com/qrcode/qrcode_viewid_8591.jpg): failed to open stream: operation failed in /mydata/web/wwwshanhubei/web/wp-content/themes/shanhuke/single.php on line 57
0
分享到:
没有账号? 忘记密码?