Dragon
  • 如有问题,可以联系网站客服QQ:2020555813
小编小编  2022-12-06 10:40 终究美好 隐藏边栏 |   抢沙发

Web Scraper 是一款网页数据采集工具,只要是我们日常在网页上可以浏览到的内容,它都可以帮助我们爬取下来。

Web Scraper最大的特色是免费和免编程,不懂编程的人也很容易操作,尽管在爬取网页数据方面也有很多工具,但综合对比来看还是web scraper更加方便快捷一些。

 

Web Scraper主要有以下几个特点:

轻量级,只是浏览器插件,无需在电脑中安装
免费,并且没有按下载数据条数收费的要求
免编程,好上手,一天学会无压力
唯一缺点是免费版不能设置定时任务

webscraper下载

 

登录官方网站进行插件安装,插件有两种浏览器可供选择:火狐或者谷歌的Chrome。我选择的是火狐浏览器,如果选用Chrome浏览器,则需要科学上网。
(具体下载网址不方便粘贴,可以私信获取)
知乎关键字搜索信息爬取代码

{"_id":"zhihuchaxun","startUrl":["
https://www.zhihu.com/search?type=content&q=k30s至尊"],"selectors":[{"id":"question","type":"SelectorElementScroll","parentSelectors":["_root"],"selector":"div[] div.List-item","multiple":true,"delay":"3000"},{"id":"url","type":"SelectorLink","parentSelectors":["question"],"selector":"div [itemprop='zhihu:question'] a","multiple":true,"delay":0},{"id":"title","type":"SelectorText","parentSelectors":["url"],"selector":".QuestionHeader h1","multiple":false,"regex":"","delay":0},{"id":"view","type":"SelectorText","parentSelectors":["url"],"selector":"div.NumberBoard-item strong","multiple":false,"regex":"","delay":0},{"id":"follower","type":"SelectorText","parentSelectors":["url"],"selector":"button strong","multiple":false,"regex":"","delay":0},{"id":"answer","type":"SelectorText","parentSelectors":["url"],"selector":"div.Card:nth-of-type(1) a.QuestionMainAction","multiple":false,"regex":"","delay":0}]}

 

webscraper安装

下载好插件后,打开火狐浏览器,点击右上角的几个横杆按钮,然后点击附加组件

声明:本文为原创文章,版权归所有,欢迎分享本文,转载请保留出处!

发表评论

扫一扫二维码分享
×