摘 要:随着网上购物的盛行,淘宝、京东、拼多多等互联网商业巨头也展开了激烈的竞争。收集商品、评论及销量数据以及对各种商品及用户的消费场景进行分析成了必不可少的环节。然而传统的人工收集并整理数据显然效率不足以满足当下各大公司以及其他相关产业对这些数据的需要。近年来 Python 爬虫技术的逐渐成熟,给网购数据收集并整理带来了极大的便利。
关键词:网购;Python;pip;爬虫技术
DOI:10.19850/j.cnki.2096-4706.2021.16.007
中图分类号:TP311.1 文献标识码:A 文章编号:2096-4706(2021)16-0026-06
Online Shopping Data Crawling Based on Python
GAO Yating, LIU Yaju
(Hebei Agricultural University, Cangzhou 061000, China)
Abstract: With the popularity of online shopping, Taobao, Jingdong, Pinduoduo and other internet business giants also launches a fierce competition. Collecting product, review, and sales data, as well as analyzing the consumption scenarios of various products and users, has become an essential links. However, the traditional manual collection and sorting of data is obviously not efficient enough to meet the needs of companies and other related industries. In recent years, the gradual maturity of Python crawler technology has brought great convenience to the collection and sorting of online shopping data.
Keywords: online shopping; Python; pip; crawler technology
参考文献:
[1] 李霖,杨蕾 . 公众参与的兴趣点数据有效性效验方法[J]. 测绘科学,2015,40(7): 98-103.
[2] 菜鸟教程 .Python 爬虫介绍 [EB/OL].[2021-04-26]. https://www.runoob.com/w3cnote/python-spider-intro.html.
[3] 吴道君 . 大数据背景 python 在网络爬虫框架中的应用[J]. 科学技术创新,2021(21): 97-99.
[4] pennykoon.python 爬取淘宝销量数据 [EB/OL]. [2021-04-26].https://blog.csdn.net/pennykoon/article/ details/112150688.
[5] weixin_34199405.windows 使 用 pip 安装 selenium 报错问题 [EB/OL].[2021-04-26].https://blog.csdn.net/ weixin_34199405.
作者简介:高雅婷 (2000—),女,汉族,河北保定人,本科在读,研究方向:Python 爬虫。