生活随笔
收集整理的這篇文章主要介紹了
用python爬取智联招聘
小編覺得挺不錯的,現(xiàn)在分享給大家,幫大家做個參考.
在智聯(lián)網(wǎng)站上搜索“大數(shù)據(jù)分析”
F12檢索網(wǎng)頁，找到對應(yīng)的json
抓取URL
import requests
import pandas
as pd
import time
url
= r
'https://fe-api.zhaopin.com/c/i/sou?_v=0.15071971&x-zp-page-request-id=eb7282843faf4a2d827002757bcdd769-1575511230999-129076&x-zp-client-id=60004a6b-bf5e-41c0-9a37-e2aa003360c8&MmEwMD=4CkD_v9XYKkRPQD7x5kBhxL5rYE8kibi89tA7lNM3gE_o.GmRqE0CXdzn7hhrlUY4sfi_Dh2K.E.lZ7V2ohekVswQoqKdW8i4H5r5Ie9ke9hETN2dUGVd.VplT9huTmAvE69pF0udgsddmqOiGqOkO55_wyaV0lLV4uTkR41VcMsb5qV3UPIOoHl160CiBmNryjs5bk7Z6RLlZWkhRxVpXb0DbEzTXLv7T8Xst6dQ1dj1fDP.q2ERisCklLcxyRy.WgM8Xtk6mLcYkInmzFbxrmw_wz1SCOi1co_5brw8ntInYCL74N6Cv2TGFU_fxfjlKGQtShNRQliBXrk8w1ULqTTUTMk2TcdyLC3PGDCSHZajRKH7xzeulcZ0jwm9B03YBTixrfpodjXKIs0wH6brVp2Q'
headers
= {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36'}
response
= requests
.get
(url
,headers
=headers
)
datas
= response
.json
()
datas
爬取到j(luò)son里面的內(nèi)容
解析json中的內(nèi)容
列一個循環(huán)找到[‘data’][‘results’]編寫如下：就可以將json內(nèi)容分別取出
for i
in res_
['data']['results']:city
= i
['city']['items'][0]['name']company
= i
['company']['name']type = i
['company']['type']['name']size
= i
['company']['size']['name']eduLevel
= i
['eduLevel']['name']jobname
= i
['jobName']salary
= i
['salary']workingExp
= i
['workingExp']['name']welfare
= i
['welfare']number
= i
['number'][0]
最后保存到CSV
with open('zhilian.csv','a',encoding
='gbk',newline
='')as csv_file
:writer
= csv
.writer
(csv_file
)try:writer
.writerow
(item
)except Exception
as e
:print('writer error:',e
)
部分內(nèi)容如下：
總結(jié)
以上是生活随笔為你收集整理的用python爬取智联招聘的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。
如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。
