空氣質量指數獲取

• • 介紹
  • 配置文件
  • 代碼
  • 結果
  • 展示

介紹

空氣質量指數（air quality index，AQI）又稱為空氣污染指數，可以用來表征空氣污染程度，是國際上普遍采用的定量評價空氣質量好壞的重要指標。它是根據環境空氣質量標準和各項污染物對人體健康、生態、環境的影響，將常規監測的幾種空氣污染物（如PM2.5、PM10、SO2、NO2、O3、CO等）濃度簡化成為單一的概念性指數值形式。

目前很多網站都有提供可以查詢的公開歷史AQI數據，生態環境部也有全國空氣質量實時發布平臺，可以對空氣質量進行實時監測，但目前鮮見可以快速下載的途徑，今天分享一個爬蟲實現，希望對從事空氣質量研究的同學有所幫助。

去看原文

配置文件

#城市名 CITYNAME = 北京 CITY = beijing MONTH = 2013-12# 起始日期 年月 DATE_BEGIN = 2018/01# 終止日期 年月 DATE_END = 2018/02# 保存路徑 SAVE_PATH = data/

代碼

class SpiderMain(object):def __init__(self, conf):self.conf = confself.dates = manager.DateManager()self.downloader = html_downloader.HtmlDownloader(conf)self.parser = html_parser.HtmlParser(conf)self.output = html_output.HtmlOutput()def craw(self):count = 1type_ = conf.get("MAIN", "SPIDER_TYPE")df_dates = pd.date_range(start = conf.get(type_, "DATE_BEGIN"), end = conf.get(type_, "DATE_END"), freq = "M")df_dates = list(df_dates)df_dates.append(datetime.datetime.strptime(conf.get(type_, "DATE_END"), '%Y/%m'))self.dates.add_new_dates(df_dates)while self.dates.has_new_date():try:new_date = self.dates.get_new_date()print("craw %d: %s %s" % (count, conf.get(type_, "CITY"), new_date.strftime("%Y-%m")))html_cont = self.downloader.download(new_date)#print html_contnew_data = self.parser.parse(new_date, html_cont)if new_data is None:print("There are no data for this date")count = count + 1continue#print new_urlsself.output.collect_data(new_data)# if count == 3:# breakcount = count + 1except Exception as e:print(e); self.downloader.terminateBroswer()print("craw failed")sys.exit()self.downloader.terminateBroswer()self.output.save_excel(type_, conf.get("WEATHER", "SAVE_PATH") + type_ + "_" + conf.get(type_, "CITY") + ".csv")if __name__ == '__main__':conf = configparser.ConfigParser()conf.read("conf.ini", encoding="utf-8-sig")obj_spider = SpiderMain(conf)obj_spider.craw()

結果

,Date,AQI,GRADE,PM25,PM10,SO2,CO,NO2,O3 0,2018-01-01,57,良,34,63,9,1,44,38 1,2018-01-02,50,優,28,50,7,0.8,33,46 2,2018-01-03,28,優,11,28,5,0.4,21,51 3,2018-01-04,40,優,15,30,4,0.5,32,39 4,2018-01-05,63,良,32,54,8,0.9,50,36 5,2018-01-06,48,優,16,30,5,0.5,38,48 6,2018-01-07,54,良,38,57,10,0.8,43,50 7,2018-01-08,55,良,12,60,4,0.3,11,61 8,2018-01-09,35,優,7,35,3,0.3,13,63 9,2018-01-10,32,優,6,21,3,0.3,9,63 10,2018-01-11,32,優,13,25,5,0.5,25,55 11,2018-01-12,87,良,61,81,11,1.3,69,21 12,2018-01-13,139,輕度污染,106,122,15,1.7,79,17 13,2018-01-14,176,中度污染,133,137,12,1.7,71,41 14,2018-01-15,59,良,32,58,8,0.9,47,42 15,2018-01-16,114,輕度污染,45,177,5,0.7,42,55 16,2018-01-17,77,良,42,104,8,1,49,62 17,2018-01-18,93,良,63,105,11,1.2,74,19 18,2018-01-19,108,輕度污染,81,122,13,1.5,73,36 19,2018-01-20,63,良,31,75,9,0.8,48,32 20,2018-01-21,64,良,37,77,19,1.2,44,29 21,2018-01-22,47,優,22,47,4,0.6,25,65 22,2018-01-23,32,優,11,32,4,0.4,15,60 23,2018-01-24,35,優,17,33,5,0.4,28,65 24,2018-01-25,33,優,9,23,4,0.4,26,62 25,2018-01-26,53,良,29,41,8,0.6,42,42 26,2018-01-27,112,輕度污染,84,95,14,1.4,67,14 27,2018-01-28,59,良,11,67,3,0.4,15,66 28,2018-01-29,56,良,8,61,3,0.4,20,67 29,2018-01-30,36,優,11,36,6,0.4,24,68 30,2018-01-31,62,良,22,74,7,0.5,29,65 31,2018-02-01,68,良,30,85,10,0.7,36,64 32,2018-02-02,34,優,8,30,5,0.3,11,68 33,2018-02-03,32,優,8,21,5,0.4,20,64 34,2018-02-04,40,優,19,36,8,0.5,32,55 35,2018-02-05,34,優,7,18,3,0.3,15,67 36,2018-02-06,65,良,47,61,13,0.9,51,43 37,2018-02-07,51,良,33,52,8,0.6,31,76 38,2018-02-08,73,良,53,76,12,0.9,53,49 39,2018-02-09,80,良,40,109,8,0.7,32,74 40,2018-02-10,44,優,10,44,3,0.3,12,74 41,2018-02-11,67,良,9,84,2,0.3,6,73 42,2018-02-12,53,良,12,56,4,0.4,15,73 43,2018-02-13,79,良,58,79,13,1.1,57,50 44,2018-02-14,37,優,13,33,3,0.4,18,74 45,2018-02-15,73,良,53,66,10,0.5,22,80 46,2018-02-16,107,輕度污染,80,101,14,0.6,24,85 47,2018-02-17,109,輕度污染,82,92,10,1.3,35,49 48,2018-02-18,152,中度污染,116,109,14,1.7,46,80 49,2018-02-19,188,中度污染,141,131,24,2,42,69 50,2018-02-20,63,良,45,42,6,0.7,21,85 51,2018-02-21,48,優,33,43,6,0.6,26,81 52,2018-02-22,45,優,18,45,6,0.5,29,77 53,2018-02-23,52,良,23,54,6,0.6,29,79 54,2018-02-24,62,良,30,74,10,0.6,21,65 55,2018-02-25,82,良,60,71,10,0.8,43,66 56,2018-02-26,162,中度污染,123,121,21,1.5,69,86 57,2018-02-27,218,重度污染,168,170,12,1.8,51,66 58,2018-02-28,115,輕度污染,87,116,9,1,34,74

展示

原文有源碼，更多內容，請關注地學數據處理分析。

總結

以上是生活随笔為你收集整理的空气质量指数的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。