日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程语言 > python >内容正文

python

python数据格式化后导入数据库_如何为数据库导入重新格式化这个json?

發布時間:2025/3/12 python 16 豆豆
生活随笔 收集整理的這篇文章主要介紹了 python数据格式化后导入数据库_如何为数据库导入重新格式化这个json? 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

我有這些“json”文件,我想插入到我的mongodb數據庫中。你知道嗎

問題是,它的格式如下:{ "channelType":"TEMPGROUP", ... } # line 1

{ "channelType":"TEMPGROUP", ... } # line 2

因此,它不是將它作為一個文檔插入數據庫,而是將每一行作為一個條目插入。最終,數據庫中3個“json”文件中的3個文檔變成了數據庫中的1189個文檔。你知道嗎

如何將“.json”的全部內容插入到一個文檔中?你知道嗎

我的代碼是:replay_url = "http://live.ksmobile.net/live/getreplayvideos?"

userid = 969730808384462848

url2 = replay_url + urllib.parse.urlencode({'userid': userid}) + '&page_size=1000'

raw_replay_data = requests.get(url2).json()

for i in raw_replay_data['data']['video_info']:

url3 = i['msgfile']

raw_message_data = urllib.request.urlopen(url3)

for line in raw_message_data:

json_data = json.loads(line)

messages.insert_one(json_data)

print(json_data)

更新以提供更多回答信息

在消息.插入(json\ U數據)給出以下錯誤:Traceback (most recent call last):

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/collection.py", line 633, in _insert

blk.execute(concern, session=session)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/bulk.py", line 432, in execute

return self.execute_command(generator, write_concern, session)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/bulk.py", line 329, in execute_command

raise BulkWriteError(full_result)

pymongo.errors.BulkWriteError: batch op errors occurred

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/import_messages_dev.py", line 43, in

messages.insert(json_data)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/collection.py", line 2941, in insert

check_keys, manipulate, write_concern)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/collection.py", line 635, in _insert

_raise_last_error(bwe.details)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/helpers.py", line 220, in _raise_last_error

_raise_last_write_error(write_errors)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/helpers.py", line 188, in _raise_last_write_error

raise DuplicateKeyError(error.get("errmsg"), 11000, error)

pymongo.errors.DuplicateKeyError: E11000 duplicate key error index: liveme.messages.$_id_ dup key: { : ObjectId('5aa2fc6f5d60126499060949') }

在消息。插入一個(json\ U數據)給了我這個錯誤:Traceback (most recent call last):

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/import_messages_dev.py", line 43, in

messages.insert_one(json_data)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/collection.py", line 676, in insert_one

common.validate_is_document_type("document", document)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/common.py", line 434, in validate_is_document_type

"collections.MutableMapping" % (option,))

TypeError: document must be an instance of dict, bson.son.SON, bson.raw_bson.RawBSONDocument, or a type that inherits from collections.MutableMapping

在消息。插入\u多個(json\ U數據)給了我這個錯誤:Traceback (most recent call last):

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/import_messages_dev.py", line 43, in

messages.insert_many(json_data)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/collection.py", line 742, in insert_many

blk.execute(self.write_concern.document, session=session)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/bulk.py", line 432, in execute

return self.execute_command(generator, write_concern, session)

File "/media/anon/06bcf743-8b4d-409f-addc-520fc4e19299/PycharmProjects/LiveMe/venv1/lib/python3.6/site-packages/pymongo/bulk.py", line 329, in execute_command

raise BulkWriteError(full_result)

pymongo.errors.BulkWriteError: batch op errors occurred

在消息.插入以及消息。插入\u多個兩者都插入一行并拋出錯誤。你知道嗎

總結

以上是生活随笔為你收集整理的python数据格式化后导入数据库_如何为数据库导入重新格式化这个json?的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。