How do I bulk update/insert in mongoDb with pymongo/pandas. The error I get is batch op errors occurred I reason I get is because I set the "_id", which I want to do. I code runs fine on first run, but on second run it fails. I want to use pandas in workflow. The data does have a datetime object.
The syntax is completely different for upsert = True, with Update. An efficient solution with update would be helpful, where "_id" or "qid" could be set. But, there are python datetime objects!
InSQL = 'SELECT * from database2.table2 ' sqlOut = pd.read_sql(InSQL,cxn) sqlOut['_id'] = "20170101" + ":"+ sqlOut['Var'] dfOut = sqlOut.to_json(orient='records',date_format='iso' ) try: db["test"].insert_many(json.loads(dfOut)) except Exception as e: print e
0 comments:
Post a Comment