PyMongo/Mongoengine equivalent of mongodump

Question

Is there an equivalent function in PyMongo or mongoengine to MongoDB's mongodump? I can't seem to find anything in the docs.

Use case: I need to periodically backup a remote mongo database. The local machine is a production server that does not have mongo installed, and I do not have admin rights, so I can't use subprocess to call mongodump. I could install the mongo client locally on a virtualenv, but I'd prefer an API call.

Thanks a lot :-).

Solution 1

For my relatively small small database, I eventually used the following solution. It's not really suitable for big or complex databases, but it suffices for my case. It dumps all documents as a json to the backup directory. It's clunky, but it does not rely on other stuff than pymongo.

from os.path import join
import pymongo
from bson.json_utils import dumps

def backup_db(backup_db_dir):
    client = pymongo.MongoClient(host=<host>, port=<port>)
    database = client[<db_name>]
    authenticated = database.authenticate(<uname>,<pwd>)
    assert authenticated, "Could not authenticate to database!"
    collections = database.collection_names()
    for i, collection_name in enumerate(collections):
        col = getattr(database,collections[i])
        collection = col.find()
        jsonpath = collection_name + ".json"
        jsonpath = join(backup_db_dir, jsonpath)
        with open(jsonpath, 'wb') as jsonfile:
            jsonfile.write(dumps(collection))

Solution 2

The accepted answer is not working anymore. Here is a revised code:

from os.path import join
import pymongo
from bson.json_util import dumps

def backup_db(backup_db_dir):
    client = pymongo.MongoClient(host=..., port=..., username=..., password=...)
    database = client[<db_name>]
    collections = database.collection_names()

    for i, collection_name in enumerate(collections):
        col = getattr(database,collections[i])
        collection = col.find()
        jsonpath = collection_name + ".json"
        jsonpath = join(backup_db_dir, jsonpath)
        with open(jsonpath, 'wb') as jsonfile:
            jsonfile.write(dumps(collection).encode())


backup_db('.')

Comments

[Cmag]

thanks for posting this! Does this differ in any way from cli mongodump? Will the resulting json file be usable with mongorestore ?

[farthVader]

You could consider iterating over the result of col.find() if you don't intend to hold all the documents in memory at once. You did mention "relatively small small database".

[Kishan Mehta]

can we store as bson?

[Kishan Mehta]

This should be from bson.json_util import dumps instead of utils.!!!!!!

[Krunal Sonparate]

I found this solution helpful, but i also want backup in single file. Any suggestions how can i archive in single file as export and import that file to restore database?

[igorkf]

This is good, but will not create .bson e .metadata.json files. So I think restore using mongorestore will not be able.

[Justin Furuness]

Why do you use .encode here?

[CIsForCookies]

don't remember why I did that, probably because it is written as bytes. Try to remove the encode and see if it works :)

[Justin Furuness]

I believe you don't need it, that's why I was curious. Thank you!