We store our pre-annotation in mongoDB which works great for genetic data. But every day the database is getting bigger and bigger and mongodump/mongorestore takes too long and uses too many resources. I know that 10gen has Incremental Backup services but at a cost plus we don't need the point in time features or cloud storage. I was wondering if anyone knows of any free, open source APIs that can do MongoDB incremental backup?
If you simply want to make a copy of your data, you could try using replica sets.
If you keep large-scale backups, you could try:
A related solution might use rsync to make incremental backups of the underlying data directories. Your best bet is to ask for help from the mongodb community, as this is a bit off-topic here.