Mongo and the source of truth
in MongoDB, you can fix, correct, or rebuild a counter that is a summary of positive or negative integers by performing the following steps:
1. Identify the Source of Truth:
Determine the collection and the documents that should be considered for rebuilding the counter. For example, if you are maintaining a counter for the number of likes on posts, identify the collection storing the likes.
Use the MongoDB aggregation framework to sum up the positive or negative integers from the relevant documents.
Once you have the aggregated value, you can update your counter document or field with this value.
4. Handling Incremental Updates:
To ensure your counter remains accurate, you should increment or decrement it as changes occur. This can be done using atomic operations like $inc.
Aggregate the values from the source documents.
Update the counter with the aggregated value.
Maintain accuracy with atomic operations on incremental updates.
By following these steps, you can ensure that your counter is always accurate and can be rebuilt whenever necessary.
The MongoDB aggregation framework, which is key to performing the aggregation operations needed to rebuild a counter, was introduced in MongoDB version 2.2, released in August 2012.
For 1 billion documents distributed across 15 shards, you can expect the aggregation process to take roughly 30 to 40 minutes, depending on the indexing, hardware, and network conditions. Running a benchmark on a smaller dataset can help refine this estimate for your specific environment.
areudirty
stormborns
germansingergirl
s-u-f-j-a-n-s-t-e-v-e-n-s
titsay
origamiaround