mirror of
https://github.com/google/nomulus.git
synced 2025-05-01 12:37:52 +02:00
When trying to run the MapReduce for DeleteOldCommitLogsAction, we run into a lot of DatastoreTimeoutException during CommitLogManifestReader.next. This causes the entire shard to fail. Since we have a lot of keys (tens of millions), this is almost guaranteed to happen, dooming the entire MapReduce. Here is an attempt to recover from the Timeout Exception by saving the state before the read, then on failure restoring that state and trying again. ------------- Created by MOE: https://github.com/google/moe MOE_MIGRATED_REVID=165172222 |
||
---|---|---|
.. | ||
inputs | ||
BUILD | ||
MapreduceModule.java | ||
MapreduceRunner.java |