google-nomulus/core
Michael Muller 2a2652c7f5 Fix issues with saving and deleting gap records (#1561)
* Fix issues with saving and deleting gap records

Datastore limits us to mutating up to 25 records per transaction.  We
sometimes exceed that when deleting expired gap records.  In addition, it is
theoretically possible for us to accumulate enough continuous gap records to
exceed this count while replaying the original transaction.

Deal with deletion by breaking up the gap records to be deleted into a batch
size that is small enough to be deleted transactionally (in practice, we don't
much care about the transactionality but it doesn't seem like we can delete
batches without it).

Deal with the possibility of too many additions by always breaking out gap
record storage and last transaction number updates into their own
transaction(s) (separate from the replay of the original SQL transaction).
2022-03-17 15:09:59 -04:00
..
gradle/dependency-locks Upgrade to Beam 2.34.0 (#1472) 2021-12-19 22:48:15 -05:00
src Fix issues with saving and deleting gap records (#1561) 2022-03-17 15:09:59 -04:00
build.gradle Add a tools command to launch SQL validation job (#1526) 2022-02-28 13:14:57 -05:00
Dockerfile Build docker image of nomulus tool (#142) 2019-07-16 20:18:44 -04:00