google-nomulus/java/google/registry
mcilwain ded40851d3 Use locking on async mapreduces
This ensures that only one will run at a time, which should help fix the
clogged up mapreduces we've seen on sandbox.

In order to do this, the UnlockerOutput is introduced. This unlocks the
given Lock after all reducer shards have finished.

Also increases the lease duration of the DNS refresh action from 20 to
240 minutes. 20 minutes isn't long enough; when there's a lot of domains
and decent system load the mapreduce could take longer than that in the
ordinary case.

TESTED=Deployed to alpha and verified that more than one copy of the
mapreduce wouldn't run simultaneously, and also that the lock is
released when the mapreduce is finished.

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=205887554
2018-08-10 13:44:25 -04:00
..
backup Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
batch Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
beam Add invoicing package to nomulus release (fixes build) 2018-07-17 22:10:48 -04:00
bigquery Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
builddefs Format .bzl files with buildifier 2018-07-14 01:37:03 -04:00
config Refactor beam invoicing pipeline into its own package 2018-07-17 22:08:13 -04:00
cron Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
dns Export Weimin as author of commits to GitHub 2018-07-14 01:37:03 -04:00
env Switch pubapi/default service to basic scaling in prod/sandbox 2018-07-17 22:01:08 -04:00
export Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
flows Properly handle NAME_COLLISION domains in start-date sunrise 2018-08-10 13:44:25 -04:00
gcs Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
groups Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
idn Update IDN tables to comply with https://www.iana.org/help/idn-repository-procedure 2018-02-01 21:59:14 -05:00
keyring Delete all Braintree code 2018-07-14 01:37:03 -04:00
loadtest Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
mapreduce Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
model Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
module Remove transition code for set of parameter refactoring 2018-07-14 01:37:03 -04:00
monitoring/whitebox Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
pricing Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
proxy Make some minor changes to logging messages and test names. 2018-08-10 13:44:25 -04:00
rdap Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
rde Move the RDE PGP file encoding to a dedicated file 2018-08-10 13:44:25 -04:00
reporting Refactor beam invoicing pipeline into its own package 2018-07-17 22:08:13 -04:00
request Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
security Improve internal build system speed 2018-06-27 15:28:52 -04:00
storage/drive Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
tldconfig/idn Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
tmch Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
tools Allow square bracket expansion when specifying nameservers 2018-08-10 13:44:25 -04:00
ui Fix mismatched parenthesis in domain.soy 2018-07-14 01:37:03 -04:00
util Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
whois Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
xjc Run bazel installer as a argument to bash 2018-08-10 13:44:25 -04:00
xml Pretty-print actual XML in tests 2018-07-14 01:37:03 -04:00
BUILD Remove most HTML/CSS/JS assets from the backend service WAR 2018-06-27 15:28:53 -04:00
repositories.bzl Upgrade Guava and Truth versions 2018-08-10 13:44:25 -04:00