google-nomulus/java/google/registry/util
guyben d87f01e7bf Fetch data from Cloud DNS in parallel
Before pushing an update to Cloud DNS, the CloudDnsWriter needs to read all the domain RRSs from Cloud DNS one by one to know what to delete.

Doing so sequentially results in update times that are too long (approx 200ms per domain, which is 20 seconds per batch of 100) severely limiting our QPS.

This CL uses Concurrent threading to do the Cloud DNS queries in parallel. Unfortunately, my preferred method (Set.parallelStream) doesn't work on App Engine :(

This reduces the per-item time from 200ms to 80ms, which can be further reduced to 50ms if we remove the rate limiter (currently set to 20 per second).

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=178126877
2017-12-13 12:43:45 -05:00
..
AppEngineTimeLimiter.java Fix mismatch in types of Predicates being used 2017-10-04 16:16:45 -04:00
BUILD Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
CapturingLogHandler.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
CidrAddressBlock.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
Clock.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
CollectionUtils.java Remove unnecessary generic type arguments 2017-11-21 18:17:31 -05:00
ComparingInvocationHandler.java Fix two warnings thrown by Eclipse 2017-04-26 10:36:51 -04:00
Concurrent.java Fetch data from Cloud DNS in parallel 2017-12-13 12:43:45 -05:00
DatastoreServiceUtils.java Refactor Guava functional methods to use lambdas 2017-12-01 22:14:05 -05:00
DateTimeUtils.java Refer to Datastore everywhere correctly by its capitalized form 2017-02-17 12:12:12 -05:00
DiffUtils.java Clarify diff display of MutatingCommand 2017-10-04 16:16:45 -04:00
DomainNameUtils.java Clean up minor items found during DiRT 2017-03-27 13:25:35 -04:00
FixedClock.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
FormattingLogger.java Run automatic Java 8 conversion over codebase 2017-10-10 12:09:41 -04:00
HexDumper.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
Idn.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
ImprovedInputStream.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
ImprovedOutputStream.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
ListNamingUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
NetworkUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
NonFinalForTesting.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
ObjectifyUtils.java Run automatic Java 8 conversion over codebase 2017-10-10 12:09:41 -04:00
package-info.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
PipelineUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
PosixTarHeader.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
PreconditionsUtils.java Switch from Guava Optionals to Java 8 Optionals 2017-10-24 16:53:47 -04:00
PredicateUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
RandomStringGenerator.java Generate authInfo for imported domains 2017-02-08 17:42:57 -05:00
RegistrarUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
RequestStatusChecker.java Clean up some code quality issues 2017-12-01 22:14:06 -05:00
RequestStatusCheckerImpl.java Add unit tests to RequestStatusCheckerImpl 2017-09-12 15:51:50 -04:00
ResourceUtils.java Add golden files for request component routing maps 2017-06-05 18:17:09 -04:00
Retrier.java Clean up some code quality issues 2017-12-01 22:14:06 -05:00
SendEmailService.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
SerializeUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
Sleeper.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
SqlTemplate.java Remove unnecessary generic type arguments 2017-11-21 18:17:31 -05:00
StringGenerator.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
SystemClock.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
SystemSleeper.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
TaskEnqueuer.java Run automatic Java 8 conversion over codebase 2017-10-10 12:09:41 -04:00
TeeOutputStream.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
TokenUtils.java Clean up some code quality issues 2017-12-01 22:14:06 -05:00
TypeUtils.java Clean up some code quality issues 2017-12-01 22:14:06 -05:00
UrlFetchException.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
UrlFetchUtils.java Switch from Guava Optionals to Java 8 Optionals 2017-10-24 16:53:47 -04:00
VoidCallable.java Clean up some code quality issues 2017-12-01 22:14:06 -05:00
X509Utils.java Remove unnecessary generic type arguments 2017-11-21 18:17:31 -05:00
XmlEnumUtils.java Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
XmlToEnumMapper.java Remove unnecessary explicit generic type declarations 2017-11-07 17:11:29 -05:00