zydronium/google-nomulus
1
0
Fork 0
mirror of https://github.com/google/nomulus.git synced 2025-06-18 02:14:49 +02:00
Code Issues Projects Releases Packages Wiki Activity
google-nomulus/java/google/registry
History
guyben d87f01e7bf Fetch data from Cloud DNS in parallel 
Before pushing an update to Cloud DNS, the CloudDnsWriter needs to read all the domain RRSs from Cloud DNS one by one to know what to delete.

Doing so sequentially results in update times that are too long (approx 200ms per domain, which is 20 seconds per batch of 100) severely limiting our QPS.

This CL uses Concurrent threading to do the Cloud DNS queries in parallel. Unfortunately, my preferred method (Set.parallelStream) doesn't work on App Engine :(

This reduces the per-item time from 200ms to 80ms, which can be further reduced to 50ms if we remove the rate limiter (currently set to 20 per second).

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=178126877
2017-12-13 12:43:45 -05:00
..
backup Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
batch Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
bigquery Refactor Guava functional methods to use lambdas 2017-12-01 22:14:05 -05:00
billing Generate detail reports from Bigquery via Beam 2017-12-13 12:43:45 -05:00
braintree
builddefs
config Clean up some code quality issues 2017-12-01 22:14:06 -05:00
cron Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
dns Fetch data from Cloud DNS in parallel 2017-12-13 12:43:45 -05:00
eclipse
env Temporarily disable deleteProberData cron job in sandbox for load-testing 2017-12-01 22:14:06 -05:00
export Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
flows Append event year to poll message external IDs 2017-12-13 12:43:45 -05:00
gcs Use compound return statements for greater readability 2017-11-07 17:12:57 -05:00
groups Clean up some code quality issues 2017-12-01 22:14:06 -05:00
idn
keyring Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
loadtest Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
mapreduce Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
model Append event year to poll message external IDs 2017-12-13 12:43:45 -05:00
module Make FOSS build work with DummyKeyringModule 2017-12-01 22:14:06 -05:00
monitoring Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
pricing Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
proxy Open source GCP proxy 2017-11-21 19:19:03 -05:00
rdap Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
rde Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
reporting Clean up some code quality issues 2017-12-01 22:14:06 -05:00
request Clean up some code quality issues 2017-12-01 22:14:06 -05:00
security Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
storage/drive
tldconfig/idn Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
tmch Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
tools Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
ui Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
util Fetch data from Cloud DNS in parallel 2017-12-13 12:43:45 -05:00
whois Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
xjc Clean up some code quality issues 2017-12-01 22:14:06 -05:00
xml Remove unnecessary generic type arguments 2017-11-21 18:17:31 -05:00
BUILD
repositories.bzl Generate detail reports from Bigquery via Beam 2017-12-13 12:43:45 -05:00