zydronium/google-nomulus
1
0
Fork 0
mirror of https://github.com/google/nomulus.git synced 2025-08-01 23:42:12 +02:00
Code Issues Projects Releases Packages Wiki Activity
google-nomulus/javatests/google/registry
History
guyben d87f01e7bf Fetch data from Cloud DNS in parallel 
Before pushing an update to Cloud DNS, the CloudDnsWriter needs to read all the domain RRSs from Cloud DNS one by one to know what to delete.

Doing so sequentially results in update times that are too long (approx 200ms per domain, which is 20 seconds per batch of 100) severely limiting our QPS.

This CL uses Concurrent threading to do the Cloud DNS queries in parallel. Unfortunately, my preferred method (Set.parallelStream) doesn't work on App Engine :(

This reduces the per-item time from 200ms to 80ms, which can be further reduced to 50ms if we remove the rate limiter (currently set to 20 per second).

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=178126877
2017-12-13 12:43:45 -05:00
..
backup Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
batch Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
bigquery Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
billing Generate detail reports from Bigquery via Beam 2017-12-13 12:43:45 -05:00
builddefs Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
config Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
cron Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
dns Fetch data from Cloud DNS in parallel 2017-12-13 12:43:45 -05:00
export Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
flows Append event year to poll message external IDs 2017-12-13 12:43:45 -05:00
groups Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
keyring Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
mapreduce/inputs Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
model Append event year to poll message external IDs 2017-12-13 12:43:45 -05:00
module Add apache beam to registry and open source 2017-11-07 17:36:07 -05:00
monitoring Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
pricing Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
proxy Open source GCP proxy 2017-11-21 19:19:03 -05:00
rdap Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
rde Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
reporting Rename all testdata loading files to conform to a single naming scheme 2017-12-01 22:14:06 -05:00
request Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
security Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
server Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
storage/drive Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
testing Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
tldconfig/idn Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
tmch Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
tools Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
ui Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
util Clean up some code quality issues 2017-12-01 22:14:06 -05:00
whois Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
xjc Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
xml Clean up test "load resources" methods and classes 2017-12-01 22:14:05 -05:00