google-nomulus/javatests/google/registry
mcilwain 3f1a8eebdc Decrease flakiness of multipart TLD lifecycle tests
As part of our commit log layer that we have built on top of Objectify, we
enforce the constraint of a monotonically increasing transaction time with a
millisecond granularity. Thus, if two transactions occur at exactly the same
millisecond, as had been the case with these tests, one will get a
TimestampInversionException and retry. However, since we're mocking time in
these tests as well, they will retry at exactly the same millisecond, and thus
continue failing for the same reason until the max retry threshold is hit. The
EPP flow then ultimately fails with a generic "Command failed" response. All
of this is actual findings from looking at test logs from a flake.

It's a mystery to me why these tests were merely flaky; it seems like they
should have always been failing for this reason, but they were still only
sometimes failing. Who knows.

The fix is simple -- Adjust the tests so that no two commands are run at exactly
the same millisecond. Note that this is a test-only problem; in the real world,
a command that temporarily fails will simply then succeed the next time it is
retried, since time is actually elapsing. This implies that our commit log system
imposes a max mutation rate of 1,000 QPS across our entire system. This is
unlikely to be a problem in practice for any existing registry of any size.

Also note that, as far the EPP XML itself is concerned, times only have second
granularity, so up to a thousand commands can execute in the same second and
still "appear" to have taken place at the same time as far as EPP is concerned.
That's why this CL only adds millisecond precision to the actual run time, not
to the expected values in the commands.

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=184777558
2018-02-20 15:20:22 -05:00
..
backup Rationalize logging statements across codebase 2018-01-19 14:56:45 -05:00
batch Migrate final try/catch test assertions to use assert/expectThrows 2018-01-19 14:43:12 -05:00
beam Move invoice generation to billing bucket and improve emailing 2018-01-19 14:34:14 -05:00
bigquery Automatically refactor more exception testing to use new JUnit rules 2017-12-27 10:42:36 -05:00
builddefs Update copyright year on all license headers 2017-02-02 16:27:22 -05:00
config Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
cron Automatically refactor more exception testing to use new JUnit rules 2017-12-27 10:42:36 -05:00
dns Fix in-baliwick nameserver check bug in CloudDnsWriter 2018-02-20 15:15:57 -05:00
export Migrate final try/catch test assertions to use assert/expectThrows 2018-01-19 14:43:12 -05:00
flows Decrease flakiness of multipart TLD lifecycle tests 2018-02-20 15:20:22 -05:00
groups Use method references when possible 2017-12-27 11:25:02 -05:00
keyring Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
mapreduce/inputs Migrate final try/catch test assertions to use assert/expectThrows 2018-01-19 14:43:12 -05:00
model Remove leniency on poll message ID format without years in them 2018-02-20 15:12:43 -05:00
module Refactor ICANN reporting and billing into common package 2018-02-01 21:56:06 -05:00
monitoring/whitebox Add dependencies on classes that are not in the default modules in JDK 9 2018-02-01 22:00:49 -05:00
pricing Automatically refactor more exception testing to use new JUnit rules 2017-12-27 10:42:36 -05:00
proxy Add TokenStore and QuotaManager to manage proxy quota requests 2018-01-19 14:46:44 -05:00
rdap Add dependencies on classes that are not in the default modules in JDK 9 2018-02-01 22:00:49 -05:00
rde Add //third_party/java/jaxb dependency to targets using javax.xml.bind 2018-01-23 16:18:35 -05:00
reporting Refactor ICANN reporting and billing into common package 2018-02-01 21:56:06 -05:00
request Remove unnecessary type specifications 2017-12-27 11:23:03 -05:00
security Remove more unused Truth8.assertThat() static imports in tests 2017-11-07 17:22:56 -05:00
server Move backported JUnit file to third_party (part 2) 2017-12-02 11:37:46 -05:00
storage/drive Remove unnecessary type specifications 2017-12-27 11:23:03 -05:00
testing Rationalize logging statements across codebase 2018-01-19 14:56:45 -05:00
tldconfig/idn Remove unnecessary type specifications 2017-12-27 11:23:03 -05:00
tmch Use method references instead of lambdas when possible 2017-12-27 10:55:03 -05:00
tools Delete obsolete billing code 2018-02-20 15:09:45 -05:00
ui Replace uses of @code in Javascript documentation with Markdown backticks 2018-02-05 23:51:49 -05:00
util Replace com.google.common.base.Function with java.util.function.Function 2017-12-27 11:08:55 -05:00
whois Migrate final try/catch test assertions to use assert/expectThrows 2018-01-19 14:43:12 -05:00
xjc Automatically refactor more exception testing to use new JUnit rules 2017-12-27 10:42:36 -05:00
xml Add basic AllocationToken validation/redemption for domain creates 2018-01-19 14:28:26 -05:00