Commit graph

65 commits

Author SHA1 Message Date
ctingue
e01edf261d Add a SYNTHETIC flag for BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119559193
2016-05-13 17:39:01 -04:00
mcilwain
755fce9e52 Consolidate BigQuery handling into one place
I'm writing a follow-up CL that will send integrity checking data to
BigQuery, and that is made a lot easier by centralizing the BigQuery
connection logic.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119375766
2016-05-13 17:38:56 -04:00
mcilwain
c880a042a7 Add command to re-save all environment entities
This is the tool we'll run after dumping everything in sandbox except
for Registrars, Registries, and RegistrarContacts, in order to
re-create the commit logs on said entities.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119369873
2016-05-13 17:38:50 -04:00
mcilwain
4b15d49f52 Add database invariant checker []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119162082
2016-05-13 17:38:34 -04:00
mcilwain
d213d9a114 Restore the number of load test queues to 10
I'm running a read-only load test right now and I was running into unacceptably low limits with only five load test queues to execute in.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119048442
2016-05-13 17:38:26 -04:00
mcilwain
e6d3f42e60 Make metrics export run on backend module
This fixes a previous issue where metrics generated on the
tools/backend modules weren't being successfully exported to BigQuery.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119047757
2016-05-13 17:38:21 -04:00
mcilwain
17c4ad83c8 Improve load test servlet
This adds better comments, sane defaults for most parameters, and
improved caching of test data.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118996436
2016-05-13 17:38:11 -04:00
mcilwain
45a194fd90 Merge tools/[] package into tools/server
There's no point in having this extra package exclusively for
[]s, especially because we already weren't being consistent and
had multiple []s in the tools/server package.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118807843
2016-05-13 17:38:06 -04:00
jart
dcbabd06a6 Sync registrar to Braintree customer record automatically
In order to set the customerId field on a payment, the customer entry
must exist in Braintree's database. This CL causes it to be created or
updated before processing the payment.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118530040
2016-05-13 17:38:00 -04:00
jart
b3125ae070 Move getTldFromDomainName into DomainNameUtils
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118475557
2016-05-13 17:37:32 -04:00
jart
4442f4c31b Improve documentation of TLD extraction routines
Some confusion came up in #9 over the proper way to extract TLDs from
hostnames. This should hopefully alleviate that.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118417091
2016-05-13 17:37:24 -04:00
cgoldfeder
ec2daec412 Adds the ability to whitelist registrants and nameservers on a TLD
This is needed for ROCC TLDs like .foo
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118404870
2016-05-13 17:37:17 -04:00
ctingue
f9e1bab1d2 Rename async flow failure backoff config property
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118207124
2016-05-13 17:37:10 -04:00
Hans Ridder
1194a81e91 Fixes "Insufficient permission" error in export-snapshot task
Removed "run_as_a_service" parameter from backup.create command in DatastoreBackupService.
This parameter can't be used externally, and is apparently no longer needed.
2016-04-20 17:33:06 -07:00
Wolfgang Meyers
fcaaee03c1 Make flows and registrar targets visible
Needed to reuse server-side XSRF protection
2016-04-11 09:37:59 -07:00
Hans Ridder
20f214b9d0 Adds DnsWriter that implements DNS UPDATE protocol
* DnsUpdateWriter publishes changes to NS, DS, A, AAAA records
  for domains/hosts as appropriate using RFC 2136 DNS UPDATE protocol
* Static configuration separate from RegistryConfig
* Include dnsjava library as new third party dependency
  to generate DNS protocol messages
* Expose /_dr/task/writeDns in RegistryTestServer
* Currently not included in BackendComponent
2016-04-06 08:56:54 -07:00
Justine Tunney
954d7e1e8f Merge pull request #5 from wolfgangmeyers/hermetically-sealed-eclipse
Hermetically sealed eclipse setup
2016-04-04 14:05:50 -04:00
Wolfgang Meyers
15222fc32f Use jar command from bazel in eclipse setup
Original eclipse setup used the jar command from the system path
which resulted in different behavior on different systems. This
change modifies the build target to use the jar command provided
by bazel: @local_jdk//:bin/jar
2016-03-28 12:40:20 -07:00
Justine Tunney
076c8d7e27 Update copyright notice to Domain Registry Authors 2016-03-24 17:52:56 -04:00
jart
89fa3caaba Add payment page link to Registrar Console
The payment page has also been updated to refuse to show itself if
the registrar is not set to credit card billing terms.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117983313
2016-03-23 22:38:08 -04:00
jart
b6b13333dd Pay off technical debt with ConsoleUiServlet
1. Turn ConsoleUiServlet into an action
2. Remove AbstractUiServlet, which fixes its threading bug
3. Use type-safe soy template parameters when rendering console

A follow-up change will add a new template parameter that renders the
payment page link on the navigation bar.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117969638
2016-03-23 22:38:08 -04:00
ctingue
79b2d5a990 Implement 10 min backoff for failed async deletes
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117945626
2016-03-23 22:38:08 -04:00
ctingue
62ca799b36 Add Flag.AUTO_RENEW to BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117821700
2016-03-23 22:38:08 -04:00
kak
0db3e13ef3 Replace Throwables.propagate with equivalent "throw e" or "throw new RuntimeException(e)."
We are removing all calls in preparation for deleting the method.

More information: []

Tested:
    TAP --sample for global presubmit queue
    []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117628955
2016-03-23 22:38:08 -04:00
mcilwain
980625f901 Fix web.xml file broken in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117591773
2016-03-23 22:38:08 -04:00
mountford
c25cfa626b RDAP: Include remarks only in object classes
The APNIC conformance checker points out that, according to RFC 7483,
RDAP remarks should be included only as part of object classes such as
domains, nameservers and entities, not in help responses and so on.

Note that something is amiss here -- If RFC 7483 is read strictly, the
remarks boilerplate for domain, nameserver and entity search results
should appear not at the top level, as we currently do, but as part of
each constituent object. However, the conformance checker does not
seem to complain about that. So I have added this to the RDAP questions
list, and am leaving the boilerplate at the top level for now.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117557594
2016-03-23 22:38:08 -04:00
mcilwain
c8d655e416 Add ability to manually trigger contact group syncs
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117549773
2016-03-23 22:38:08 -04:00
mcilwain
9f548674b7 Use fewer simultaneous connections to Directory API
Ten turns out to have been set too high; that will occasionally throw
500 Backend errors from the API (presumably having to do with
rate-limiting).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117549363
2016-03-23 22:38:08 -04:00
mountford
68c0f4647f RDAP: Add event records to responses
RFC 7483 defines a way to attach events (such as registration, renewal, etc.) to domains, nameservers and entities. The ICANN Profile calls out particular events: registration, expiration, last changed and last update. This CL implements all the ICANN-defined events except last update (defined to be the last update time of the database), which doesn't make so much sense in our system.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117546838
2016-03-23 22:38:08 -04:00
mcilwain
2293be4079 Automatically create mailing lists for registrars
This improves one of our gTech processes so they no longer have to remember to create Google Groups for a registrar after creating that registrar.

The ConfirmingCommand.verify() method is renamed to be more general purpose, so that it can do anything that follows naturally after a successful execution, such as creating Google Groups groups.

Minor refactoring is done around RegistryToolEnvironment handling for tests to make it more bullet-proof and general case.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117494277
2016-03-23 22:38:08 -04:00
nickfelt
5174c1c63f Improve RegistryToolEnvironment setup behavior
Here's an alternate approach that I think simplifies the existing
code quite a bit.  Now instead of doing:

  RegistryToolEnvironment.loadFromArgs(args);
  RegistryToolEnvironment.get().setup();

You just do one chained call:

  RegistryToolEnvironment.parseFromArgs(args).setup();

or call setup() on a known environment constant:

  RegistryToolEnvironment.ALPHA.setup();

This avoids having loadFromArgs() implicitly set the active env
(but *not* do setup) and then having setup() *not* set the active
env, both of which were confusing.  Now parseFromArgs() is only
responsible for parsing from args, and setup() both sets the env
as the active one and does the environment variable setup (which
also ensures that the RegistryToolEnvironment.instance field
doesn't get out of sync with the RegistryEnvironment value).

In addition, this CL adds a runCommandInEnvironment() method to
CommandTestCase and ensures that the UNITTEST environment is always
set before constructing the default command instance.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117492978
2016-03-23 22:38:08 -04:00
mcilwain
99a50f7972 Remove EppResource.SharedFields following successful data migration
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117412736
2016-03-23 22:38:08 -04:00
mcilwain
401df6c34a Set # of reducer shards on ExportDomainLists []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117403604
2016-03-23 22:38:08 -04:00
Justine Tunney
a31a626b16 Merge pull request #6 from wolfgangmeyers/java7-compatibility-fix
Make ForeignKeyIndex java 7 compatible
2016-03-16 21:26:52 -04:00
cgoldfeder
cd13aa8a96 Removes fixed TODO
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117278234
2016-03-16 21:20:25 -04:00
cgoldfeder
847dac792a Clean up duped servlets in web.xml files
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117277821
2016-03-16 21:20:25 -04:00
mcilwain
702c5b9692 Annihilate the annihilator []
I am become Ben, annihilator of annihilators.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117275133
2016-03-16 21:20:25 -04:00
ctingue
d82ac03c8c Delete duplicate MR inputs files
This is cleanup from [] -- when I set up the hint, these files were recreated inadvertently. All other code is already fixed to use the classes in []/inputs.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117270147
2016-03-16 21:20:25 -04:00
ctingue
77dd730400 Break out EppResourceInput subclasses
This frankenclass was starting to get a little cluttered, especially once I add the ChildEntityInput/Reader.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117266882
2016-03-16 21:20:25 -04:00
mcilwain
57fa57968d Rename Runnable classes from Tasks to Actions
This is cleanup relating to a naming decision that we made awhile ago
but never got around to.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117244827
2016-03-16 21:20:25 -04:00
cgoldfeder
5f7bf57cf9 Replaces uses of java.net.IDN with our Idn stand in class
java.net.IDN uses outdated IDNA2003. We've created a replacement
class that uses the modern UTS46 transitional standard via the
IDNA library. This fixes uses of IDN in the RDAP code.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117243868
2016-03-16 21:20:25 -04:00
jart
46e02c6bd1 Use rel="noopener" when appropriate
We're not vulnerable. But it's a good security practice.

https://mathiasbynens.github.io/rel-noopener/
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117240907
2016-03-16 21:20:25 -04:00
nickfelt
7e80b5646f Make Cancellation OneTime vs Recurring logic explicit
This CL does a very similar cleanup to Cancellation as the diffbase
does to GracePeriod - see []  It simplifes logic where we
used to overload methods to accept eitherw OneTime or Recurring billing
events refs, despite storing them in separate fields in the entity
(since BillingEvent is not a polymorphic superclass, just a Java-only
one, you can't store them as refs to BillingEvent).

That overloading was ultimately only there as a convenience/hack from
when we added Recurring events and didn't want to go back and change
everything.  It obfuscates what's really going on, requires extra
casting/loss of type-safety, and relies on indirect signals (e.g. the
Billing event reason being AUTO_RENEW) to guess what the right billing
event type is.  That latter aspect will likely no longer work in a
monthly billing world, and was brittle anyways (as came up in the
context of removing the AUTO_RENEW reason - see []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117165174
2016-03-16 21:20:25 -04:00
nickfelt
9786e6732f Make GracePeriod OneTime vs Recurring logic explicit
This CL cleans up some old crufy logic in GracePeriod that overloaded
methods to accept either OneTime or Recurring billing events refs,
despite storing them in separate fields in the entity (since
BillingEvent is not a polymorphic superclass, just a Java-only one,
you can't store them as refs to BillingEvent).

That overloading was ultimately only there as a convenience/hack from
when we added Recurring events and didn't want to go back and change
everything.  It obfuscates what's really going on, requires extra
casting/loss of type-safety, and relies on indirect signals (e.g. the
grace period type being AUTO_RENEW) to guess what the right billing
event type is.  That latter aspect will likely no longer work in a
monthly billing world, and was brittle in any case.

A coming CL will rip the same logic out of Cancellation.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117164286
2016-03-16 21:20:25 -04:00
ctingue
d006506531 Drop unnecessary typecast in CidrAddressBlock
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117002905
2016-03-16 21:20:25 -04:00
nickfelt
f898d551e4 Remove unneeded type params in EppResourceInput nested classes
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=116997558
2016-03-16 21:20:25 -04:00
Wolfgang Meyers
e97eb1eeef Make ForeignKeyIndex java 7 compatible
ForeignKeyIndex.java would not compile when building with bazel
and targeting 1.7. This change fixes the build issue.
2016-03-16 15:59:43 +00:00
jart
f2116093b1 Delete admin console
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=116894352
2016-03-10 16:48:39 -05:00
jart
6772b2ef80 Move VerifyOteAction to tools/server
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=116825910
2016-03-10 16:48:39 -05:00
jart
3eef39126d Add Registrar client ID to Braintree payment info
The client ID is passed as the "customer ID" to Braintree. In order for
this to work, someone needs to go into the Braintree website beforehand,
click on "New Customer" link, and create the customer record with a
matching ID.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=116769955
2016-03-10 16:48:39 -05:00