Commit graph

75 commits

Author SHA1 Message Date
mcilwain
c5d09227c5 Refactor update snapshot view servlet into a Daggerized Action
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120224051
2016-05-13 17:40:12 -04:00
mcilwain
4fbf613955 Export entity integrity alerts to BigQuery
This is part 2 of a longer series.  Part 3 will add lots more tests, will add a cron entry, and will include an analysis script to run on BigQuery to detect the presence of two consecutive errors.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120040267
2016-05-13 17:40:08 -04:00
nickfelt
f20b1d89a9 Fix premium list command regressions
This CL fixes bugs introduced when the premium list commands were moved to
be server-side commands.

Fixes:

 - omitting the --name parameter actually works now; before it was failing
   in the local build() call since it uses the name as the @Id and tries to
   create a key for PremiumListRevision, but key IDs cannot be null.

 - premium list data larger than about 2K works now (see [] before
   it was stuffing the list data all into a POST query parameter, and URLs of
   more than 2K in length were all getting 404s.  Fix was changing it to put
   the inputData param in the POST body.

 - misc test cleanup
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119912494
2016-05-13 17:40:03 -04:00
mcilwain
625c34662b Remove launcher options to java_binary from open source release
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119897863
2016-05-13 17:39:57 -04:00
cgoldfeder
2fc636632b Turn on braintree in sandbox.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119890386
2016-05-13 17:39:52 -04:00
ctingue
4112bca925 Begin writing AUTO_RENEW flag alongside reason
Backfill [] to follow, and the Recurring billing events will eventually be replicated as OneTime via a regular job.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119883652
2016-05-13 17:39:47 -04:00
ctingue
fbe076b5da Implement input for MRs over child entities
Also throwing in a proof-of-concept MR that I'd like to run in production, and then scrap once the meaty MR is finished (e.g. exploding Recurring billing events into OneTimes).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119881471
2016-05-13 17:39:40 -04:00
ctingue
27c034c080 Change java launcher to JDK for module/*
Per https://groups.google.com[]forum/#!topic/[]-discuss/NfejII_D5dA, a default launcher change broke our GAE-deployed services.

Tested in alpha with no issues.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119790722
2016-05-13 17:39:18 -04:00
nickfelt
7c4b80f4d9 Remove no-longer-used AdminServletPathPrefix config value
We still have some paths under /_dr/admin (e.g. for server-side regtool
actions), but this actual config value isn't used anywhere ever since
we deleted the admin console in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119693711
2016-05-13 17:39:12 -04:00
mcilwain
ad90cdf82d Move MetricsTaskServlet runtime dep to backend
This is a follow-up to [] that corrects an oversight.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119683462
2016-05-13 17:39:08 -04:00
ctingue
e01edf261d Add a SYNTHETIC flag for BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119559193
2016-05-13 17:39:01 -04:00
mcilwain
755fce9e52 Consolidate BigQuery handling into one place
I'm writing a follow-up CL that will send integrity checking data to
BigQuery, and that is made a lot easier by centralizing the BigQuery
connection logic.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119375766
2016-05-13 17:38:56 -04:00
mcilwain
c880a042a7 Add command to re-save all environment entities
This is the tool we'll run after dumping everything in sandbox except
for Registrars, Registries, and RegistrarContacts, in order to
re-create the commit logs on said entities.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119369873
2016-05-13 17:38:50 -04:00
mcilwain
4b15d49f52 Add database invariant checker []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119162082
2016-05-13 17:38:34 -04:00
mcilwain
d213d9a114 Restore the number of load test queues to 10
I'm running a read-only load test right now and I was running into unacceptably low limits with only five load test queues to execute in.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119048442
2016-05-13 17:38:26 -04:00
mcilwain
e6d3f42e60 Make metrics export run on backend module
This fixes a previous issue where metrics generated on the
tools/backend modules weren't being successfully exported to BigQuery.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119047757
2016-05-13 17:38:21 -04:00
mcilwain
17c4ad83c8 Improve load test servlet
This adds better comments, sane defaults for most parameters, and
improved caching of test data.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118996436
2016-05-13 17:38:11 -04:00
mcilwain
45a194fd90 Merge tools/[] package into tools/server
There's no point in having this extra package exclusively for
[]s, especially because we already weren't being consistent and
had multiple []s in the tools/server package.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118807843
2016-05-13 17:38:06 -04:00
jart
dcbabd06a6 Sync registrar to Braintree customer record automatically
In order to set the customerId field on a payment, the customer entry
must exist in Braintree's database. This CL causes it to be created or
updated before processing the payment.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118530040
2016-05-13 17:38:00 -04:00
jart
b3125ae070 Move getTldFromDomainName into DomainNameUtils
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118475557
2016-05-13 17:37:32 -04:00
jart
4442f4c31b Improve documentation of TLD extraction routines
Some confusion came up in #9 over the proper way to extract TLDs from
hostnames. This should hopefully alleviate that.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118417091
2016-05-13 17:37:24 -04:00
cgoldfeder
ec2daec412 Adds the ability to whitelist registrants and nameservers on a TLD
This is needed for ROCC TLDs like .foo
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118404870
2016-05-13 17:37:17 -04:00
ctingue
f9e1bab1d2 Rename async flow failure backoff config property
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118207124
2016-05-13 17:37:10 -04:00
Hans Ridder
1194a81e91 Fixes "Insufficient permission" error in export-snapshot task
Removed "run_as_a_service" parameter from backup.create command in DatastoreBackupService.
This parameter can't be used externally, and is apparently no longer needed.
2016-04-20 17:33:06 -07:00
Wolfgang Meyers
fcaaee03c1 Make flows and registrar targets visible
Needed to reuse server-side XSRF protection
2016-04-11 09:37:59 -07:00
Hans Ridder
20f214b9d0 Adds DnsWriter that implements DNS UPDATE protocol
* DnsUpdateWriter publishes changes to NS, DS, A, AAAA records
  for domains/hosts as appropriate using RFC 2136 DNS UPDATE protocol
* Static configuration separate from RegistryConfig
* Include dnsjava library as new third party dependency
  to generate DNS protocol messages
* Expose /_dr/task/writeDns in RegistryTestServer
* Currently not included in BackendComponent
2016-04-06 08:56:54 -07:00
Justine Tunney
954d7e1e8f Merge pull request #5 from wolfgangmeyers/hermetically-sealed-eclipse
Hermetically sealed eclipse setup
2016-04-04 14:05:50 -04:00
Wolfgang Meyers
15222fc32f Use jar command from bazel in eclipse setup
Original eclipse setup used the jar command from the system path
which resulted in different behavior on different systems. This
change modifies the build target to use the jar command provided
by bazel: @local_jdk//:bin/jar
2016-03-28 12:40:20 -07:00
Justine Tunney
076c8d7e27 Update copyright notice to Domain Registry Authors 2016-03-24 17:52:56 -04:00
jart
89fa3caaba Add payment page link to Registrar Console
The payment page has also been updated to refuse to show itself if
the registrar is not set to credit card billing terms.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117983313
2016-03-23 22:38:08 -04:00
jart
b6b13333dd Pay off technical debt with ConsoleUiServlet
1. Turn ConsoleUiServlet into an action
2. Remove AbstractUiServlet, which fixes its threading bug
3. Use type-safe soy template parameters when rendering console

A follow-up change will add a new template parameter that renders the
payment page link on the navigation bar.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117969638
2016-03-23 22:38:08 -04:00
ctingue
79b2d5a990 Implement 10 min backoff for failed async deletes
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117945626
2016-03-23 22:38:08 -04:00
ctingue
62ca799b36 Add Flag.AUTO_RENEW to BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117821700
2016-03-23 22:38:08 -04:00
kak
0db3e13ef3 Replace Throwables.propagate with equivalent "throw e" or "throw new RuntimeException(e)."
We are removing all calls in preparation for deleting the method.

More information: []

Tested:
    TAP --sample for global presubmit queue
    []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117628955
2016-03-23 22:38:08 -04:00
mcilwain
980625f901 Fix web.xml file broken in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117591773
2016-03-23 22:38:08 -04:00
mountford
c25cfa626b RDAP: Include remarks only in object classes
The APNIC conformance checker points out that, according to RFC 7483,
RDAP remarks should be included only as part of object classes such as
domains, nameservers and entities, not in help responses and so on.

Note that something is amiss here -- If RFC 7483 is read strictly, the
remarks boilerplate for domain, nameserver and entity search results
should appear not at the top level, as we currently do, but as part of
each constituent object. However, the conformance checker does not
seem to complain about that. So I have added this to the RDAP questions
list, and am leaving the boilerplate at the top level for now.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117557594
2016-03-23 22:38:08 -04:00
mcilwain
c8d655e416 Add ability to manually trigger contact group syncs
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117549773
2016-03-23 22:38:08 -04:00
mcilwain
9f548674b7 Use fewer simultaneous connections to Directory API
Ten turns out to have been set too high; that will occasionally throw
500 Backend errors from the API (presumably having to do with
rate-limiting).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117549363
2016-03-23 22:38:08 -04:00
mountford
68c0f4647f RDAP: Add event records to responses
RFC 7483 defines a way to attach events (such as registration, renewal, etc.) to domains, nameservers and entities. The ICANN Profile calls out particular events: registration, expiration, last changed and last update. This CL implements all the ICANN-defined events except last update (defined to be the last update time of the database), which doesn't make so much sense in our system.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117546838
2016-03-23 22:38:08 -04:00
mcilwain
2293be4079 Automatically create mailing lists for registrars
This improves one of our gTech processes so they no longer have to remember to create Google Groups for a registrar after creating that registrar.

The ConfirmingCommand.verify() method is renamed to be more general purpose, so that it can do anything that follows naturally after a successful execution, such as creating Google Groups groups.

Minor refactoring is done around RegistryToolEnvironment handling for tests to make it more bullet-proof and general case.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117494277
2016-03-23 22:38:08 -04:00
nickfelt
5174c1c63f Improve RegistryToolEnvironment setup behavior
Here's an alternate approach that I think simplifies the existing
code quite a bit.  Now instead of doing:

  RegistryToolEnvironment.loadFromArgs(args);
  RegistryToolEnvironment.get().setup();

You just do one chained call:

  RegistryToolEnvironment.parseFromArgs(args).setup();

or call setup() on a known environment constant:

  RegistryToolEnvironment.ALPHA.setup();

This avoids having loadFromArgs() implicitly set the active env
(but *not* do setup) and then having setup() *not* set the active
env, both of which were confusing.  Now parseFromArgs() is only
responsible for parsing from args, and setup() both sets the env
as the active one and does the environment variable setup (which
also ensures that the RegistryToolEnvironment.instance field
doesn't get out of sync with the RegistryEnvironment value).

In addition, this CL adds a runCommandInEnvironment() method to
CommandTestCase and ensures that the UNITTEST environment is always
set before constructing the default command instance.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117492978
2016-03-23 22:38:08 -04:00
mcilwain
99a50f7972 Remove EppResource.SharedFields following successful data migration
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117412736
2016-03-23 22:38:08 -04:00
mcilwain
401df6c34a Set # of reducer shards on ExportDomainLists []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117403604
2016-03-23 22:38:08 -04:00
Justine Tunney
a31a626b16 Merge pull request #6 from wolfgangmeyers/java7-compatibility-fix
Make ForeignKeyIndex java 7 compatible
2016-03-16 21:26:52 -04:00
cgoldfeder
cd13aa8a96 Removes fixed TODO
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117278234
2016-03-16 21:20:25 -04:00
cgoldfeder
847dac792a Clean up duped servlets in web.xml files
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117277821
2016-03-16 21:20:25 -04:00
mcilwain
702c5b9692 Annihilate the annihilator []
I am become Ben, annihilator of annihilators.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117275133
2016-03-16 21:20:25 -04:00
ctingue
d82ac03c8c Delete duplicate MR inputs files
This is cleanup from [] -- when I set up the hint, these files were recreated inadvertently. All other code is already fixed to use the classes in []/inputs.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117270147
2016-03-16 21:20:25 -04:00
ctingue
77dd730400 Break out EppResourceInput subclasses
This frankenclass was starting to get a little cluttered, especially once I add the ChildEntityInput/Reader.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117266882
2016-03-16 21:20:25 -04:00
mcilwain
57fa57968d Rename Runnable classes from Tasks to Actions
This is cleanup relating to a naming decision that we made awhile ago
but never got around to.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117244827
2016-03-16 21:20:25 -04:00