Commit graph

302 commits

Author SHA1 Message Date
kak
2dfffba1ee Inline remaining usages of Throwables.propagate. We are removing all calls in preparation for deleting the method.
More information: []

Tested:
    $ [] test //third_party/java_src/gtld/javatests/google/registry/bigquery:BigqueryUtilsTest //third_party/java_src/gtld/javatests/google/registry/cron:CommitLogFanoutActionTest //third_party/java_src/gtld/javatests/google/registry/dns:ReadDnsQueueActionTest //third_party/java_src/gtld/javatests/google/registry/documentation:FlowExceptionsTest //third_party/java_src/gtld/javatests/google/registry/export:BigqueryPollJobActionTest //third_party/java_src/gtld/javatests/google/registry/export:DatastoreBackupServiceTest //third_party/java_src/gtld/javatests/google/registry/export:ExportSnapshotServletTest //third_party/java_src/gtld/javatests/google/registry/export:SyncGroupMembersActionTest //third_party/java_src/gtld/javatests/google/registry/export:UpdateSnapshotViewActionTest //third_party/java_src/gtld/javatests/google/registry/flows:EppConsoleAsAdminServletTest //third_party/java_src/gtld/javatests/google/registry/flows:EppControllerTest //third_party/java_src/gtld/javatests/google/registry/flows:EppTlsServletTest //third_party/java_src/gtld/javatests/google/registry/flows:contact/ContactCheckFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:contact/ContactTransferCancelFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:domain/DomainAllocateFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:domain/DomainApplicationDeleteFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:domain/DomainDeleteFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:domain/DomainRestoreRequestFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:domain/DomainTransferApproveFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:host/HostCreateFlowTest //third_party/java_src/gtld/javatests/google/registry/flows:session/LoginFlowViaTlsTest //third_party/java_src/gtld/javatests/google/registry/flows:session/LogoutFlowTest //third_party/java_src/gtld/javatests/google/registry/[]/inputs:EppResourceInputsTest //third_party/java_src/gtld/javatests/google/registry/model:CreateAutoTimestampTest //third_party/java_src/gtld/javatests/google/registry/model:RoidSuffixesTest //third_party/java_src/gtld/javatests/google/registry/model:UpdateAutoTimestampTest //third_party/java_src/gtld/javatests/google/registry/model:billing/BillingEventTest //third_party/java_src/gtld/javatests/google/registry/model:contact/ContactResourceTest //third_party/java_src/gtld/javatests/google/registry/model:domain/DomainApplicationTest //third_party/java_src/gtld/javatests/google/registry/model:domain/DomainResourceTest //third_party/java_src/gtld/javatests/google/registry/model:export/LogsExportCursorTest //third_party/java_src/gtld/javatests/google/registry/model:ofy/OfyCommitLogTest //third_party/java_src/gtld/javatests/google/registry/model:ofy/OfyTest //third_party/java_src/gtld/javatests/google/registry/model:poll/PollMessageExternalKeyConverterTest //third_party/java_src/gtld/javatests/google/registry/model:rde/RdeNamingUtilsTest //third_party/java_src/gtld/javatests/google/registry/model:registry/RegistryCursorTest //third_party/java_src/gtld/javatests/google/registry/model:registry/label/PremiumListTest //third_party/java_src/gtld/javatests/google/registry/model:registry/label/ReservedListTest //third_party/java_src/gtld/javatests/google/registry/model:server/LockTest //third_party/java_src/gtld/javatests/google/registry/model:smd/SignedMarkRevocationListTest //third_party/java_src/gtld/javatests/google/registry/model:tmch/ClaimsListShardTest //third_party/java_src/gtld/javatests/google/registry/monitoring/blackbox:EppClientConnectionTest //third_party/java_src/gtld/javatests/google/registry/monitoring/blackbox:EppRunnableProberTest //third_party/java_src/gtld/javatests/google/registry/monitoring/blackbox:WhoisQueryTest //third_party/java_src/gtld/javatests/google/registry/rdap:RdapActionBaseTest //third_party/java_src/gtld/javatests/google/registry/rdap:RdapJsonFormatterTest //third_party/java_src/gtld/javatests/google/registry/rdap:RdapSearchPatternTest //third_party/java_src/gtld/javatests/google/registry/rde:DomainResourceToXjcConverterTest //third_party/java_src/gtld/javatests/google/registry/request:JsonResponseTest //third_party/java_src/gtld/javatests/google/registry/tmch:NordnVerifyActionTest //third_party/java_src/gtld/javatests/google/registry/tmch:TmchCrlActionTest //third_party/java_src/gtld/javatests/google/registry/tools/params:DurationParameterTest //third_party/java_src/gtld/javatests/google/registry/tools/params:MoneyParameterTest //third_party/java_src/gtld/javatests/google/registry/tools/params:PathParameterTest //third_party/java_src/gtld/javatests/google/registry/tools/server:CreateGroupsActionTest //third_party/java_src/gtld/javatests/google/registry/tools/server:DeleteEntityActionTest //third_party/java_src/gtld/javatests/google/registry/tools:CreateContactCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:CreateCreditBalanceCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:CreateReservedListCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:CreateTldCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:DeletePremiumListCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:DomainApplicationInfoCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:DomainCheckCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:EncryptEscrowDepositCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:GenerateAuctionDataCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:GetDomainCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:GetTldCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:ListDomainsCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:ListRegistrarsCommandTest //third_party/java_src/gtld/javatests/google/registry/tools:RegistryToolEnvironmentTest //third_party/java_src/gtld/javatests/google/registry/ui/server/registrar:RegistrarServletTest //third_party/java_src/gtld/javatests/google/registry/util:RetrierTest //third_party/java_src/gtld/javatests/google/registry/util:SendEmailUtilsTest //third_party/java_src/gtld/javatests/google/registry/util:UrlFetchUtilsTest //third_party/java_src/gtld/javatests/google/registry/xjc:XjcObjectTest
    []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=121294781
2016-05-13 23:18:02 -04:00
Michael Muller
05803bbc33 Add a throw-away tool to remove IP addresses of external hosts
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=121279715
2016-05-13 23:17:26 -04:00
jart
b672643194 Remove patharg classes
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=121238717
2016-05-13 23:16:29 -04:00
jart
6082146d55 Prefer re2 over java.util.regex
Java's stock regex implementation doesn't guarantee linear time
complexity which makes it a security liability.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=121159875
2016-05-13 23:16:07 -04:00
dxy
3291eb8b70 Make new source tree visible from internal release files
d/r/release is currently unable to see the new source tree, thus build fails
with [] files in the new location.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=121140336
2016-05-13 23:16:01 -04:00
Michael Muller
c458c05801 Rename Java packages to use the .google TLD
The dark lord Gosling designed the Java package naming system so that
ownership flows from the DNS system. Since we own the domain name
registry.google, it seems only appropriate that we should use
google.registry as our package name.
2016-05-13 20:04:42 -04:00
Justine Tunney
5012893c1d mv com/google/domain/registry google/registry
This change renames directories in preparation for the great package
rename. The repository is now in a broken state because the code
itself hasn't been updated. However this should ensure that git
correctly preserves history for each file.
2016-05-13 18:55:08 -04:00
cgoldfeder
a41677aea1 Action to delete all cross-tld entities.
Plus refactoring of the KillAllXXXActions and tests to share
common code.

This essentially completes the KillAll []s. We can now reliably
clean out everything except for:
 * Lock - harmless to leave alone or delete from the gae console
 * GaeUserIdConverter - same
 * RdeRevision - filed [] to track, but harmless if not cleaned up
 * ForeignKeyHostIndex of renamed hosts - tracked in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120781975
2016-05-13 17:42:16 -04:00
mcilwain
ac2f17e10f Make snapshot export modules use parameters, not headers
This fixes a regression introduced in the Daggerization change-over in
[] and [] which incorrectly switched to using
headers instead of sticking with parameters.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120751832
2016-05-13 17:42:10 -04:00
mcilwain
894aaa5d68 Add code documentation on how the snapshot actions interact
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120707865
2016-05-13 17:42:01 -04:00
mcilwain
7c43b1d89b Fix web.xml servlet entry for LoadSnapshotAction
This should have gone in with []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120671591
2016-05-13 17:41:42 -04:00
mcilwain
e14faaa7e6 Use Multimap bindings to construct BigQuery schema map
This refactoring allows the schemas to live in the same package they
are used, rather than all having to be inside the bigquery package.
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120551011
2016-05-13 17:41:36 -04:00
mcilwain
d65bf2a714 Daggerize/Actionize the load snapshot servlet
This is needed to eliminate the last non-injected use of BigqueryFactory.  It gets rid of the deprecated HttpServletUtils now that we don't have lots of separate servlets, and changes the check snapshot servlet's usage of such.  It also fixes up some related minor style issues in the update snapshot action (and its injectable parameters).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120547998
2016-05-13 17:41:28 -04:00
mcilwain
9e7934684e Change WHOIS functionality to return PDT registrars
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120448012
2016-05-13 17:41:23 -04:00
cgoldfeder
9ca191f3d4 Registry should not be a BackupGroupRoot
In [] I made Registry a BGR in prep for each Registry being in
its own entity group. But we decided not to do that, and in []
mcilwain@ moved Registry under the cross-tld root. So there's no reason
for Registry to implement BackupGroupRoot anymore.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120402417
2016-05-13 17:41:18 -04:00
jart
36ab6c15fe Add Braintree prod merchant ID
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120400330
2016-05-13 17:41:13 -04:00
nickfelt
3a3f112454 Whitelist credit creations commands for gTech
See bug for context.  This way gTech can create credits in the future
without our intervention.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120382506
2016-05-13 17:41:08 -04:00
jart
9c8e23ea57 Really enable payment page in sandbox
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120372049
2016-05-13 17:41:03 -04:00
cgoldfeder
4e6c8ec6fe Fix WHOIS formatting to match format from RA
Our whois format was flagged as wrong in the .meet PDT. Although
we had followed the AWIP samples from ICANN, the definitive list
of field names is from Specification 4 of our contract, available at
https://newgtlds.icann.org/sites/default/files/agreements/agreement-approved-09jan14-en.htm
and indeed our fields are incorrect. (The remaining formatting issues
are ambiguous but the PDT testers' interpretation is probably correct.)

Since the footer format is now somewhat more complicated, I also denormalized
the disclaimer field into all of the testdata files. (I spent some time
debugging an extra newline between the content and the disclaimer, and
it would have been far clearer to solve if the files had been this way.)
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120338930
2016-05-13 17:40:58 -04:00
cgoldfeder
c99711c7e3 Augment KillAllCommitLogsAction to also kill checkpoints
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120338924
2016-05-13 17:40:51 -04:00
ctingue
145de1d4db Drop LegacyStatusValue from StatusValue
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120332716
2016-05-13 17:40:46 -04:00
cgoldfeder
5d88962258 Add real batching to KillAllXXXActions, and fix nits
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120272836
2016-05-13 17:40:41 -04:00
ctingue
67a604654c Create MR for backfilling billing AUTO_RENEW flag
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120261970
2016-05-13 17:40:36 -04:00
cgoldfeder
6f72af2ba6 A tool to visualize the layout of our schema in datastore.
The output on the current schema is:

CommitLogBucket (not backed up)
  ↳ CommitLogManifest (not backed up)
    ↳ CommitLogMutation (not backed up)

CommitLogCheckpointRoot (not backed up)
  ↳ CommitLogCheckpoint (not backed up)

DomainApplicationIndex (bgr)

EntityGroupRoot (bgr)
  ↳ ClaimsListShard.ClaimsListSingleton (not backed up)
    ↳ ClaimsListShard.ClaimsListRevision (virtual)
      ↳ ClaimsListShard (not backed up)
  ↳ LogsExportCursor
  ↳ PremiumList
    ↳ PremiumList.PremiumListRevision (virtual)
      ↳ PremiumList.PremiumListEntry
  ↳ Registrar
    ↳ RegistrarBillingEntry
    ↳ RegistrarContact
    ↳ RegistrarCredit
      ↳ RegistrarCreditBalance
  ↳ Registry (bgr)
    ↳ RegistryCursor
  ↳ ReservedList
  ↳ ServerSecret (not backed up)
  ↳ SignedMarkRevocationList (not backed up)
  ↳ TmchCrl (not backed up)

EppResource (abstract) (bgr)
  - ContactResource
  - DomainBase
    - DomainApplication (subclass)
    - DomainResource (subclass)
  - HostResource
  ↳ HistoryEntry
    ↳ BillingEvent.Cancellation
    ↳ BillingEvent.Modification
    ↳ BillingEvent.OneTime
    ↳ BillingEvent.Recurring
    ↳ PollMessage (abstract)
      - PollMessage.Autorenew (subclass)
      - PollMessage.OneTime (subclass)

EppResourceIndexBucket (virtual)
  ↳ EppResourceIndex (bgr)

ForeignKeyIndex.ForeignKeyContactIndex (bgr)

ForeignKeyIndex.ForeignKeyDomainIndex (bgr)

ForeignKeyIndex.ForeignKeyHostIndex (bgr)

GaeUserIdConverter (not backed up)

Lock (not backed up)

RdeRevision
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120251537
2016-05-13 17:40:31 -04:00
mcilwain
4ba8c0e552 Use HttpException for error handling in UpdateSnapshotViewAction
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120238590
2016-05-13 17:40:26 -04:00
mcilwain
0f4a1035b2 Refactor metrics servlet to be a Daggerized action
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120235694
2016-05-13 17:40:21 -04:00
nickfelt
706f3b44ed Enforce currency consistency for server status billing cost
Also adds tests for currency consistency for other costs, and cleans
up some of the testing for negative currencies (since I was there).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120231198
2016-05-13 17:40:17 -04:00
mcilwain
c5d09227c5 Refactor update snapshot view servlet into a Daggerized Action
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120224051
2016-05-13 17:40:12 -04:00
mcilwain
4fbf613955 Export entity integrity alerts to BigQuery
This is part 2 of a longer series.  Part 3 will add lots more tests, will add a cron entry, and will include an analysis script to run on BigQuery to detect the presence of two consecutive errors.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120040267
2016-05-13 17:40:08 -04:00
nickfelt
f20b1d89a9 Fix premium list command regressions
This CL fixes bugs introduced when the premium list commands were moved to
be server-side commands.

Fixes:

 - omitting the --name parameter actually works now; before it was failing
   in the local build() call since it uses the name as the @Id and tries to
   create a key for PremiumListRevision, but key IDs cannot be null.

 - premium list data larger than about 2K works now (see [] before
   it was stuffing the list data all into a POST query parameter, and URLs of
   more than 2K in length were all getting 404s.  Fix was changing it to put
   the inputData param in the POST body.

 - misc test cleanup
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119912494
2016-05-13 17:40:03 -04:00
mcilwain
625c34662b Remove launcher options to java_binary from open source release
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119897863
2016-05-13 17:39:57 -04:00
cgoldfeder
2fc636632b Turn on braintree in sandbox.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119890386
2016-05-13 17:39:52 -04:00
ctingue
4112bca925 Begin writing AUTO_RENEW flag alongside reason
Backfill [] to follow, and the Recurring billing events will eventually be replicated as OneTime via a regular job.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119883652
2016-05-13 17:39:47 -04:00
ctingue
fbe076b5da Implement input for MRs over child entities
Also throwing in a proof-of-concept MR that I'd like to run in production, and then scrap once the meaty MR is finished (e.g. exploding Recurring billing events into OneTimes).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119881471
2016-05-13 17:39:40 -04:00
ctingue
27c034c080 Change java launcher to JDK for module/*
Per https://groups.google.com[]forum/#!topic/[]-discuss/NfejII_D5dA, a default launcher change broke our GAE-deployed services.

Tested in alpha with no issues.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119790722
2016-05-13 17:39:18 -04:00
nickfelt
7c4b80f4d9 Remove no-longer-used AdminServletPathPrefix config value
We still have some paths under /_dr/admin (e.g. for server-side regtool
actions), but this actual config value isn't used anywhere ever since
we deleted the admin console in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119693711
2016-05-13 17:39:12 -04:00
mcilwain
ad90cdf82d Move MetricsTaskServlet runtime dep to backend
This is a follow-up to [] that corrects an oversight.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119683462
2016-05-13 17:39:08 -04:00
ctingue
e01edf261d Add a SYNTHETIC flag for BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119559193
2016-05-13 17:39:01 -04:00
mcilwain
755fce9e52 Consolidate BigQuery handling into one place
I'm writing a follow-up CL that will send integrity checking data to
BigQuery, and that is made a lot easier by centralizing the BigQuery
connection logic.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119375766
2016-05-13 17:38:56 -04:00
mcilwain
c880a042a7 Add command to re-save all environment entities
This is the tool we'll run after dumping everything in sandbox except
for Registrars, Registries, and RegistrarContacts, in order to
re-create the commit logs on said entities.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119369873
2016-05-13 17:38:50 -04:00
mcilwain
4b15d49f52 Add database invariant checker []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119162082
2016-05-13 17:38:34 -04:00
mcilwain
d213d9a114 Restore the number of load test queues to 10
I'm running a read-only load test right now and I was running into unacceptably low limits with only five load test queues to execute in.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119048442
2016-05-13 17:38:26 -04:00
mcilwain
e6d3f42e60 Make metrics export run on backend module
This fixes a previous issue where metrics generated on the
tools/backend modules weren't being successfully exported to BigQuery.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119047757
2016-05-13 17:38:21 -04:00
mcilwain
17c4ad83c8 Improve load test servlet
This adds better comments, sane defaults for most parameters, and
improved caching of test data.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118996436
2016-05-13 17:38:11 -04:00
mcilwain
45a194fd90 Merge tools/[] package into tools/server
There's no point in having this extra package exclusively for
[]s, especially because we already weren't being consistent and
had multiple []s in the tools/server package.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118807843
2016-05-13 17:38:06 -04:00
jart
dcbabd06a6 Sync registrar to Braintree customer record automatically
In order to set the customerId field on a payment, the customer entry
must exist in Braintree's database. This CL causes it to be created or
updated before processing the payment.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118530040
2016-05-13 17:38:00 -04:00
jart
b3125ae070 Move getTldFromDomainName into DomainNameUtils
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118475557
2016-05-13 17:37:32 -04:00
jart
4442f4c31b Improve documentation of TLD extraction routines
Some confusion came up in #9 over the proper way to extract TLDs from
hostnames. This should hopefully alleviate that.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118417091
2016-05-13 17:37:24 -04:00
cgoldfeder
ec2daec412 Adds the ability to whitelist registrants and nameservers on a TLD
This is needed for ROCC TLDs like .foo
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118404870
2016-05-13 17:37:17 -04:00
ctingue
f9e1bab1d2 Rename async flow failure backoff config property
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118207124
2016-05-13 17:37:10 -04:00