Commit graph

289 commits

Author SHA1 Message Date
mcilwain
9e7934684e Change WHOIS functionality to return PDT registrars
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120448012
2016-05-13 17:41:23 -04:00
cgoldfeder
9ca191f3d4 Registry should not be a BackupGroupRoot
In [] I made Registry a BGR in prep for each Registry being in
its own entity group. But we decided not to do that, and in []
mcilwain@ moved Registry under the cross-tld root. So there's no reason
for Registry to implement BackupGroupRoot anymore.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120402417
2016-05-13 17:41:18 -04:00
jart
36ab6c15fe Add Braintree prod merchant ID
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120400330
2016-05-13 17:41:13 -04:00
nickfelt
3a3f112454 Whitelist credit creations commands for gTech
See bug for context.  This way gTech can create credits in the future
without our intervention.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120382506
2016-05-13 17:41:08 -04:00
jart
9c8e23ea57 Really enable payment page in sandbox
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120372049
2016-05-13 17:41:03 -04:00
cgoldfeder
4e6c8ec6fe Fix WHOIS formatting to match format from RA
Our whois format was flagged as wrong in the .meet PDT. Although
we had followed the AWIP samples from ICANN, the definitive list
of field names is from Specification 4 of our contract, available at
https://newgtlds.icann.org/sites/default/files/agreements/agreement-approved-09jan14-en.htm
and indeed our fields are incorrect. (The remaining formatting issues
are ambiguous but the PDT testers' interpretation is probably correct.)

Since the footer format is now somewhat more complicated, I also denormalized
the disclaimer field into all of the testdata files. (I spent some time
debugging an extra newline between the content and the disclaimer, and
it would have been far clearer to solve if the files had been this way.)
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120338930
2016-05-13 17:40:58 -04:00
cgoldfeder
c99711c7e3 Augment KillAllCommitLogsAction to also kill checkpoints
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120338924
2016-05-13 17:40:51 -04:00
ctingue
145de1d4db Drop LegacyStatusValue from StatusValue
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120332716
2016-05-13 17:40:46 -04:00
cgoldfeder
5d88962258 Add real batching to KillAllXXXActions, and fix nits
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120272836
2016-05-13 17:40:41 -04:00
ctingue
67a604654c Create MR for backfilling billing AUTO_RENEW flag
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120261970
2016-05-13 17:40:36 -04:00
cgoldfeder
6f72af2ba6 A tool to visualize the layout of our schema in datastore.
The output on the current schema is:

CommitLogBucket (not backed up)
  ↳ CommitLogManifest (not backed up)
    ↳ CommitLogMutation (not backed up)

CommitLogCheckpointRoot (not backed up)
  ↳ CommitLogCheckpoint (not backed up)

DomainApplicationIndex (bgr)

EntityGroupRoot (bgr)
  ↳ ClaimsListShard.ClaimsListSingleton (not backed up)
    ↳ ClaimsListShard.ClaimsListRevision (virtual)
      ↳ ClaimsListShard (not backed up)
  ↳ LogsExportCursor
  ↳ PremiumList
    ↳ PremiumList.PremiumListRevision (virtual)
      ↳ PremiumList.PremiumListEntry
  ↳ Registrar
    ↳ RegistrarBillingEntry
    ↳ RegistrarContact
    ↳ RegistrarCredit
      ↳ RegistrarCreditBalance
  ↳ Registry (bgr)
    ↳ RegistryCursor
  ↳ ReservedList
  ↳ ServerSecret (not backed up)
  ↳ SignedMarkRevocationList (not backed up)
  ↳ TmchCrl (not backed up)

EppResource (abstract) (bgr)
  - ContactResource
  - DomainBase
    - DomainApplication (subclass)
    - DomainResource (subclass)
  - HostResource
  ↳ HistoryEntry
    ↳ BillingEvent.Cancellation
    ↳ BillingEvent.Modification
    ↳ BillingEvent.OneTime
    ↳ BillingEvent.Recurring
    ↳ PollMessage (abstract)
      - PollMessage.Autorenew (subclass)
      - PollMessage.OneTime (subclass)

EppResourceIndexBucket (virtual)
  ↳ EppResourceIndex (bgr)

ForeignKeyIndex.ForeignKeyContactIndex (bgr)

ForeignKeyIndex.ForeignKeyDomainIndex (bgr)

ForeignKeyIndex.ForeignKeyHostIndex (bgr)

GaeUserIdConverter (not backed up)

Lock (not backed up)

RdeRevision
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120251537
2016-05-13 17:40:31 -04:00
mcilwain
4ba8c0e552 Use HttpException for error handling in UpdateSnapshotViewAction
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120238590
2016-05-13 17:40:26 -04:00
mcilwain
0f4a1035b2 Refactor metrics servlet to be a Daggerized action
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120235694
2016-05-13 17:40:21 -04:00
nickfelt
706f3b44ed Enforce currency consistency for server status billing cost
Also adds tests for currency consistency for other costs, and cleans
up some of the testing for negative currencies (since I was there).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120231198
2016-05-13 17:40:17 -04:00
mcilwain
c5d09227c5 Refactor update snapshot view servlet into a Daggerized Action
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120224051
2016-05-13 17:40:12 -04:00
mcilwain
4fbf613955 Export entity integrity alerts to BigQuery
This is part 2 of a longer series.  Part 3 will add lots more tests, will add a cron entry, and will include an analysis script to run on BigQuery to detect the presence of two consecutive errors.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=120040267
2016-05-13 17:40:08 -04:00
nickfelt
f20b1d89a9 Fix premium list command regressions
This CL fixes bugs introduced when the premium list commands were moved to
be server-side commands.

Fixes:

 - omitting the --name parameter actually works now; before it was failing
   in the local build() call since it uses the name as the @Id and tries to
   create a key for PremiumListRevision, but key IDs cannot be null.

 - premium list data larger than about 2K works now (see [] before
   it was stuffing the list data all into a POST query parameter, and URLs of
   more than 2K in length were all getting 404s.  Fix was changing it to put
   the inputData param in the POST body.

 - misc test cleanup
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119912494
2016-05-13 17:40:03 -04:00
mcilwain
625c34662b Remove launcher options to java_binary from open source release
This is a follow-up to []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119897863
2016-05-13 17:39:57 -04:00
cgoldfeder
2fc636632b Turn on braintree in sandbox.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119890386
2016-05-13 17:39:52 -04:00
ctingue
4112bca925 Begin writing AUTO_RENEW flag alongside reason
Backfill [] to follow, and the Recurring billing events will eventually be replicated as OneTime via a regular job.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119883652
2016-05-13 17:39:47 -04:00
ctingue
fbe076b5da Implement input for MRs over child entities
Also throwing in a proof-of-concept MR that I'd like to run in production, and then scrap once the meaty MR is finished (e.g. exploding Recurring billing events into OneTimes).
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119881471
2016-05-13 17:39:40 -04:00
ctingue
27c034c080 Change java launcher to JDK for module/*
Per https://groups.google.com[]forum/#!topic/[]-discuss/NfejII_D5dA, a default launcher change broke our GAE-deployed services.

Tested in alpha with no issues.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119790722
2016-05-13 17:39:18 -04:00
nickfelt
7c4b80f4d9 Remove no-longer-used AdminServletPathPrefix config value
We still have some paths under /_dr/admin (e.g. for server-side regtool
actions), but this actual config value isn't used anywhere ever since
we deleted the admin console in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119693711
2016-05-13 17:39:12 -04:00
mcilwain
ad90cdf82d Move MetricsTaskServlet runtime dep to backend
This is a follow-up to [] that corrects an oversight.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119683462
2016-05-13 17:39:08 -04:00
ctingue
e01edf261d Add a SYNTHETIC flag for BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119559193
2016-05-13 17:39:01 -04:00
mcilwain
755fce9e52 Consolidate BigQuery handling into one place
I'm writing a follow-up CL that will send integrity checking data to
BigQuery, and that is made a lot easier by centralizing the BigQuery
connection logic.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119375766
2016-05-13 17:38:56 -04:00
mcilwain
c880a042a7 Add command to re-save all environment entities
This is the tool we'll run after dumping everything in sandbox except
for Registrars, Registries, and RegistrarContacts, in order to
re-create the commit logs on said entities.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119369873
2016-05-13 17:38:50 -04:00
mcilwain
4b15d49f52 Add database invariant checker []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119162082
2016-05-13 17:38:34 -04:00
mcilwain
d213d9a114 Restore the number of load test queues to 10
I'm running a read-only load test right now and I was running into unacceptably low limits with only five load test queues to execute in.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119048442
2016-05-13 17:38:26 -04:00
mcilwain
e6d3f42e60 Make metrics export run on backend module
This fixes a previous issue where metrics generated on the
tools/backend modules weren't being successfully exported to BigQuery.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=119047757
2016-05-13 17:38:21 -04:00
mcilwain
17c4ad83c8 Improve load test servlet
This adds better comments, sane defaults for most parameters, and
improved caching of test data.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118996436
2016-05-13 17:38:11 -04:00
mcilwain
45a194fd90 Merge tools/[] package into tools/server
There's no point in having this extra package exclusively for
[]s, especially because we already weren't being consistent and
had multiple []s in the tools/server package.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118807843
2016-05-13 17:38:06 -04:00
jart
dcbabd06a6 Sync registrar to Braintree customer record automatically
In order to set the customerId field on a payment, the customer entry
must exist in Braintree's database. This CL causes it to be created or
updated before processing the payment.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118530040
2016-05-13 17:38:00 -04:00
jart
b3125ae070 Move getTldFromDomainName into DomainNameUtils
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118475557
2016-05-13 17:37:32 -04:00
jart
4442f4c31b Improve documentation of TLD extraction routines
Some confusion came up in #9 over the proper way to extract TLDs from
hostnames. This should hopefully alleviate that.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118417091
2016-05-13 17:37:24 -04:00
cgoldfeder
ec2daec412 Adds the ability to whitelist registrants and nameservers on a TLD
This is needed for ROCC TLDs like .foo
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118404870
2016-05-13 17:37:17 -04:00
ctingue
f9e1bab1d2 Rename async flow failure backoff config property
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=118207124
2016-05-13 17:37:10 -04:00
Hans Ridder
1194a81e91 Fixes "Insufficient permission" error in export-snapshot task
Removed "run_as_a_service" parameter from backup.create command in DatastoreBackupService.
This parameter can't be used externally, and is apparently no longer needed.
2016-04-20 17:33:06 -07:00
Wolfgang Meyers
fcaaee03c1 Make flows and registrar targets visible
Needed to reuse server-side XSRF protection
2016-04-11 09:37:59 -07:00
Hans Ridder
20f214b9d0 Adds DnsWriter that implements DNS UPDATE protocol
* DnsUpdateWriter publishes changes to NS, DS, A, AAAA records
  for domains/hosts as appropriate using RFC 2136 DNS UPDATE protocol
* Static configuration separate from RegistryConfig
* Include dnsjava library as new third party dependency
  to generate DNS protocol messages
* Expose /_dr/task/writeDns in RegistryTestServer
* Currently not included in BackendComponent
2016-04-06 08:56:54 -07:00
Justine Tunney
954d7e1e8f Merge pull request #5 from wolfgangmeyers/hermetically-sealed-eclipse
Hermetically sealed eclipse setup
2016-04-04 14:05:50 -04:00
Wolfgang Meyers
15222fc32f Use jar command from bazel in eclipse setup
Original eclipse setup used the jar command from the system path
which resulted in different behavior on different systems. This
change modifies the build target to use the jar command provided
by bazel: @local_jdk//:bin/jar
2016-03-28 12:40:20 -07:00
Justine Tunney
076c8d7e27 Update copyright notice to Domain Registry Authors 2016-03-24 17:52:56 -04:00
jart
89fa3caaba Add payment page link to Registrar Console
The payment page has also been updated to refuse to show itself if
the registrar is not set to credit card billing terms.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117983313
2016-03-23 22:38:08 -04:00
jart
b6b13333dd Pay off technical debt with ConsoleUiServlet
1. Turn ConsoleUiServlet into an action
2. Remove AbstractUiServlet, which fixes its threading bug
3. Use type-safe soy template parameters when rendering console

A follow-up change will add a new template parameter that renders the
payment page link on the navigation bar.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117969638
2016-03-23 22:38:08 -04:00
ctingue
79b2d5a990 Implement 10 min backoff for failed async deletes
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117945626
2016-03-23 22:38:08 -04:00
ctingue
62ca799b36 Add Flag.AUTO_RENEW to BillingEvent
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117821700
2016-03-23 22:38:08 -04:00
kak
0db3e13ef3 Replace Throwables.propagate with equivalent "throw e" or "throw new RuntimeException(e)."
We are removing all calls in preparation for deleting the method.

More information: []

Tested:
    TAP --sample for global presubmit queue
    []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117628955
2016-03-23 22:38:08 -04:00
mcilwain
980625f901 Fix web.xml file broken in []
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117591773
2016-03-23 22:38:08 -04:00
mountford
c25cfa626b RDAP: Include remarks only in object classes
The APNIC conformance checker points out that, according to RFC 7483,
RDAP remarks should be included only as part of object classes such as
domains, nameservers and entities, not in help responses and so on.

Note that something is amiss here -- If RFC 7483 is read strictly, the
remarks boilerplate for domain, nameserver and entity search results
should appear not at the top level, as we currently do, but as part of
each constituent object. However, the conformance checker does not
seem to complain about that. So I have added this to the RDAP questions
list, and am leaving the boilerplate at the top level for now.
-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=117557594
2016-03-23 22:38:08 -04:00