google-nomulus/java/google/registry
larryruili d199b383e5 Add preliminary spec11 monthly pipeline
This adds the scaffolding for a basic Spec11 pipeline- it gathers all domains from all time for a given project and counts how many there are. I've factored out a few common utilities for beam pipelines to avoid excessive duplication.

Future CLs will:
- Actually process domains via the SafeBrowsing API
- Generate a real spec11 report
- Template queries based on the input YearMonth
- Abstract more commonalities across beam pipelines to reduce boilerplate when adding new pipelines.

TESTED: FOSS test passed, and ran successfully on alpha

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=205997741
2018-08-10 13:44:25 -04:00
..
backup Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
batch Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
beam Add preliminary spec11 monthly pipeline 2018-08-10 13:44:25 -04:00
bigquery Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
builddefs Format .bzl files with buildifier 2018-07-14 01:37:03 -04:00
config Add preliminary spec11 monthly pipeline 2018-08-10 13:44:25 -04:00
cron Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
dns Export Weimin as author of commits to GitHub 2018-07-14 01:37:03 -04:00
env Switch pubapi/default service to basic scaling in prod/sandbox 2018-07-17 22:01:08 -04:00
export Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
flows Properly handle NAME_COLLISION domains in start-date sunrise 2018-08-10 13:44:25 -04:00
gcs Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
groups Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
idn Update IDN tables to comply with https://www.iana.org/help/idn-repository-procedure 2018-02-01 21:59:14 -05:00
keyring Delete all Braintree code 2018-07-14 01:37:03 -04:00
loadtest Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
mapreduce Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
model Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
module Remove transition code for set of parameter refactoring 2018-07-14 01:37:03 -04:00
monitoring/whitebox Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
pricing Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
proxy Make some minor changes to logging messages and test names. 2018-08-10 13:44:25 -04:00
rdap Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
rde Move the RDE PGP file encoding to a dedicated file 2018-08-10 13:44:25 -04:00
reporting Add preliminary spec11 monthly pipeline 2018-08-10 13:44:25 -04:00
request Use locking on async mapreduces 2018-08-10 13:44:25 -04:00
security Improve internal build system speed 2018-06-27 15:28:52 -04:00
storage/drive Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
tldconfig/idn Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
tmch Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
tools Add preliminary spec11 monthly pipeline 2018-08-10 13:44:25 -04:00
ui Fix mismatched parenthesis in domain.soy 2018-07-14 01:37:03 -04:00
util Clean up third_party imports in BUILD files 2018-07-14 01:11:51 -04:00
whois Clean up annotation imports in BUILD files 2018-06-27 15:28:53 -04:00
xjc Run bazel installer as a argument to bash 2018-08-10 13:44:25 -04:00
xml Pretty-print actual XML in tests 2018-07-14 01:37:03 -04:00
BUILD Remove most HTML/CSS/JS assets from the backend service WAR 2018-06-27 15:28:53 -04:00
repositories.bzl Upgrade Guava and Truth versions 2018-08-10 13:44:25 -04:00