zydronium/google-nomulus
1
0
Fork 0
mirror of https://github.com/google/nomulus.git synced 2025-05-13 16:07:15 +02:00
Code Issues Projects Releases Packages Wiki Activity

Remove datastore export cron jobs in all environments

Browse source 
Remove those that call the /_dr/task/exportSnapshot endpoint.

The new export mechanism through /_dr/task/backupDatastore
has been running successfully in production.

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=228908704
This commit is contained in:
weiminyu 2019-01-11 10:56:33 -08:00 • committed by Ben McIlwain
parent f017798162
commit eeb65b4610
4 changed files with 8 additions and 54 deletions
Download patch file Download diff file Expand all files Collapse all files

18
java/google/registry/env/alpha/default/WEB-INF/cron.xml vendored
View file

@ -151,23 +151,7 @@
</description> </description>
<!-- <!--
Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than
this interval. this interval. -->
To facilitate troubleshooting, run after the exportSnapshot task below (typically finishes in
90 minutes in production) has completed.
TODO(b/122271637): move to 06:00 (UTC) when the exportSnapshot task is removed. -->
<schedule>every day 09:00</schedule>
<target>backend</target>
</cron>
<cron>
<url><![CDATA[/_dr/cron/fanout?queue=export-snapshot&endpoint=/_dr/task/exportSnapshot&runInEmpty]]></url>
<description>
This job fires off a Datastore backup-as-a-service job that generates snapshot files in GCS.
It also enqueues a new task to wait on the completion of that job and then load the resulting
snapshot into bigquery.
</description>
<!-- Keep the task-age-limit for this job's task queue less than this cron interval. -->
<schedule>every day 06:00</schedule> <schedule>every day 06:00</schedule>
<target>backend</target> <target>backend</target>
</cron> </cron>

8
java/google/registry/env/crash/default/WEB-INF/cron.xml vendored
View file

@ -134,13 +134,15 @@
</cron> </cron>
<cron> <cron>
<url><![CDATA[/_dr/cron/fanout?queue=export-snapshot&endpoint=/_dr/task/exportSnapshot&runInEmpty]]></url> <url><![CDATA[/_dr/cron/fanout?queue=export-snapshot&endpoint=/_dr/task/backupDatastore&runInEmpty]]></url>
<description> <description>
This job fires off a Datastore backup-as-a-service job that generates snapshot files in GCS. This job fires off a Datastore managed-export job that generates snapshot files in GCS.
It also enqueues a new task to wait on the completion of that job and then load the resulting It also enqueues a new task to wait on the completion of that job and then load the resulting
snapshot into bigquery. snapshot into bigquery.
</description> </description>
<!-- Keep the task-age-limit for this job's task queue less than this cron interval. --> <!--
Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than
this interval. -->
<schedule>every day 06:00</schedule> <schedule>every day 06:00</schedule>
<target>backend</target> <target>backend</target>
</cron> </cron>

18
java/google/registry/env/production/default/WEB-INF/cron.xml vendored
View file

@ -183,23 +183,7 @@
</description> </description>
<!-- <!--
Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than
this interval. this interval. -->
To facilitate troubleshooting, run after the exportSnapshot task below (typically finishes in
90 minutes in production) has completed.
TODO(b/122271637): move to 06:00 (UTC) when the exportSnapshot task is removed. -->
<schedule>every day 09:00</schedule>
<target>backend</target>
</cron>
<cron>
<url><![CDATA[/_dr/cron/fanout?queue=export-snapshot&endpoint=/_dr/task/exportSnapshot&runInEmpty]]></url>
<description>
This job fires off a Datastore backup-as-a-service job that generates snapshot files in GCS.
It also enqueues a new task to wait on the completion of that job and then load the resulting
snapshot into bigquery.
</description>
<!-- Keep the task-age-limit for this job's task queue less than this cron interval. -->
<schedule>every day 06:00</schedule> <schedule>every day 06:00</schedule>
<target>backend</target> <target>backend</target>
</cron> </cron>

18
java/google/registry/env/sandbox/default/WEB-INF/cron.xml vendored
View file

@ -160,23 +160,7 @@
</description> </description>
<!-- <!--
Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than Keep google.registry.export.CheckBackupAction.MAXIMUM_BACKUP_RUNNING_TIME less than
this interval. this interval. -->
To facilitate troubleshooting, run after the exportSnapshot task below (typically finishes in
90 minutes in production) has completed.
TODO(b/122271637): move to 06:00 (UTC) when the exportSnapshot task is removed. -->
<schedule>every day 09:00</schedule>
<target>backend</target>
</cron>
<cron>
<url><![CDATA[/_dr/cron/fanout?queue=export-snapshot&endpoint=/_dr/task/exportSnapshot&runInEmpty]]></url>
<description>
This job fires off a Datastore backup-as-a-service job that generates snapshot files in GCS.
It also enqueues a new task to wait on the completion of that job and then load the resulting
snapshot into bigquery.
</description>
<!-- Keep the task-age-limit for this job's task queue less than this cron interval. -->
<schedule>every day 06:00</schedule> <schedule>every day 06:00</schedule>
<target>backend</target> <target>backend</target>
</cron> </cron>