Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add shredder_mitigation to KPI and search related tables #6700

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
+23 −2
Open

Add shredder_mitigation to KPI and search related tables #6700

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
b2c1b80
Add shredder_mitigation to KPI and search related tables
alekhyamoz Dec 18, 2024
be2eaa5
add more search files
alekhyamoz Dec 20, 2024
9a7ce4f
Merge branch 'main' into shredder_mitigation_kpi_search
alekhyamoz Dec 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ...ata-shared-prod/contextual_services_derived/event_aggregates_spons_tiles_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,8 @@ labels:
schedule: daily
dag: bqetl_ctxsvc_derived
owner1: rburwei
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_ctxsvc_derived
bigquery:
Expand Down
2 changes: 2 additions & 0 deletions ...fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ labels:
incremental: true
schedule: daily
dag: bqetl_ctxsvc_derived
shredder_mitigation: true
table_type: aggregate
owner1: rburwei
scheduling:
dag_name: bqetl_ctxsvc_derived
Expand Down
2 changes: 2 additions & 0 deletions sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,8 @@ owners:
labels:
incremental: true
schedule: daily
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_ctxsvc_derived
arguments: ['--schema_update_option=ALLOW_FIELD_ADDITION']
Expand Down
2 changes: 2 additions & 0 deletions ...-fx-data-shared-prod/contextual_services_derived/request_payload_suggest_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ labels:
incremental: true
schedule: daily
change_controlled: true
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_ctxsvc_derived
bigquery:
Expand Down
1 change: 1 addition & 0 deletions ...oz-fx-data-shared-prod/contextual_services_derived/request_payload_tiles_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ labels:
incremental: true
schedule: daily
change_controlled: true
table_type: aggregate
scheduling:
dag_name: bqetl_ctxsvc_derived
bigquery:
Expand Down
2 changes: 2 additions & 0 deletions ...fx-data-shared-prod/search_derived/desktop_mobile_search_clients_monthly_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ owners:
labels:
incremental: true
schedule: monthly
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_desktop_mobile_search_monthly
date_partition_parameter: null
Expand Down
3 changes: 2 additions & 1 deletion sql/moz-fx-data-shared-prod/search_derived/search_aggregates_v8/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@ description: |-
Daily search clients, aggregated across unique sets of dimensions
and partitioned by day.
owners:
- [email protected]
- [email protected]
- [email protected]
- [email protected]
labels:
schedule: daily
Expand Down
2 changes: 1 addition & 1 deletion sql/moz-fx-data-shared-prod/search_derived/search_dau_aggregates_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ labels:
incremental: true
schedule: daily
change_controlled: true
shredder_mitigation: true
table_type: aggregate
shredder_mitigation: true
scheduling:
dag_name: bqetl_search_dashboard
bigquery:
Expand Down
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/search_derived/search_metric_contribution_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ owners:
- [email protected]
labels:
schedule: daily
table_type: aggregate
scheduling:
dag_name: bqetl_search
bigquery:
Expand Down
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/search_derived/search_revenue_levers_daily_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ labels:
change_controlled: true
dag: bqetl_search_dashboard
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_search_dashboard
bigquery:
Expand Down
2 changes: 2 additions & 0 deletions ...x-data-shared-prod/telemetry_derived/active_users_aggregates_attribution_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ owners:
- [email protected]
labels:
incremental: true
shredder_mitigation: true
table_type: aggregate
bigquery:
time_partitioning:
type: day
Expand Down
2 changes: 2 additions & 0 deletions ...moz-fx-data-shared-prod/telemetry_derived/active_users_aggregates_device_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ owners:
- [email protected]
labels:
incremental: true
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_analytics_aggregations
task_name: active_users_aggregates_device_v1
Expand Down
1 change: 1 addition & 0 deletions sql_generators/active_users_aggregates_v4/templates/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ labels:
incremental: true
change_controlled: true
shredder_mitigation: true
table_type: aggregate
scheduling:
dag_name: bqetl_analytics_aggregations
task_name: {{ app_name }}_{{ table_name }}
Expand Down
2 changes: 2 additions & 0 deletions sql_generators/active_users_deletion_requests/templates/metadata_deletion_request.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@ owners:
- [email protected]
labels:
incremental: true
table_type: aggregate
shredder_mitigation: true
scheduling:
dag_name: bqetl_kpis_shredder
task_name: {{ app_name }}_active_users_aggregates_for_deletion_requests
Expand Down