Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(DENG-6890): mobile kpi support metrics managed backfill 20250122 #6847

Merged
merged 4 commits into from
Jan 29, 2025
Merged

feat(DENG-6890): mobile kpi support metrics managed backfill 20250122 #6847

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b01477e
feat: add backfill.yaml entries for fenix retention, new_profiles and…
kik-kik Jan 22, 2025
b97b0f0
feat: add backfill.yaml entries for firefox_ios retention, new_profil…
kik-kik Jan 22, 2025
4e11d89
feat: add a note to metadata that the new fields are available on fir…
kik-kik Jan 22, 2025
dcc66ea
feat: add shredder_mitigation flag to the new backfills entries, but …
kik-kik Jan 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions sql/moz-fx-data-shared-prod/fenix_derived/engagement_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false
8 changes: 8 additions & 0 deletions sql/moz-fx-data-shared-prod/fenix_derived/new_profiles_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false
9 changes: 9 additions & 0 deletions sql/moz-fx-data-shared-prod/fenix_derived/retention_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,12 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false

2024-05-31:
start_date: 2021-01-01
end_date: 2024-05-31
Expand Down
8 changes: 8 additions & 0 deletions sql/moz-fx-data-shared-prod/firefox_ios_derived/engagement_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false
8 changes: 8 additions & 0 deletions sql/moz-fx-data-shared-prod/firefox_ios_derived/new_profiles_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false
9 changes: 9 additions & 0 deletions sql/moz-fx-data-shared-prod/firefox_ios_derived/retention_v1/backfill.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,12 @@
2025-01-22:
start_date: 2024-03-05
end_date: 2025-01-21
reason: Recompute partitions since DMA came into effect to include additional fields (DENG-6890).
watchers:
- [email protected]
status: Initiate
shredder_mitigation: false

2024-06-04:
start_date: 2021-01-01
end_date: 2024-06-04
Expand Down
8 changes: 7 additions & 1 deletion sql_generators/mobile_kpi_support_metrics/templates/engagement.metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,19 @@ friendly_name: Profile / Client Engagement - {{ friendly_name }} (Aggregated)
description: |-
Profile / Client Engagement ({{ friendly_name }}) aggregated metrics

{% if app_name in ['fenix', 'firefox_ios'] -%}
device_type and device_manufacturer fields were added in 2024-03-05.
{%- else -%}
device_type and device_manufacturer fields were added on 2025-01-18.
{%- endif %}

owners:
- mozilla/kpi_table_reviewers
- [email protected]
labels:
schedule: daily
incremental: true
shredder_mitigation: true
shredder_mitigation: false
table_type: aggregate
scheduling:
dag_name: bqetl_mobile_kpi_metrics
Expand Down
8 changes: 7 additions & 1 deletion sql_generators/mobile_kpi_support_metrics/templates/new_profiles.metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,19 @@ friendly_name: New profiles - {{ friendly_name }} (Aggregated)
description: |-
New profiles ({{ friendly_name }}) aggregated metrics

{% if app_name in ['fenix', 'firefox_ios'] -%}
device_type and device_manufacturer fields were added in 2024-03-05.
{%- else -%}
device_type and device_manufacturer fields were added on 2025-01-18.
{%- endif %}

owners:
- mozilla/kpi_table_reviewers
- [email protected]
labels:
schedule: daily
incremental: true
shredder_mitigation: true
shredder_mitigation: false
table_type: aggregate
scheduling:
dag_name: bqetl_mobile_kpi_metrics
Expand Down
8 changes: 7 additions & 1 deletion sql_generators/mobile_kpi_support_metrics/templates/retention.metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,19 @@ description: |-

see: DENG-3183 for more information.

{% if app_name in ['fenix', 'firefox_ios'] -%}
device_type and device_manufacturer fields were added in 2024-03-05.
{%- else -%}
device_type and device_manufacturer fields were added on 2025-01-18.
{%- endif %}

owners:
- mozilla/kpi_table_reviewers
- [email protected]
labels:
schedule: daily
incremental: true
shredder_mitigation: true
shredder_mitigation: false
table_type: aggregate
scheduling:
dag_name: bqetl_mobile_kpi_metrics
Expand Down