Code

DNM Maybe working migrations#30980

Code

Closed

jkosh44 wants to merge 50 commits intoMaterializeInc:mainMaterializeInc/materialize:mainfrom jkosh44:maybe-working-migrationsjkosh44/materialize:maybe-working-migrationsCopy head branch name to clipboard

+2,129-735

Commits

Commits on Jan 8, 2025

• storage: Simplify dataflow as_of computation

  Show description for a8ad4ba
  jkosh44

  committed
  a8ad4ba

  Copy full SHA for a8ad4ba

• storage: Always initialize ingestion statistics

  Show description for b84e290
  jkosh44

  committed
  b84e290

  Copy full SHA for b84e290

• More generic sender for ReadHold changes

  Show description for 785d6a7
  

  teskje

  authored and

  jkosh44

  committed
  785d6a7

  Copy full SHA for 785d6a7

• controller/compute: sequence external read hold changes

  Show description for 92f56f3
  

  teskje

  authored and

  jkosh44

  committed
  92f56f3

  Copy full SHA for 92f56f3

• Revert "controller/compute: defer application of early read hold changes"

  Show description for 062dcd8
  

  teskje

  authored and

  jkosh44

  committed
  062dcd8

  Copy full SHA for 062dcd8

• compute: correctly propagate read holds in shutdown check

  Show description for bbe7a98
  

  teskje

  authored and

  jkosh44

  committed
  bbe7a98

  Copy full SHA for bbe7a98

• controller/compute: send all read hold changes through command_tx

  Show description for 84cdf01
  

  teskje

  authored and

  jkosh44

  committed
  84cdf01

  Copy full SHA for 84cdf01

• envd: make tests robust against slower read hold downgrade

  Show description for ca7c42c
  

  teskje

  authored and

  jkosh44

  committed
  ca7c42c

  Copy full SHA for ca7c42c

• kafka-source: detect topic deletion in metadata fetcher

  Show description for 3dedd37
  

  teskje

  authored and

  jkosh44

  committed
  3dedd37

  Copy full SHA for 3dedd37

• kafka: don't shutdown metadata fetcher on error

  Show description for bc83246
  

  teskje

  authored and

  jkosh44

  committed
  bc83246

  Copy full SHA for bc83246

• storage: in upsert StateValue allow converting finalized tombstones

  Show description for 3fe9148
  

  aljoscha

  authored and

  jkosh44

  committed
  3fe9148

  Copy full SHA for 3fe9148

• build: Use "limited" debug info instead of "line-tables" (MaterializeInc#30962)

  Show description for 2a90439
  

  ParkMyCar

  authored and

  jkosh44

  committed
  2a90439

  Copy full SHA for 2a90439

• storage: Correct output index for source exports

  Show description for 2ec6f53
  jkosh44

  committed
  2ec6f53

  Copy full SHA for 2ec6f53

• Opt-in catalog migration for converting subsources to source tables

  

  rjobanp

  authored and

  jkosh44

  committed
  a0b1299

  Copy full SHA for a0b1299

• Add migration logic for source statements

  

  rjobanp

  authored and

  jkosh44

  committed
  4ce1748

  Copy full SHA for 4ce1748

• Rename the feature flag

  

  rjobanp

  authored and

  jkosh44

  committed
  f9b3c01

  Copy full SHA for f9b3c01

• Add new table to audit log

  

  rjobanp

  authored and

  jkosh44

  committed
  1094734

  Copy full SHA for 1094734

• Add platform check scenario to test migration

  

  rjobanp

  authored and

  jkosh44

  committed
  aa9d33c

  Copy full SHA for aa9d33c

• Switch to using system vars instead of flags to allow console access to values

  Show description for b810598
  

  rjobanp

  authored and

  jkosh44

  committed
  b810598

  Copy full SHA for b810598

• Fixes to migration based on testing

  

  rjobanp

  authored and

  jkosh44

  committed
  a9ac9dc

  Copy full SHA for a9ac9dc

• Also test the migration in the legacy upgrade tests

  

  rjobanp

  authored and

  jkosh44

  committed
  869dde3

  Copy full SHA for 869dde3

• platform checks: unique source name

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  7daeefc

  Copy full SHA for 7daeefc

• Migration structure cleanup from feedback

  

  rjobanp

  authored and

  jkosh44

  committed
  3144c3e

  Copy full SHA for 3144c3e

• Address more feedback; ensure new source name is unique

  

  rjobanp

  authored and

  jkosh44

  committed
  b08465c

  Copy full SHA for b08465c

• Fix legacy-upgrade checks

  

  rjobanp

  authored and

  jkosh44

  committed
  8cc26c9

  Copy full SHA for 8cc26c9

• Fixes caused by rebase on main

  

  rjobanp

  authored and

  jkosh44

  committed
  a061b34

  Copy full SHA for a061b34

• ci: print source table migration issues

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  12428f7

  Copy full SHA for 12428f7

• migration tests: pg-cdc-old-syntax

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  ebcd57e

  Copy full SHA for ebcd57e

• migration tests: extract logic

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  db36e65

  Copy full SHA for db36e65

• migration tests: improve verification

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  7a36b2a

  Copy full SHA for 7a36b2a

• migration tests: mysql-cdc-old-syntax

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  093bc6c

  Copy full SHA for 093bc6c

• migration tests: testdrive-old-kafka-syntax

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  e2ec8a6

  Copy full SHA for e2ec8a6

• migration tests: improve output

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  08b6748

  Copy full SHA for 08b6748

• migration tests: fixes

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  9879b1b

  Copy full SHA for 9879b1b

• migration tests: fixes

  

  nrainer-materialize

  authored and

  jkosh44

  committed
  6ac9b65

  Copy full SHA for 6ac9b65

• Fix for mysql source being restarted after new table added

  

  rjobanp

  authored and

  jkosh44

  committed
  03f7f3a

  Copy full SHA for 03f7f3a

• Avoid needing to rewrite ids of dependent statements by changing the sorting of item updates

  

  rjobanp

  authored and

  jkosh44

  committed
  cb52018

  Copy full SHA for cb52018

• Fix merge skew

  jkosh44

  committed
  6a42fca

  Copy full SHA for 6a42fca

• Fix dependency tracking

  jkosh44

  committed
  5cb65cf

  Copy full SHA for 5cb65cf

• Fix lint

  jkosh44

  committed
  dc1a48a

  Copy full SHA for dc1a48a

• Fix some issues

  jkosh44

  committed
  b14cc63

  Copy full SHA for b14cc63

• Fix dependency tracking

  jkosh44

  committed
  1763a86

  Copy full SHA for 1763a86

• Fix merge skew

  jkosh44

  committed
  ace0355

  Copy full SHA for ace0355

• Update test versions

  jkosh44

  committed
  bdb5783

  Copy full SHA for bdb5783

• More merge skew fixes

  jkosh44

  committed
  032cc84

  Copy full SHA for 032cc84

• Update item sorting to only sort within item groups

  jkosh44

  committed
  31fb760

  Copy full SHA for 31fb760

• Experiment for migrate

  jkosh44

  committed
  ac821fa

  Copy full SHA for ac821fa

• Fix migration idempotency

  jkosh44

  committed
  f56fac0

  Copy full SHA for f56fac0

• Fixup

  jkosh44

  committed
  51647b6

  Copy full SHA for 51647b6

• resolve merge conflicts

  jkosh44

  committed
  6462bfc

  Copy full SHA for 6462bfc