Development Release - v0.1.23

Bug Fixes

• Fix replication slot check (#1031)
• Remove non-existent proto include, which made cargo always rerun (#1064)
• Record readers not inserted in release builds (#1068)

Features

• Implement start from in postgres connector (#994)
• Add RoCacheEndpoint::redirect_cache. (#1027)
• Enhance python udf (#984)

Miscellaneous Tasks

• Refactor grpc types (#1036)

Refactor

• Make tables vector required for connector start (#1058)

Testing

• Add tests for local storage (#1030)

Support

Contact us at https://getdozer.io

v0.1.22

What's Changed

• feat: Implement monitoring command by @karolisg in #1559
• chore: Remove status update method from internal pipeline server by @karolisg in #1560
• chore: json arrow conversion support by @chloeminkyung in #1514
• chore: update proto model matching dozer types by @duonganhthu43 in #1563
• chore: Call start_dozer on dozer cloud update by @chubei in #1556
• chore: add grpc endpoint for cloud to support develop ui by @duonganhthu43 in #1565
• feature: Display progress of cloud deployment by @karolisg in #1566
• fix: Update style of progress bar by @karolisg in #1567
• refactor: Change errors structure for cloud by @karolisg in #1568
• refactor: Add proper error handling for cloud service grpc errors by @karolisg in #1569
• fix: Map grpc call error to proper error by @karolisg in #1570
• chore/add file management endpoint by @duonganhthu43 in #1571
• feature: Add stop app in cloud call by @karolisg in #1572
• feature: Add filters and pagination to command by @karolisg in #1573
• feat: Show revision and version information in cloud status by @chubei in #1574
• feat: Support version management by @chubei in #1575
• chore: Remove unused optional in cloud.proto by @chubei in #1576
• chore: add delete files by @duonganhthu43 in #1577

Full Changelog: v0.1.21...v0.1.22

v0.1.21

What's Changed

• feat: Api server can continue cache building from checkpoint by @chubei in #1538
• fix: OpenTelemetry must be initialized in a tokio runtime by @chubei in #1541
• Add issue template for dozer documentation improvement by @dozerpadawan in #1542
• feat: Add update and delete for cloud APIs by @karolisg in #1544
• chore: Don't write ansi color to file by @chubei in #1545
• fix: OpenTelemetry tracing not working because of Jaeger batch exporter. by @chubei in #1549
• feat: Add metrics for cache by @chubei in #1551
• chore: Add a missing cloud feature gate by @chubei in #1552
• feat: add public service provide metadata for cli: dozer cloud login by @duonganhthu43 in #1553
• chore: Add HomeDir::list_endpoints by @chubei in #1554

New Contributors

• @dozerpadawan made their first contribution in #1542

Full Changelog: v0.1.20...v0.1.21

v0.1.20

What's Changed

• feat: Send files list with contents in cloud deploy call by @karolisg in #1523
• feat: Add Record lifetime by @mediuminvader in #1453
• chore: Recover update_record_when_primary_changes test by @chubei in #1517
• feat: Run migration only when necessary by @chubei in #1515
• fix: Add Record missing fields by @mediuminvader in #1525
• chore: Recover "feat: Run migration only when necessary (#1515)" by @mediuminvader in #1527
• feat: Allow starting API on selected migration number by @chubei in #1530
• feat: Add expression support in TTL by @mediuminvader in #1529
• chore: Upgrade deltalake to 0.8.0 by @chubei in #1531
• refactor: arrow conversion function by @chloeminkyung in #1532
• refactor: Remove raw config from cloud deploy API payload by @karolisg in #1533
• feat: JSON_VALUE() & JSON_QUERY() sql support by @chloeminkyung in #1526

Full Changelog: v0.1.19...v0.1.20

v0.1.19

What's Changed

• feat: allow disabling of grpc & rest apis via config by @universalmind303 in #1441
• fix: cli init generation by @nurikk in #1465
• fix: Snowflake connector fixes by @nurikk in #1462
• feat: NOW() by @chloeminkyung in #1467
• chore: Remove DCO by @chubei in #1470
• chore: Add dozer-log-python README and CI by @chubei in #1471
• chore: Move log related code to dozer-types and dozer-log. by @chubei in #1474
• chore: Add dozer-log-python CI by @chubei in #1473
• chore: Fix dozer-log-python cross compilation by @chubei in #1475
• chore: Don't run dozer-log-python workflow on PR and pushes to main by @chubei in #1478
• chore: Rename admin to cloud by @karolisg in #1477
• chore: Remove outdated example by @karolisg in #1481
• chore: Remove examples by @mediuminvader in #1479
• chore: Add CI for publishing doer-log-js by @chubei in #1476
• chore: Rename dozer_log to pydozer_log by @chubei in #1482
• chore: Remove unused dependency fp_rust by @chubei in #1486
• chore: Mention Dozer Log bindings in README by @chubei in #1487
• chore: Rename pyproject name from dozer-log-python to pydozer_log by @chubei in #1485
• chore: Change cloud command and make minor changes in cloud proto by @karolisg in #1489
• chore: Add react sample URL reference by @abhishekmishragithub in #1491
• refactor: Create an api directory for every endpoint by @chubei in #1497
• chore: Remove FieldBorrow by @chubei in #1501
• feat: Add support for cloud list and status methods by @karolisg in #1507
• chore: Let actix web handle json deserialization by @chubei in #1504
• refactor: Start a new migration when dozer restarts by @chubei in #1503
• chore: put the table prints behind info by @universalmind303 in #1509
• feat: json & jsonb and their array type support by @v3g42 in #1200
• chore: Add cloud feature flag by @karolisg in #1513
• feat: Last version check by @mediuminvader in #1518
• feat: count(*) sql support by @chloeminkyung in #1520
• fix: Linux arm deb package by @mediuminvader in #1522

New Contributors

• @universalmind303 made their first contribution in #1441
• @abhishekmishragithub made their first contribution in #1491

Full Changelog: v0.1.18...v0.1.19

v0.1.18

What's Changed

• chore: Make AccessFilter::fields optional by @chubei in #1436
• feat: Support loading dozer config from an url. by @chubei in #1440
• test: Add flights e2e scenario by @mediuminvader in #1425
• fix: Use rustls reqwest by @mediuminvader in #1443
• feat: Switch to postgres for admin database by @chubei in #1444
• chore: Only build dozer binary in release workflow by @chubei in #1447
• chore: Remove dozer-admin package by @karolisg in #1448
• chore: Reexport two actix crates from dozer-api by @chubei in #1451
• chore: Add get status method to admin proto service by @karolisg in #1450
• refactor: Don't check for insert conflict when schema has no primary key by @chubei in #1452
• chore: Change error message for CustomTypeNotSupported by @chubei in #1459
• fix: uuid postgres type support by @chloeminkyung in #1458
• Update init.rs by @nurikk in #1460
• feat: dozer deploy command by @chloeminkyung in #1435
• feat: Make secondary index configurable by @chubei in #1461

New Contributors

• @nurikk made their first contribution in #1460

Full Changelog: v0.1.17...v0.1.18

v0.1.17

What's Changed

• switched to apache license by @snork-alt in #1404

• fix: e2e tests write to directories that are not removed by @chubei in #1407

• fix: type validation by @chloeminkyung in #1405

• refactor: Asyncify connectors by @chubei in #1409

• feat: SQL Logic Test Framework by @mediuminvader in #1326

• fix: Use tokio::time::sleep instead of std::thread::sleep by @chubei in #1413

• chore: Use a single tokio runtime for everything by @chubei in #1417

• feature: Implement APIs for monitoring and status updates by @karolisg in #1329

• chore: Use correct runtime for internal pipeline thread by @karolisg in #1418

• fix: Api thread graceful shutdown by @chubei in #1416

• feat: Use record hash as key when schema has no primary index by @chubei in #1399

• Revert "chore: Remove error_non_existing_primary_key for now becaus… by @chubei in #1419

• chore: refactor as dozer-log crate by @chubei in #1420

• fix: Use proper error message for postgres replication slot creation by @karolisg in #1422

• refactor: Store schema of sinks separately by @chubei in #1423

• feat: implement js log bindings by @chubei in #1424

• chore: Add deb generation to release process by @karolisg in #1432

• chore: Remove unnecessary workspace.exlude in Cargo.toml by @chubei in #1430

• feat: implement python log bindings by @chubei in #1426

• Bump h2 from 0.3.16 to 0.3.17 by @dependabot in #1427

Full Changelog: v0.1.16...v0.1.17

v0.1.16

What's Changed

• fix: README Ubuntu instructions by @mediuminvader in #1367
• test: Add integration test on Github runner by @chubei in #1371
• perf: Use MDB_APPEND when possible by @chubei in #1362
• feature: Implement authorization in gRPC methods by @karolisg in #1375
• refactor: Optimize the Join indexes structure by @mediuminvader in #1373
• feat: u128 and i128 Field and FieldType by @chloeminkyung in #1315
• feature: Add snapshotting started message to ingestion process by @karolisg in #1377
• fix: Fix web config usage in auth grpc service by @karolisg in #1380
• test: Implement integration test on Github runner by @chubei in #1378
• feature: Read object store files in parallel by @karolisg in #1381
• feat: Duration Field & FieldType support by @chloeminkyung in #1374
• feat: Duration for sql representation + aggregation support by @chloeminkyung in #1384
• fix: minor error while running with duration by @chloeminkyung in #1388
• fix: Update resolution atomicity and stream operations. by @chubei in #1390
• refactor: Remove Record::version. Add version to CacheRecord. by @chubei in #1392
• fix: grpc error caused by duration by @chloeminkyung in #1395

Full Changelog: v0.1.15...v0.1.16

v0.1.15

What's Changed

• feat: Implement ExecutionLog on fs 🚀 by @chubei in #1356
• feat: COALESCE() support by @chloeminkyung in #1342
• fix: openssl dependecies as features by @mediuminvader in #1358
• fix: Api should use read only cache manager by @chubei in #1346
• fix: Switch Right join order for empty cases by @mediuminvader in #1348

Full Changelog: v0.1.14...v0.1.15

v0.1.14

What's Changed

• refactor: Stop using lmdb NO_LOCK flag. by @chubei in #1337
• perf: Put indexing thread pool to idle if indexes are up to date by @chubei in #1320
• feat: make sources optional by @v3g42 in #1318
• doc: Add type conversion spec in API by @chubei in #1313
• test: Add cud test suite and implement for postgres by @chubei in #1309
• fix: Error handling in processor by @karolisg in #1325
• fix: division by zero error handling by @chloeminkyung in #1324
• fix: Update .deb url doc by @mediuminvader in #1333
• fix: Multimap single item removal by @mediuminvader in #1336

Full Changelog: v0.1.13...v0.1.14