For installation instructions check out the getting started guide. Added postgres_cdc: Added incremental snapshot support to Postgres CDC, enabling tables to be backfilled in chunks while replication continues running, eliminating the need for snapshot-induced stream blocking or restart from the beginning. (@josephwoodward, #4811) oracledb_cdc: Implemented a log_count based algorithm for the Oracl…
For installation instructions check out the getting started guide. Added oracledb_cdc: Implemented a log_count based algorithm for the Oracle CDC window strategy to improve change capture efficiency. (@josephwoodward, #4864) postgres_cdc: Added support for incremental snapshot backfills that run alongside live replication, allowing tables to be captured in chunks without blocking the replication s…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added mssqlserver_cdc: Exposed seqval and command_id metadata fields alongside lsn to enable proper ordering of changes within transactions. (@Leward, #4831) oracledb_cdc: Added prefetch_rows configuration option to optimize LogMiner query performance. (@josephwoodward, #4698) websocket: Enabled websocket input and output component…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added oracledb_cdc: Oracle CDC connector now includes username as metadata in events for better traceability. (@josephwoodward, #4674) Fixed iceberg: Replaced MinIO with silo fork in tests to work around MinIO's removal from Docker Hub. (@Leward, #4819) snowflake_streaming: Fixed offset token comparison to handle unpadded numeric t…
For installation instructions check out the getting started guide. Added avro: Added max_decompressed_block_bytes configuration field to cap OCF block decompression and prevent decompression-bomb denial-of-service attacks. (@Jeffail, #4773) aws_kinesis: Added a poll_period field to bound the rate of GetRecords calls per shard, and an enhanced_fan_out configuration block that consumes streams via a…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Settle acks by handle and isolate per-shard backpressure (@squiidz, #4739) prometheus: Fixed prometheus exporter accumulating frozen metric series for deleted streams by purging their labels when streams are deleted. (@squiidz, #4742) aws_dynamodb_cdc: Fixed shard discovery aborting on transient failures by…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed aws_dynamodb_cdc: Fixed snapshot_throttle lint rule that was comparing duration string to numeric literal, causing configuration validation to fail. (@squiidz, #4723) aws_dynamodb_cdc: Fixed infinite retry loop when a DynamoDB shard iterator expires after the shard has been deleted by properly classifying the error as permane…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added salesforce_cdc: Added decode-failure bounds and classification of schema-fetch errors (deterministic vs transient) to prevent infinite retry loops and livelocks, with terminal failures surfaced clearly to the health check. (@squiidz, #4689) mongodb, mongodb_cdc: Added AWS IAM authentication (MONGODB-AWS) for MongoDB Atlas to…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Added postgres_cdc: Added support for control signals in PostgreSQL CDC by detecting and forwarding rows inserted into a configurable signal table downstream like regular messages. (@josephwoodward, #4637) iceberg: Added an opt-in merge_strategy: copy-on-write for row-level upsert/delete, which materialises mutations by rewriting w…
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
For installation instructions check out the getting started guide. Fixed kafka: Fixed incorrect validation of max_in_flight_requests with idempotent_write enabled, which was causing silent failures instead of configuration errors. (@prakhargarg105, #4645) oracledb_cdc: Improved Oracle CDC snapshot handling by skipping unnecessary checkpointing during snapshot reads. (@josephwoodward, #4670) redpan…