What's Changed Breaking Changes 🛠 perf(compaction)!: skip building row-address maps when index remapping is not needed by @everySympathy in #7778 perf(cache)!: use fixed-size cache keys by @Ali2Arslan in #7878 fix(blob)!: preserve null selections across blob APIs by @Xuanwo in #7903 Critical Fixes ‼️ fix(exec): preserve order when coalescing a sorted multi-partition plan by @wjones127 in #7868 fix…
What's Changed Breaking Changes 🛠 feat(mem_wal): validate maintained indexes against the writer's rules by @hamersaw in #8360 New Features 🎉 feat(rowids): validate stable row ids in Dataset::validate by @wjones127 in #8258 feat(python): expose BlobFile.read_ranges by @keunhong in #8319 feat(java): expose index segment sizes by @majin1102 in #8355 feat(python): add RowIdSequence for constructing ro…
What's Changed Breaking Changes 🛠 feat(mem_wal): return the sealed generation from force_seal_active by @hamersaw in #8051 feat(mem_wal): expose whether an index type can be maintained by @hamersaw in #8095 New Features 🎉 perf(dataset): spill large inline transaction out of manifest by @zhangyue19921010 in #7881 feat(object-store): add explicit IRSA and ECS credential storage options by @westonpac…
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v9.0 in #8158. Bug Fixes 🐛 fix(ci): backport cargo publish fix to release/v9.0 by @wjones127 in #7990 Full Changelog: v9.0.0...v9.0.…
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v8.0 in #8157. Full Changelog: v8.0.0...v8.0.1
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v7.1 in #8156. New Features 🎉 feat: clean up data files on failed writes by @wjones127 in #6320 feat: query with scalar index suppor…
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v6.1 in #8155. Full Changelog: v6.0.0...v6.1.0
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v4.0 in #8153. Full Changelog: v4.0.1...v4.0.2
What's Changed Critical Fixes ‼️ fix(encoding): bounds-check the length prefix in VariableFullZipDecoder::unzip by @professor-moody in #8138 fix(encoding): reject out-of-bounds variable-width offsets on decode by @Xuanwo in #8144 Both fixes were backported to release/v3.0 in #8152. Full Changelog: v3.0.1...v3.0.2
What's Changed Breaking Changes 🛠 refactor!: compose exact current-format readers by @Xuanwo in #8024 refactor: centralize exact dataset write policy by @Xuanwo in #8025 refactor: move file-version selectors to lance-file by @Xuanwo in #8026 fix(cache): deduplicate deep size accounting by @app/lance-gatekeeper in #8159 fix(encoding): return errors for malformed variable-width offsets by @app/lance…
Release root for 11.0.0-beta.N series (same base as 10.1.0-beta.N)
What's Changed Breaking Changes 🛠 perf(compaction)!: skip building row-address maps when index remapping is not needed by @everySympathy in #7778 perf(cache)!: use fixed-size cache keys by @Ali2Arslan in #7878 fix(blob)!: preserve null selections across blob APIs by @Xuanwo in #7903 Critical Fixes ‼️ fix(exec): preserve order when coalescing a sorted multi-partition plan by @wjones127 in #7868 fix…
What's Changed Bug Fixes 🐛 fix(ci): backport cargo publish fix to release/v9.0 by @wjones127 in #7990 fix(encoding): backport corruption-safety fixes to release/v9.0 by @Xuanwo in #8158 Full Changelog: v9.0.0...v9.0.1-rc.1
What's Changed Bug Fixes 🐛 fix(encoding): backport corruption-safety fixes to release/v8.0 by @Xuanwo in #8157 Full Changelog: v8.0.0...v8.0.1-rc.1
What's Changed New Features 🎉 feat: clean up data files on failed writes by @wjones127 in #6320 feat: query with scalar index support fast search ability by @zhangyue19921010 in #6784 feat: support batch vector queries by @LeoReeYang in #6828 feat: expose index segments in Python scanner by @hfutatzhanghb in #6872 feat(namespace-dir): implement table tag operations by @XuQianJin-Stars in #6886 fix…
What's Changed Bug Fixes 🐛 fix(encoding): backport corruption-safety fixes to release/v6.1 by @Xuanwo in #8155 Full Changelog: v6.0.0...v6.1.0-rc.2
What's Changed Breaking Changes 🛠 refactor!: cleanup namespace related APIs by @jackye1995 in #6186 feat!: add progress monitoring via callbacks for distributed merge by @vivek-bharathan in #6210 refactor!: remove staging from distributed vector indexing by @Xuanwo in #6269 refactor: move DatasetIndexExt out of lance-index by @Xuanwo in #6280 feat!: support sampling selected fragments by @Xuanwo i…
What's Changed Bug Fixes 🐛 fix(encoding): backport corruption-safety fixes to release/v4.0 by @Xuanwo in #8153 Full Changelog: v4.0.1...v4.0.2-rc.1
What's Changed Bug Fixes 🐛 fix(encoding): backport corruption-safety fixes to release/v3.0 by @Xuanwo in #8152 Full Changelog: v3.0.1...v3.0.2-rc.1
What's Changed New Features 🎉 feat(cache): support register and switch pluggable cache backend by @yanghua in #7683 feat(java): expose index build progress callbacks by @hfutatzhanghb in #8090 feat(fts): compose boosted compound scorers by @BubbleCal in #8094 feat(fts): export CompoundQueryExec and support an injected base scorer by @LuQQiu in #8131 feat(goosefs): implement safe commit with Condit…
What's Changed New Features 🎉 feat(python): expose file size from LanceFileWriter by @FANNG1 in #7876 feat(java): add OpenTelemetry metrics bridge by @yanghua in #8064 feat(java): expose fragment statics through java blocking dataset by @zhangyue19921010 in #8072 feat(fts): add composable scorer core for multimatch by @BubbleCal in #8092 feat(fts): compose boolean and phrase scorers by @BubbleCal…
What's Changed Breaking Changes 🛠 perf(compaction)!: skip building row-address maps when index remapping is not needed by @everySympathy in #7778 perf(cache)!: use fixed-size cache keys by @Ali2Arslan in #7878 fix(blob)!: preserve null selections across blob APIs by @Xuanwo in #7903 Critical Fixes ‼️ fix(exec): preserve order when coalescing a sorted multi-partition plan by @wjones127 in #7868 New…
What's Changed Breaking Changes 🛠 perf(compaction)!: skip building row-address maps when index remapping is not needed by @everySympathy in #7778 perf(cache)!: use fixed-size cache keys by @Ali2Arslan in #7878 fix(blob)!: preserve null selections across blob APIs by @Xuanwo in #7903 Critical Fixes ‼️ fix(exec): preserve order when coalescing a sorted multi-partition plan by @wjones127 in #7868 New…
Release root for 10.1.0-beta.N series
What's Changed Breaking Changes 🛠 perf(cache)!: use fixed-size cache keys by @Ali2Arslan in #7878 New Features 🎉 feat: introduce exact file format identity and persisted codecs by @Xuanwo in #7879 feat(python): expose LABEL_LIST segment index build by @ddupg in #7884 feat(namespace): idempotent create_table_version with strict CAS and dotfile-safe reserved marker by @XuQianJin-Stars in #7940 Bug F…
What's Changed New Features 🎉 feat(index): per-query index cache hit/miss stats by @yanghua in #7862 Bug Fixes 🐛 fix: preserve blob selection cardinality by @Xuanwo in #8003 Performance Improvements 🚀 perf(encoding): cache complex-all-null levels in RLE run form and drain run-by-run by @Ali2Arslan in #7564 Full Changelog: v10.0.0-beta.5...v10.0.0-beta.6
What's Changed New Features 🎉 feat(index): support segmented ngram index by @zhangyue19921010 in #7244 Full Changelog: v10.0.0-beta.4...v10.0.0-beta.5
What's Changed New Features 🎉 feat(fts): add native exact segment selection by @Xuanwo in #7976 Bug Fixes 🐛 fix(ci): unblock cargo publish and dry-run packaging in CI by @wjones127 in #7989 Documentation 📚 docs: fix nested agent guide loading and trim root AGENTS.md by @Xuanwo in #7992 Performance Improvements 🚀 perf(fts): search partitions in pipelined chunks by @LuQQiu in #7950 perf(cache): opt-…
What's Changed Breaking Changes 🛠 refactor!: rename FMIndexIndexDetails to FMIndexDetails by @westonpace in #7397 feat(fts)!: add configurable posting block size by @BubbleCal in #7466 feat(fts)!: make v2 the default index format by @BubbleCal in #7512 New Features 🎉 feat(namespace-dir): add alter table column operations (add/alter/drop) by @XuQianJin-Stars in #6273 feat: compile-time feature-gate…
What's Changed New Features 🎉 feat: support merge_insert when source omits blob columns by @nyl3532016 in #7615 feat(index): use ACORN-1 traversal for prefiltered HNSW search by @leohoare in #7927 feat: support segmented RTree indexes by @jackye1995 in #7932 Bug Fixes 🐛 fix: avoid panic due to empty IO buffers on tokio runtime shutdown by @ilya-zlobintsev in #7478 fix(blob): unwrap Option in merge…