milvus-2.4.14
v2.4.14
Release Date: October 31, 2024
Milvus version | Python SDK version | Java SDK version | Node.js SDK version |
---|---|---|---|
2.4.14 | 2.4.9 | 2.4.7 | 2.4.9 |
Milvus 2.4.14 addresses a critical issue from version 2.4.13 that could cause collection information to be lost after snapshotKV
garbage collection. It also fixed a couple of resource leaks. Additionally, this release includes numerous enhancements focused on improving stability in large-scale delete operations and compaction performance.
Features
Improvements
- Delete/Compaction Optimization
- Enabled parallel execution of l0 compactions (#36985)
- Batched forward delete when using direct forward (#37107)
- Skipped loading delta data in delegater when using remoteload (#37112)
- Directly forwarded delta excluding l0 segments (#36914)
- Added prioritization of compaction tasks in DataCoord (#36979)
- Tracked complex delete rates (#36958)
- Refactored CreateCollection in RESTFul API (#36885)
- Fused multiple 'and' and 'or' operations into a single op (#36973)
- Made skip load work for all branches (#37161)
- Upgraded Minio dependency to support EKS Pod Identities (#37089)
- Tidied import options (#37078)
- Limited maximum number of import jobs (#36892)
- Preallocated data slice to avoid re-allocating memory (#37044)
- Prevented DataNode from loading the bf (#37027)
- Avoided limiting ddl operations repeatedly (#37011)
- Made the configuration item
datanode.import.maxconcurrenttasknum
dynamically adjustable (#37103) - Used
queryNode.mmap.growingMmapEnabled
to control the behavior of interim index (#36391) - Populated the
Level
andStartPosition
fields in segmentLoadInfo of growing segment (#36911) - Forced to stop buffer messages when receiving the drop collection message (#36917)
- Added metrics for querynode delete buffer info (#37097)
- Added collection name label for some metric (#37159)
- Used middleware to observe RESTful v2 in/out rpc stats (#37224)
- Changed GPU default memory pool size (#36969)
- Updated Knowhere version to 2.3.12 (#37132)
- Allowed deleting data when disk quota exhausted (#37139)
Bug fixes
- Fixed collection info that could not be recovered from metakv after restart if all snapshots were garbage collected (#36950)
- Corrected the rpc error code to avoid invalid retry in client (#37025)
- Ignored db not found error in quota center (#36850)
- Fixed goroutine leakage in QueryNode by using singleton delete pool (#37225)
- Fixed collection leak in querynode (#37079)
- Fixed leakage of clustering compaction task (#36803)
- Prohibited renaming a collection that had an alias (#37208)
- Made sure alias was cached (#36808)
- Search/query could have failed during updating delegator cache (#37174)
- Excluded l0 compaction when clustering was executing (#37142)
- Referenced collection meta when loading l0 segment meta only (#37179)
- Delegator might have become unserviceable after querycoord restart (#37100)
- Dynamic release partition might have failed search/query (#37099)
- Rectified delete buffer row count quota value (#37068)
- Passed full field list when partial load enabled (#37063)
- Query node panic occurred during sending rpc to worker (#36988)
- Datacoord got stuck at stopping progress (#36961)
- Fixed the out-of-bounds access in the growing segment when raw data was replaced by interim index (#36938)
- Rootcoord got stuck at graceful stop progress (#36881)