Skip to content

milvus-2.4.14

Compare
Choose a tag to compare
@yanliang567 yanliang567 released this 29 Oct 13:01
· 1497 commits to master since this release
8370caa

v2.4.14

Release Date: October 31, 2024

Milvus version Python SDK version Java SDK version Node.js SDK version
2.4.14 2.4.9 2.4.7 2.4.9

Milvus 2.4.14 addresses a critical issue from version 2.4.13 that could cause collection information to be lost after snapshotKV garbage collection. It also fixed a couple of resource leaks. Additionally, this release includes numerous enhancements focused on improving stability in large-scale delete operations and compaction performance.

Features

  • Supported memory mode chunk cache (#35836)
  • Supported db for bulkinsert (#37017)

Improvements

  • Delete/Compaction Optimization
    • Enabled parallel execution of l0 compactions (#36985)
    • Batched forward delete when using direct forward (#37107)
    • Skipped loading delta data in delegater when using remoteload (#37112)
    • Directly forwarded delta excluding l0 segments (#36914)
    • Added prioritization of compaction tasks in DataCoord (#36979)
    • Tracked complex delete rates (#36958)
  • Refactored CreateCollection in RESTFul API (#36885)
  • Fused multiple 'and' and 'or' operations into a single op (#36973)
  • Made skip load work for all branches (#37161)
  • Upgraded Minio dependency to support EKS Pod Identities (#37089)
  • Tidied import options (#37078)
  • Limited maximum number of import jobs (#36892)
  • Preallocated data slice to avoid re-allocating memory (#37044)
  • Prevented DataNode from loading the bf (#37027)
  • Avoided limiting ddl operations repeatedly (#37011)
  • Made the configuration item datanode.import.maxconcurrenttasknum dynamically adjustable (#37103)
  • Used queryNode.mmap.growingMmapEnabled to control the behavior of interim index (#36391)
  • Populated the Level and StartPosition fields in segmentLoadInfo of growing segment (#36911)
  • Forced to stop buffer messages when receiving the drop collection message (#36917)
  • Added metrics for querynode delete buffer info (#37097)
  • Added collection name label for some metric (#37159)
  • Used middleware to observe RESTful v2 in/out rpc stats (#37224)
  • Changed GPU default memory pool size (#36969)
  • Updated Knowhere version to 2.3.12 (#37132)
  • Allowed deleting data when disk quota exhausted (#37139)

Bug fixes

  • Fixed collection info that could not be recovered from metakv after restart if all snapshots were garbage collected (#36950)
  • Corrected the rpc error code to avoid invalid retry in client (#37025)
  • Ignored db not found error in quota center (#36850)
  • Fixed goroutine leakage in QueryNode by using singleton delete pool (#37225)
  • Fixed collection leak in querynode (#37079)
  • Fixed leakage of clustering compaction task (#36803)
  • Prohibited renaming a collection that had an alias (#37208)
  • Made sure alias was cached (#36808)
  • Search/query could have failed during updating delegator cache (#37174)
  • Excluded l0 compaction when clustering was executing (#37142)
  • Referenced collection meta when loading l0 segment meta only (#37179)
  • Delegator might have become unserviceable after querycoord restart (#37100)
  • Dynamic release partition might have failed search/query (#37099)
  • Rectified delete buffer row count quota value (#37068)
  • Passed full field list when partial load enabled (#37063)
  • Query node panic occurred during sending rpc to worker (#36988)
  • Datacoord got stuck at stopping progress (#36961)
  • Fixed the out-of-bounds access in the growing segment when raw data was replaced by interim index (#36938)
  • Rootcoord got stuck at graceful stop progress (#36881)