Releases: TileDB-Inc/TileDB-Vector-Search
Releases · TileDB-Inc/TileDB-Vector-Search
0.5.0
What's Changed
- Fix CLion UI issue with long test names, cleanup C++ unit tests by @jparismorgan in #392
- Add missing
temporal_policy
toopen_array()
calls by @jparismorgan in #393 - Fix Vamana index not setting metadata when loaded by URI by @jparismorgan in #394
- Native code refactors and cleanups by @jparismorgan in #395
- Share max int / float values and index lists in Python by @jparismorgan in #396
- Update l2 distance to support
int8_t
by @jparismorgan in #400 - Update
feature_vector_array_with_ids
to requireid()
accessor by @jparismorgan in #401 - Update
add()
for IVF Flat and IVF PQ to take in IDs by @jparismorgan in #402 - Add query with driver implementation by @NikolaosPapailiou in #398
- Initial work to get IVF PQ working like Vamana does by @jparismorgan in #390
- Add Python IVF PQ Index by @jparismorgan in #404
- Add option to install libtiledb.so by @dudoslav in #361
- Fix bug with
adjacency_row_index_uri()
array type being incorrect, removeadjacency_row_index_type
from API by @jparismorgan in #405 - Cleanup IVF PQ test and add better logging on failure by @jparismorgan in #406
- Cleanup tdb_partitioned_matrix - move state to local variables and remove unused code by @jparismorgan in #408
- Add Vamana backwards compatibility data generation and tests by @jparismorgan in #409
- Pin mdspan version by @NikolaosPapailiou in #413
- Rename
opt_l
tol_search
by @jparismorgan in #411 - Update TileDB core 2.24.0 by @NikolaosPapailiou in #399
- Initial scaling strategy by @cainamisir in #407
New Contributors
- @cainamisir made their first contribution in #407
Full Changelog: 0.4.1...0.5.0
0.4.1
What's Changed
- Update
matrix_with_ids
to hold aunique_ptr
with an ids array instead of astd::vector
by @jparismorgan in #364 - [automated] Update backwards-compatibility-data for release 0.4.0 by @github-actions in #370
- Add clear_history() to C++, refactor group to allow static function to open a group by @jparismorgan in #371
- Use multiple workers for Python test execution by @NikolaosPapailiou in #367
- Add
clear_history()
implementation and Python API by @jparismorgan in #372 - Optimized graph algorithms for vamana by @lums658 in #282
- Test pytest parallelism by @jparismorgan in #377
- Add
TemporalPolicy
to Python, usestd::optional
instead oftimestamp_end = 0
to mark not set by @jparismorgan in #360 - Speed up
test_ingestion.py
tests by running on less data, mix up dimensions size more between tests by @jparismorgan in #376 - Rename
dimension
todimensions
in C++ code to match Python by @jparismorgan in #374 - Enable C++ Vamana test when there are no vectors in index so we should return defaults by @jparismorgan in #379
- Update Vamana metadata keys to use full names of values by @jparismorgan in #378
- Simplify and improve matrix debug helpers by @jparismorgan in #380
- Hide logs on noisy C++ tests by @jparismorgan in #387
- Restructure Python Documentation by @NikolaosPapailiou in #382
- Improve pytest latency by @NikolaosPapailiou in #383
- Rename
ivf_flat_index_group
toivf_flat_group
by @jparismorgan in #385 - Add initial Vamana docstrings to Python by @jparismorgan in #386
- Add partioned_matrix and tdb_partitioned_matrix unit tests & improve error handling by @jparismorgan in #381
- Lums/sc 42599/implement ivf pq index by @lums658 in #279
- Expose
build_config()
in Python by @jparismorgan in #388
Full Changelog: 0.4.0...0.4.1
0.4.0
What's Changed
- [automated] Update backwards-compatibility-data for release 0.3.0 by @github-actions in #336
- Fix tiledb direct URIs in C++ group's by @jparismorgan in #332
- Remove
std::reference_wrapper
aroundtiledb::Context
by @jparismorgan in #340 - Run Python ingestion tests on all indexes by @jparismorgan in #338
- Add support for int8 type indexes by @NikolaosPapailiou in #342
- Add support for
ingest()
withindex_timestamp
for type-erased indexes by @jparismorgan in #341 - Fix bug with relative Vamana indexes in Python by @jparismorgan in #344
- Remove unused code previously used to define arrays for testing by @jparismorgan in #346
- Update type-erased code to keep Ctx alive when calling into C++ to fix Vamana ingestion crash by @jparismorgan in #347
- Fix
Index.delete_index()
so that it uses recursive=True and deletes the full index by @jparismorgan in #348 - Do not create default
tiledb::Config
objects in C++ by @jparismorgan in #350 - Pass namespace correctly form ObjectAPI embeddings ingestion to vector ingestion by @NikolaosPapailiou in #352
- Fix pickle error
tiledb.FilterList
duringBATCH
ingestion for Vamana by @jparismorgan in #349 - Fix BATCH execution error by @NikolaosPapailiou in #351
- Fix non-contiguous queries when using Vamana by @jparismorgan in #343
- Update
FeatureVectorArray
to be able to read from URIs at a specified timestamp by @jparismorgan in #353 - Add some more instructions on how to build and setup CLion by @jparismorgan in #337
- Add int8 support to Vamana type-erased index by @jparismorgan in #355
- Remove unneeded clang-format CI job by @jparismorgan in #345
- Vamana type-erased index can be opened at a specific timestamp by @jparismorgan in #354
- Use unique path for ingestion
temp_data
group by @NikolaosPapailiou in #357 - Check releases.csv hash after download by @dudoslav in #339
- Update C++ code to use TemporalPolicy instead of a timestamp by @jparismorgan in #356
- Expose C++ TemporalPolicy in Python by @jparismorgan in #362
- Add more C++ and Python temporal policy unit tests by @jparismorgan in #359
- Refactor C++ group code and add more Vamana unit tests by @jparismorgan in #363
- Fix bug where in Python where if an index was loaded before the earliest ingested data, we'd still load and query data from the future by @jparismorgan in #365
- Support Vamana in the ObjectIndex by @jparismorgan in #366
- Fix bug in tdb matrix where we would read even when the array is empty and get nan values by @jparismorgan in #368
- Update TileDB core version by @NikolaosPapailiou in #369
Full Changelog: 0.3.0...0.4.0
0.3.0
What's Changed
- Fix type-erased Vamana
query()
by @jparismorgan in #317 - Add support for external ids with Vamana type-erased by @jparismorgan in #311
- [automated] Update backwards-compatibility-data for release 0.2.2 by @github-actions in #318
- Remove
id_type
andadjacency_row_index_type
in Vamana type-erased index by @jparismorgan in #320 - Remove filter for query results with id = 0 and distance = 0 by @jparismorgan in #319
- Code cleanup: rename l_build_ & r_max_degree & b_backtrack, remove TODOs, add CLion build instructions by @jparismorgan in #323
- Add needs dependency on backwards_compatibility_data by @dudoslav in #322
- Update
generate_data.py
to return whether we should upload the generated indexes by @jparismorgan in #324 - Remove
overwrite
fromwrite_index()
by @jparismorgan in #325 - Remove temp data in consolidate_and_vacuum by @NikolaosPapailiou in #321
- Only pass TILEDB_REST_TOKEN to test_cloud during CI by @NikolaosPapailiou in #327
- Support writing C++ type-erased indexes with a storage_version by @jparismorgan in #326
- Fix TileDB URIs with type-erased indexes, add Vamana test to test_cloud.py by @jparismorgan in #330
- Fix
consolidate_updates
error fortiledb://
URIs. by @NikolaosPapailiou in #329 - Add option to import OpenAIEmbeddings from langchain_openai by @NikolaosPapailiou in #328
- Cleanup C++ group code by @jparismorgan in #331
- Refactor and cleanup
index_group.h
by @jparismorgan in #333 - Add metadata tests for type-erased indexes in Python by @jparismorgan in #334
- Increment TileDB core version to 2.22.0 by @jparismorgan in #335
Full Changelog: 0.2.2...0.3.0
0.2.2
What's Changed
- Fix local ingestion by passing a dummy default namespace by @NikolaosPapailiou in #316
Full Changelog: 0.2.1...0.2.2
0.2.1
What's Changed
- [automated] Update backwards-compatibility-data for release 0.1.3 by @github-actions in #297
- [automated] Update backwards-compatibility-data for release 0.2.0 by @github-actions in #298
- Update
set_has_updates()
to be able to set tofalse
by @jparismorgan in #299 - Update
create_empty_for_vector()
andwrite_vector()
to write to col major vectors by @jparismorgan in #300 - Update
tdb_matrix
to load in the non-empty domain instead of the full domain by @jparismorgan in #301 - Fix C++ indexes not saving metadata after the first
write_index()
by @jparismorgan in #302 - Fix unit_slicing and re-enable in CI by @jparismorgan in #303
- Run
pre-commit
to lint files by @jparismorgan in #305 - Explicitly define some missing build requirements by @jdblischak in #306
- Propagate namespace to create_ingestion_dag by @Shelnutt2 in #307
- Support access_credentials_name for BATCH tasks by @Shelnutt2 in #308
- Add CI job to run
pre-commit
by @jparismorgan in #309 - Support updates for object API by @NikolaosPapailiou in #310
- Type erased Vamana index by @jparismorgan in #285
- Support access credentials name for vamana ingestion by @Shelnutt2 in #312
- Allow all batch task resources to be overridden by @Shelnutt2 in #315
New Contributors
- @jdblischak made their first contribution in #306
Full Changelog: 0.2.0...0.2.1
0.2.0
0.1.3
What's Changed
- Fix backwards compatibility CI job by @jparismorgan in #295
- Fix source distribution config.h in superbuild by @dudoslav in #296
Full Changelog: 0.1.2...0.1.3
0.1.2
What's Changed
- Add
tdbPreLoadMatrixWithIds
by @jparismorgan in #284 - Make distance functions a type parameter (and function argument) by @lums658 in #265
- Fix packaging version by @dudoslav in #276
- Fix flaky unit tests by @jparismorgan in #288
- Small type alias fix in matrix_with_ids.h by @lums658 in #259
- Update
temp_size
metadata to int64 by @jparismorgan in #289 - Make clear which
ctx
we are using in Python by @jparismorgan in #290 - Add a type-erased Vamana index (which only supports creation) by @jparismorgan in #286
- Add support for more input sources in DirectoryReader by @NikolaosPapailiou in #283
Full Changelog: 0.1.1...0.1.2
0.1.1
What's Changed
- Fix all MSVC compilation issues by @dudoslav in #250
- Add IDs to
FeatureVectorArray
by @jparismorgan in #252 - Implement AVX2 distance computations by @lums658 in #261
- Fix broken path on Windows in
unit_tdb_matrix_with_ids.cc
by @jparismorgan in #267 - Fix some ingestion bugs by @NikolaosPapailiou in #266
- Add support for reading an empty vector with
read_vector()
by @jparismorgan in #269 - Add support for an empty
tdb_matrix
by @jparismorgan in #268 - Fix backwards compatibility data generation CI job to not include commits from
release
by @jparismorgan in #271 - Run backwards compatibility unit tests in C++ and read types metadata in
ivf_flat_index.h
by @jparismorgan in #270 - Remove
[ci-skip]
on unit tests by @jparismorgan in #275 - Add debug helper to
matrix_with_ids
by @jparismorgan in #272 - Update URIs in
test_cloud.py
to match other unit tests by @jparismorgan in #277 - [automated] Update backwards-compatibility-data for release 0.0.22 by @github-actions in #256
- [automated] Update backwards-compatibility-data for release 0.0.23 by @github-actions in #264
- Add support for LangChain embeddings in Object API by @NikolaosPapailiou in #280
- Update attribute name in test arrays by @lums658 in #227
- Add more Python and C++ unit tests around metadata by @jparismorgan in #281
New Contributors
- @github-actions made their first contribution in #256
Full Changelog: 0.0.23...0.1.1