vineyard v0.10.2

Vineyard v0.11.2 improves in the following two aspects,

• implements LocalVertexMap to vineyard-graph.
• implements basic spark integration in the Java SDK.

Commits

• [eed85833]: Don't continue if error occurs during building the array (#1063) (Tao He)
• [38472d45]: Fixes a warning in local vertex map (#1062) (Tao He)
• [a19f103b]: Fix local vertex map when adding edges (#1061) (Siyuan Zhang)
• [3e7ab0ad]: Add options to configure webhook in helm chart and improve the relevant doc. (#1060) (Ye Cao)
• [5d810153]: Resolves failures and warnings in CI (#1058) (Tao He)
• [3add7e17]: Add default value to vineyard deployment, remove ad-hoc filling and fixes typos. (#1057) (Tao He)
• [693af786]: Implement local vertex map in arrow fragment. (#1053) (Siyuan Zhang)
• [71c0afed]: Update vineyard operator's image to vineyardcloudnative/vineyard-operator (#1056) (Ye Cao)
• [430bf6ab]: Revise the vineyard-operator docs: first part. (#1055) (Tao He)
• [ac714de2]: Improve vineyard operator doc. (#1054) (Ye Cao)
• [69108db7]: Enable support for parquet and ORC IO (#1052) (Tao He)
• [3c369893]: Add Vineyard Operator Documention (#1051) (Ye Cao)
• [e7d594a1]: Java: use cmake plugin to build FFI sources. (#1050) (Tao He)
• [ac5f5aed]: Bump junit from 4.12 to 4.13.1 in /java/spark (#1049) (dependabot[bot])
• [c731b96f]: Spark on vineyard POC: run spark RDD/DataFrame APIs and SQL on vineyard table. (#1048) (Tao He)
• [48871f3a]: Add dask repartition operation to pluggable drivers. (#1041) (Ye Cao)
• [1d499f6e]: Add git leaks hooks to this repo (#1045) (Tao He)
• [5675b1a2]: Fixes the read_bytes.py to adapt to the latest fsspec (#1044) (Tao He)
• [1e96b60d]: Source more rf-files and use bash -lc when starting IO drivers (#1043) (Tao He)
• [ef452b55]: operator: move the SchedulerState into a standalone file. (#1042) (Ye Cao)
• [23173c0d]: Source /etc/bash.bashrc as well for Ubuntu 2.04 (#1040) (Tao He)

vineyard v0.10.1

Vineyard 0.10.1 is a bugfix release that addresses some compatibility issues.

Commits

• [4a242a1c]: Upgrade vineyard version to v0.10.1 to fixes the wheel error (Tao He)
• [dd723aa4]: Move to ubuntu 20.04 and give up ubuntu 18.04 support (#1038) (Tao He)
• [a370e20d]: Fixes error in vineyard-operator's CRDs (#1039) (Ye Cao)

vineyard v0.10.0

Vineyard v0.10.0 brings the following highlighted features:

• Improve the vineyard-operator to add assembly and migration support.
• Refactor the migration implementation and enables transparent compression as an optimization.
• Fixes several errors in IO drivers and improve the error diagnostics.
• Add the cllient.ListNames() API to list all available names inside the cluster.

Commits

• [42a545cf]: Fixes reading ultra-small sized files (#1036) (Tao He)
• [02366680]: Tune the logs when IO driver fails and avoid leak sensitive information in logs (#1035) (Tao He)
• [9651469c]: Fix the error in Dockerfile.vineyard-python-dev (#1034) (Ye Cao)
• [de97d306]: Update helm chart for new CRD (#1032) (Ye Cao)
• [56f1186d]: Implement vineyard assembly operation in vineyard-operator (#990) (Ye Cao)
• [251bf5d4]: Add support for Apache Arrow 10.0.0 (#1030) (Sutou Kouhei)
• [b1e01e12]: Move migration from client to server and push the work to IO workers. (#1027) (Tao He)
• [0b435614]: Revert "Share the etcd and redis watcher between sessions (#1007)" (#1028) (Tao He)
• [bf0e4b26]: upgrade GitHub actions version (#1026) (Siyuan Zhang)
• [6fa66757]: Upgrade required etcd-cpp-apiv3 to v0.2.9. (#1025) (Tao He)
• [accc58bb]: RPC server for sessions: share the same port and switch to child session when needed. (#1024) (Tao He)
• [4c5835e4]: Share the etcd and redis watcher between sessions (#1007) (ShiHao)
• [ff1f050e]: Implements "ListNames". (#1023) (Tao He)
• [c68d0059]: Add Docker Hub badge in the readme (#1021) (Ye Cao)
• [8030d36c]: Add Dockerfile for vineyard python-dev (#1017) (Ye Cao)
• [18cd5c27]: Enable webhook in vineyard operator (dashanji)
• [7580d719]: Add webhook service (dashanji)
• [ec758a6b]: Clean the vineyard operator. * Clean the vineyard operator's configuration. * Add webhook for the vineyard operator helm chart. * Readjust the limits and required of the controller. (dashanji)
• [8deed7b7]: Use the annotation to replace label for vineyard job (#1019) (Ye Cao)
• [910e0d49]: Bump up dependency version to fixes the dependentbot warnings (#1013) (Tao He)
• [07dd5b7a]: Avoid print too much logs (#1011) (Tao He)
• [5e58bb0a]: Disable the coredump by default and add an command line option to enable it (#1010) (Tao He)
• [6c518fa1]: Fix bug in vineyard-operator ci (#1006) (Ye Cao)

vineyard v0.9.0

Vineyard v0.9.0 is the first release of v0.9 series, include a notable bugfix where a data race may occuring during load graphs.

Commits

• [4bdd29b2]: Ensure no resize() operation happens at the same time between different worker threads (#1005) (Tao He)
• [bc61680f]: Login into the docker registry to publish image to github packages (Tao He)
• [d861e88c]: Release vineyard-operator in ci (#1002) (Ye Cao)
• [e4e435b1]: Delete the vineyard controller image (#1000) (Ye Cao)

vineyard v0.8.6

Vineyard v0.8.6 improves the C++ template files a bit.

Commits

• [8d593b1f]: Fixes the syntax error in comments (#999) (Tao He)
• [e997c3ef]: Syntax highlighting in VIM. (#998) (Tao He)
• [dce0a5de]: Unsigned types in graphs schema. (#997) (Tao He)
• [51019226]: Nested ns declaration is a C++17 extension. (#996) (Tao He)
• [bd7cb9ae]: Fixes the construct of global dataframe/tensor to match the semantic of python. (#994) (Tao He)
• [00a15f42]: Add debuginfo only for vineyard components (#992) (Tao He)

vineyard v0.8.5

Vineyard v0.8.5 supports adding columns to edge table of arrow fragments.

Commits

• [74997e35]: Support add edge column for ArrowFragment. (#987) (Zhang Lei)
• [269f3ba4]: Delete useless config in vineyard operator (#985) (Ye Cao)

vineyard v0.8.4

Vineyard v0.8.4 is a bugfix release.

Commit

• [66feaea2]: Restore the changes for the 'name' of property types (#986) (Tao He)

vineyard v0.8.3

Vineyard v0.8.3 came with the following enhancement:

• Support redis as the metadata backend
• The memory usage of the graph data structure has been optimized
• A vineyard-operator has been added to simplify the deploy and management of vineyard cluster as well as the shared objects.

Commits

• [b901792e]: Move some implementation to .cc to reduce compliation time. (#984) (Tao He)
• [2322faa8]: Remove unused generated clientset/listers/informers and fixes a bug in codegen annotation. (#982) (Tao He)
• [a51ad2f2]: CMake: find and set ccache correctly. (#983) (Tao He)
• [888a67f7]: Disable the lru_test if tbb is not found (#981) (Tao He)
• [61bbc615]: Fix dependency (#980) (Ye Cao)
• [e611dcba]: Add helm chart for vineyard operator (#977) (Ye Cao)
• [a45543ae]: Fixes error under lower version of C++ in wyhash.hpp. (#979) (Tao He)
• [f51ebe1c]: Fixes the typo: ConsodilateColumns -> ConsolidateColumns (#978) (Tao He)
• [24af41e7]: Add Vineyardd CRD and Controller (#951) (Ye Cao)
• [0a948f23]: Use wyhash as the hash function when building the hashmap to reduce memory usage (#976) (Tao He)
• [515f13e8]: Add a consolidate method to merge multiple columns of same type in a table into one (#975) (Tao He)
• [a6528a11]: Lightweight metadata service backend for vineyard (#902) (ShiHao)

vineyard v0.8.2

Vineyard v0.8.2 is a bugfix version that address the deadlock issue during spill happening.

Commits

• [337e71df]: Use a recursive mutex to fixes the deadlock failure (#972) (Tao He)

vineyard v0.8.1

Vineyard v0.8.1 is a bugfix release that addressed the lock crash issue inside vineyardd.

Commits

• [b478b907]: Lock the mutex when declare the lock (#971) (Tao He)
• [745faa1e]: Fixes compatibility build (#969) (Tao He)