All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
- Fix OME-Zarr version support in docs
0.6.0 - 2024-11-23
- Add
zarrs_validate
to check that arrays are equivalent - Add
--write-shape
argument tozarrs_reencode
- This enables writing sharded arrays incrementally
- Add
cargo binstall
install instructions
- #12 Bump netcdf to 0.10.2 by @magnusuMET
- Breaking: Bump MSRV to 1.80
- Bump
sysinfo
to 0.32 - Bump
zarrs
to 0.18.0 ncvar2zarr
:- Switch to output concurrency
- Breaking: Rename
concurrent-blocks
argument toconcurrent-chunks
- Breaking: Removed
validate
argument - Breaking: Removed
concat-dim
argument. Concatenation is now only supported along the first (slowest varying) dimension - This tool is intended to be replaced by
icechunk
/virtualizarr
when they mature
- Move benchmark scripts and measurements to https://github.com/LDeakin/zarr_benchmarks
- Bump
zarrs_opendal
to 0.4.0 (opendal
0.50) - Include
zarrs
version when running binaries with-v
/--version
- Cleanup
zarrs_info
docs and CLI help zarrs_ome
- add OME-Zarr 0.5 support, remove interim 0.5 version support
- Bump
ome_zarr_metadata
to 0.2.0 - Rename
--version
to--ome-zarr-version
- Remove
--no-gaussian
argument - Add
--gaussian-sigma
and--gaussian-kernel-half-size
arguments, mean downsampling is now the default - Map a "channel" unit to a channel type axis
- Bump
thiserror
to 2.0.0
zarrs_info
: Remove--time
argument
zarrs_ome
fix axis unit parsing (broken in 0.5.3)
0.6.0-beta.1 - 2024-11-15
0.5.5 - 2024-07-31
- Add http read support to
zarrs_reencode
- Bump
opendal
to 0.48
0.5.4 - 2024-07-30
- Bump
zarrs
to 0.16.0
- Fixed
zarrs_reencode
with--shard-shape
applying existing array-to-array and bytes-to-bytes codecs as both inner and outer codecs
0.5.3 - 2024-07-24
- Add
ome_zarr_metadata
dependency for OME-Zarr metadata serialisation
zarrs_reencode
: revise output and update docs- Update benchmarks and add plots
- Make the help clearer for valid chunk key encoding separators in various tools
0.5.2 - 2024-07-10
- Add
--dimension-names
arg tozarrs_filter
,zarrs_ome
,zarrs_reencode
to change dimension names
- Remove unused
http
feature fromzarrs
dependency
0.5.1 - 2024-07-07
zarrs_info
: add group metadata support
- Bump
zarrs
to 0.15.0 - Add
HTTP
store support to most benchmark binaries/scripts
0.5.0 - 2024-07-02
- Add
zarrs_info
(requiresinfo
feature): returns information about a Zarr array to stdout (JSON encoded)- Metadata
- Array shape, data type, fill value, dimension names, attributes, etc.
- Value range
- Histogram
- Bump
zarrs
to 0.15.0-beta.1 - Bump
rayon
to 1.10.0 - Bump
itertools
to 0.13 zarrs_ome
: add--version
arg, supporting0.5-dev
or0.5-dev1
- Change
zarrs_ome
default output behaviour to erase - Update benchmarks to use
zarrs
0.15.0-beta.1
0.4.2 - 2024-05-16
- Bump zarrs to 0.14.0
- Disable concurrent netCDF block processing in
zarrs_ncvar2zarr
0.4.1 - 2024-05-06
- Replace
--no_overwrite
with--exists
inzarrs_filter
andzarrs_ome
- Both support
erase
andexit
options zarrs_ome
also supports anoverwrite
option
- Both support
zarrs_{ncvar,binary}2zarr
output size change in human readable bytes- Change
zarrs_{filter,ome}
to multi progress bars - Print input path with
zarrs_{ncva2zarr,ome}
- Add bytes codec to encoding/reencoding help
- Remove
--hide-progress
fromzarrs_filter
0.4.0 - 2024-04-20
zarrs_filter
: apply simple image filters (transformations) to an arrayzarrs_ome
: convert an array to OME-Zarr- Add
--endianness
option tozarrs_binary2zarr
- Breaking: put various tools behind feature flags
- Bump
rayon_iter_concurrent_limit
to 0.2.0 - Various minor fixes to clap help
zarrs_reencode
: add--attributes-append
to re-encoding options- Bump
zarrs
to 0.13.0 - Breaking: Bump MSRV to 1.75
0.3.0 - 2024-02-22
- Add benchmark data generator:
scripts/generate_benchmark_array.py
- Add benchmark runners:
scripts/run_benchmark_read_{all,chunks}.py
- Add tensorstore benchmark script
- Bump
cargo-dist
to to 0.10.0 zarrs_benchmark_read_{sync,async}
,zarrs_binary2zarr
,zarrs_reencode
- Make
--concurrent-chunks
optional, choosing optimal by default
- Make
zarrs_ncvar2zarr
- Change
--num-parallel-blocks
to--concurrent-blocks
and make it optional - Remove
--no-parallel-codecs
- Change
- Improve internal concurrency
- Update benchmarks with
zarrs
v0.12.0 - Update dependencies
0.2.3 - 2024-02-06
--ignore_checksums
argument tozarrs_reencode
andzarrs_benchmark_read_{sync,async}
- See the relevant zarrs docs on fixing errant arrays encoded with old
zarrs
/zarrs_tools
versions
- See the relevant zarrs docs on fixing errant arrays encoded with old
- Bump
zarrs
to 0.11.6
0.2.2 - 2024-02-02
- Use
cargo-dist
for releases
- Bump dependencies
zarrs
to 0.11.3
- Fix typos/errors in various docs files
0.2.1 - 2024-01-26
- Bump
zarrs
to 0.11
0.2.0 - 2023-12-26
- Bump
zarrs
to 0.8.0 - Increase MSRV to 1.71
0.1.1 - 2023-12-11
- Bump
zarrs
to 0.7.1 to fix build withrust<1.74
0.1.0 - 2023-12-05
- Initial public release