Skip to content

Releases: LDeakin/zarrs_tools

0.6.0 - 2024-11-23

23 Nov 05:31
Compare
Choose a tag to compare

Release Notes

Added

  • Add zarrs_validate to check that arrays are equivalent
  • Add --write-shape argument to zarrs_reencode
    • This enables writing sharded arrays incrementally
  • Add cargo binstall install instructions

Changed

  • #12 Bump netcdf to 0.10.2 by [@magnusuMET]
  • Breaking: Bump MSRV to 1.80
  • Bump sysinfo to 0.32
  • Bump zarrs to 0.18.0
  • ncvar2zarr:
    • Switch to output concurrency
    • Breaking: Rename concurrent-blocks argument to concurrent-chunks
    • Breaking: Removed validate argument
    • Breaking: Removed concat-dim argument. Concatenation is now only supported along the first (slowest varying) dimension
    • This tool is intended to be replaced by icechunk / virtualizarr when they mature
  • Move benchmark scripts and measurements to https://github.com/LDeakin/zarr_benchmarks
  • Bump zarrs_opendal to 0.4.0 (opendal 0.50)
  • Include zarrs version when running binaries with -v/--version
  • Cleanup zarrs_info docs and CLI help
  • zarrs_ome
    • add OME-Zarr 0.5 support, remove interim 0.5 version support
    • Bump ome_zarr_metadata to 0.2.0
    • Rename --version to --ome-zarr-version
    • Remove --no-gaussian argument
    • Add --gaussian-sigma and --gaussian-kernel-half-size arguments, mean downsampling is now the default
    • Map a "channel" unit to a channel type axis
  • Bump thiserror to 2.0.0

Removed

  • zarrs_info: Remove --time argument

Fixed

  • zarrs_ome fix axis unit parsing (broken in 0.5.3)

Install zarrs_tools 0.6.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/LDeakin/zarrs_tools/releases/download/v0.6.0/zarrs_tools-installer.sh | sh

Download zarrs_tools 0.6.0

File Platform Checksum
zarrs_tools-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
zarrs_tools-x86_64-apple-darwin.tar.xz Intel macOS checksum
zarrs_tools-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

0.6.0-beta.1 - 2024-11-15

15 Nov 07:00
Compare
Choose a tag to compare
Pre-release

Release Notes

Added

  • Add zarrs_validate to check that arrays are equivalent
  • Add --write-shape argument to zarrs_reencode
    • This enables writing sharded arrays incrementally

Changed

  • #12 Bump netcdf to 0.10.2 by [@magnusuMET]
  • Breaking: Bump MSRV to 1.80
  • Bump sysinfo to 0.31
  • Bump zarrs to 0.18.0-beta.0
  • ncvar2zarr:
    • Switch to output concurrency
    • Breaking: Rename concurrent-blocks argument to concurrent-chunks
    • Breaking: Removed validate argument
    • Breaking: Removed concat-dim argument. Concatenation is now only supported along the first (slowest varying) dimension
    • This tool is intended to be replaced by icechunk / virtualizarr when they mature
  • Move benchmark scripts and measurements to https://github.com/LDeakin/zarr_benchmarks
  • Bump zarrs_opendal to 0.4.0 (opendal 0.50)

Fixed

  • zarrs_ome fix axis unit parsing (broken in 0.5.3)

Install zarrs_tools 0.6.0-beta.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/LDeakin/zarrs_tools/releases/download/v0.6.0-beta.1/zarrs_tools-installer.sh | sh

Download zarrs_tools 0.6.0-beta.1

File Platform Checksum
zarrs_tools-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
zarrs_tools-x86_64-apple-darwin.tar.xz Intel macOS checksum
zarrs_tools-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

Version 0.6.0-beta.0

03 Nov 04:12
60f9ec8
Compare
Choose a tag to compare
Version 0.6.0-beta.0 Pre-release
Pre-release

Release Notes

Added

  • Add zarrs_validate to check that arrays are equivalent
  • Add --write-shape argument to zarrs_reencode
    • This enables writing sharded arrays incrementally

Changed

  • #12 Bump netcdf to 0.10.2 by [@magnusuMET]
  • Breaking: Bump MSRV to 1.80
  • Bump sysinfo to 0.31
  • Bump zarrs to 0.18.0-dev
  • ncvar2zarr:
    • Switch to output concurrency
    • Breaking: Rename concurrent-blocks argument to concurrent-chunks
    • Breaking: Removed validate argument
    • Breaking: Removed concat-dim argument. Concatenation is now only supported along the first (slowest varying) dimension
    • This tool is intended to be replaced by chunk manifests when the specification and virtualizarr matures
  • Move benchmark scripts and measurements to https://github.com/LDeakin/zarr_benchmarks

Fixed

  • zarrs_ome fix axis unit parsing (broken in 0.5.3)

Install zarrs_tools 0.6.0-beta.0

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/LDeakin/zarrs_tools/releases/download/v0.6.0-beta.0/zarrs_tools-installer.sh | sh

Download zarrs_tools 0.6.0-beta.0

File Platform Checksum
zarrs_tools-aarch64-apple-darwin.tar.xz Apple Silicon macOS checksum
zarrs_tools-x86_64-apple-darwin.tar.xz Intel macOS checksum
zarrs_tools-x86_64-unknown-linux-gnu.tar.xz x64 Linux checksum

v0.5.5

31 Jul 01:21
Compare
Choose a tag to compare

Added

  • Add http read support to zarrs_reencode

Changed

  • Bump opendal to 0.48

CHANGELOG.md

Full Changelog: v0.5.4...v0.5.5

v0.5.4

29 Jul 21:02
Compare
Choose a tag to compare

Changed

  • Bump zarrs to 0.16.0

Fixed

  • Fixed zarrs_reencode with --shard-shape applying existing array-to-array and bytes-to-bytes codecs as both inner and outer codecs

CHANGELOG.md

Full Changelog: v0.5.3...v0.5.4

v0.5.3

24 Jul 09:20
Compare
Choose a tag to compare

Added

  • Add ome_zarr_metadata dependency for OME-Zarr metadata serialisation

Changed

  • zarrs_reencode: revise output and update docs
  • Update benchmarks and add plots
  • Make the help clearer for valid chunk key encoding separators in various tools

CHANGELOG.md

Full Changelog: v0.5.2...v0.5.3

v0.5.2

10 Jul 06:38
Compare
Choose a tag to compare

Changed

  • Add --dimension-names arg to zarrs_filter, zarrs_ome, zarrs_reencode to change dimension names

Fixed

  • Remove unused http feature from zarrs dependency

CHANGELOG.md

Full Changelog: v0.5.1...v0.5.2

v0.5.1

07 Jul 06:14
Compare
Choose a tag to compare

Added

  • zarrs_info: add group metadata support

Changed

  • Bump zarrs to 0.15.0
  • Add HTTP store support to most benchmark binaries/scripts

CHANGELOG.md

Full Changelog: v0.5.0...v0.5.1

v0.5.0

02 Jul 13:01
Compare
Choose a tag to compare

Added

  • Add zarrs_info (requires info feature): returns information about a Zarr array to stdout (JSON encoded)
    • Metadata
    • Array shape, data type, fill value, dimension names, attributes, etc.
    • Value range
    • Histogram

Changed

  • Bump zarrs to 0.15.0-beta.1
  • Bump rayon to 1.10.0
  • Bump itertools to 0.13
  • zarrs_ome: add --version arg, supporting 0.5-dev or 0.5-dev1
  • Change zarrs_ome default output behaviour to erase
  • Update benchmarks to use zarrs 0.15.0-beta.1

CHANGELOG.md

Full Changelog: v0.4.2...v0.5.0

v0.4.2

16 May 11:32
Compare
Choose a tag to compare

Changed

  • Bump zarrs to 0.14.0
  • Disable concurrent netCDF block processing in zarrs_ncvar2zarr

CHANGELOG.md

Full Changelog: v0.4.1...v0.4.2