Skip to content

Releases: lokijuhy/data-traffic-control

v0.1.1

01 Sep 12:43
978f04f
Compare
Choose a tag to compare

Added

  • datatc.DataDirectory now has a mkdir method. (#29)

v0.1.0

15 Mar 19:43
5eaa898
Compare
Choose a tag to compare

Added

  • Web app for visualizing SelfAwareData file trees (#23).
    • Accessible on the command line via datatc_app <project>.
    • Requires additional dependencies. Install with  pip install datatc[app].
  • SelfAwareData tracks Intermediate File Steps (#23). When you save a file to the file system and reload it, it will track that intermediate file as part of the transformation history.
  • New public interface: MagicDataInterface (#22). Use dtc.MagicDataInterface.save(data, 'file_path') and dtc.MagicDataInterface.load('file_path') to take advantage of easy file saving and loading outside of DataDirectory.

Changed

  • DataDirectory replaces DataManager as the public interface for initializing and interacting with a data directory (#21).
    • Instead of dm = DataManager('project') use dd = DataDirectory.load('project').
    • Note: DataManager is deprecated, but will still work.

Fixed

  • Fixed bug where an empty SAD Directory was left on the file system if SelfAwareData.save() failed during creation (#25). This bug caused a further error: DataDirectory would fail to initialize due to not being able to find a data file for the SAD Directory.
  • Added option to pass kwargs to SelfAwareData.load_from_file() (#24).
  • Importing SelfAwareData from datatc yielded a different type id than the SelfAwareData that is type checked against internally (specifically, what is type checked in DataDirectory.save(), when determining how to save a SAD object) (#23). Fixed with relative imports.

v0.0.5

18 Feb 20:42
c607f0d
Compare
Choose a tag to compare

New Features

  • Introduces public SelfAwareData class, which replaces the internal TransformedData class (that was hiding behind DataDirectory).
  • Separates transform and save API. The DataDirectory.transform_and_save() method has been split into SelfAwareData.transform() and SelfAwareData.save() (or DataDirectory.save(SelfAwareData)).
  • Enambles "composable transforms": you can call SelfAwareData.transform() multiple times and the series of transformations will be tracked.
  • Function arguments are also tracked in the transformation metadata.
  • New SelfAwareData.load_from_file() method tracks the file the SelfAwareData originates from.
  • New print_steps() method (replaces view_code() method) displays metadata about the series of transformations.

Bugfixes

  • Fixed bug where select did not work for selecting a SelfAwareData directory based on it's file extension.
  • Improved error message when trying to save or load a parquet file without a parquet engine installed.

v0.0.4

04 Jan 16:48
9e3c71f
Compare
Choose a tag to compare
Merge pull request #11 from uzh-dqbm-cmi/fix_docs

Fix docs requirements