Releases: lokijuhy/data-traffic-control
Releases · lokijuhy/data-traffic-control
v0.1.1
v0.1.0
Added
- Web app for visualizing SelfAwareData file trees (#23).
- Accessible on the command line via
datatc_app <project>
. - Requires additional dependencies. Install with
pip install datatc[app]
.
- Accessible on the command line via
SelfAwareData
tracks Intermediate File Steps (#23). When you save a file to the file system and reload it, it will track that intermediate file as part of the transformation history.- New public interface:
MagicDataInterface
(#22). Usedtc.MagicDataInterface.save(data, 'file_path')
anddtc.MagicDataInterface.load('file_path')
to take advantage of easy file saving and loading outside ofDataDirectory
.
Changed
DataDirectory
replacesDataManager
as the public interface for initializing and interacting with a data directory (#21).- Instead of
dm = DataManager('project')
usedd = DataDirectory.load('project')
. - Note:
DataManager
is deprecated, but will still work.
- Instead of
Fixed
- Fixed bug where an empty SAD Directory was left on the file system if
SelfAwareData.save()
failed during creation (#25). This bug caused a further error: DataDirectory would fail to initialize due to not being able to find a data file for the SAD Directory. - Added option to pass kwargs to
SelfAwareData.load_from_file()
(#24). - Importing
SelfAwareData
fromdatatc
yielded a different type id than theSelfAwareData
that is type checked against internally (specifically, what is type checked inDataDirectory.save()
, when determining how to save a SAD object) (#23). Fixed with relative imports.
v0.0.5
New Features
- Introduces public
SelfAwareData
class, which replaces the internalTransformedData
class (that was hiding behindDataDirectory
). - Separates transform and save API. The
DataDirectory.transform_and_save()
method has been split intoSelfAwareData.transform()
andSelfAwareData.save()
(orDataDirectory.save(SelfAwareData)
). - Enambles "composable transforms": you can call
SelfAwareData.transform()
multiple times and the series of transformations will be tracked. - Function arguments are also tracked in the transformation metadata.
- New
SelfAwareData.load_from_file()
method tracks the file the SelfAwareData originates from. - New
print_steps()
method (replacesview_code()
method) displays metadata about the series of transformations.
Bugfixes
- Fixed bug where
select
did not work for selecting a SelfAwareData directory based on it's file extension. - Improved error message when trying to save or load a parquet file without a parquet engine installed.