PyPI v1.6.1 - ClearML

Bug Fixes

• Fix Task.get_tasks() fails when sending search_hidden=False
• Fix LightGBM example shows UserWarning

PyPI v1.6.0 - ClearML

New Features and Improvements

• New HyperParameter Optimization CLI clearml-param-search
• Improvements to ClearML Data
  • Add support for a new ClearML Data UI in the ClearML WebApp
  • Add clearml-data new options set-description and rename
• Add random seed control using Task.set_random_seed() allowing to set a new random seed for task initialization or to disable it
• Improve error messages when failing to download an artifact
• Improve error messages when testing for permissions

Bug Fixes

• Fix axis range settings when logging plots
• Fix Task.get_project() to return more than 500 entries (#612)
• Fix pipeline progress calculation
• Fix StorageManager.upload_folder() returns None for both successful and unsuccessful uploads
• Fix script path capturing stores a relative path and not an absolute path
• Fix HTML debug samples are saved incorrectly on S3
• Fix Hydra deprecation warning in examples
• Fix missing requirement for tensorboardx example

Known issues

• When removing an image from a Dataset, its preview image won't be removed
• Moving Datasets between projects still shows the Dataset in the old project

PyPI v1.5.0 - ClearML

New Features and Improvements

• Add support for single value metric reporting (#400)
• Add support for specifying parameter sections in PipelineDecorator (#629)
• Add support for parallel uploads and downloads (upload \ download and zip \ unzip of artifacts) (ClearML Slack)
• Add support for specifying execution details (repository, branch, commit, packages, image) in PipelineDecorator
• Bump PyJWT version due to "Key confusion through non-blocklisted public key formats" vulnerability
• Add support for AWS Session Token (using boto3's aws_session_token argument)

Bug Fixes

• Fix Task.get_projects() retrieves only the first 500 results (#612)
• Fix failure to delete artifacts stored in Azure (#660)
• Fix Process Pool hangs at exit (#674)
• Fix number of unpacked values when syncing a dataset (#682)
• Fix FastAI DeprecationWarning (#683)
• Fix StorageManager.download_folder() crash
• Fix pipelines can't handle None return value
• Fix pre-existing pipeline raises an exception
• Fix deprecation warning in the image_reporting example
• Fix patches are kept binded afterTask.close() is called
• Fix running pipeline code remotely without first running it locally (i.e. no configuration on the Task)
• Fix local task execution with empty working directory
• Fix permission check fails when using local storage folder that does not exist
• Fix pipeline add_function_step breaks in remote execution
• Fix wrong mimetype used for any file or folder uploaded to S3 using StorageManager
• Add missing default default_cache_manager_size in configuration files

PyPI v1.4.1 - ClearML

Bug Fixes

• Fix Process Pool hangs at exit (#674)

PyPI v1.4.0 - ClearML

New Features

• Add OpenMMLab example #655 (thanks @zhouzaida!)
• Add support for saving artifacts with different formats #634
• Add support for setting reported values for NaN and Inf #604
• Support more than 500 results in Task.get_tasks() using the fetch_only_first_page argument #612
• Support links in clearml-data #585
• Support deferred task initialization using Task.init() argument deferred_init (beta feature)
• Support resuming experiments when importing an Offline session
• Add --import-offline-session command line option to clearml-task
• Support automatically logging Tensorboard Hparams
• Add wildcard support for model auto-logging, see Task.init() (ClearML Slack)
• Add support for Lightning CLI
• Support None values in Task.connect()
• Add Model.project getter/setter
• Add support for Task progress indication
• Datasets
  • Improve Dataset version table
  • Add warning to Dataset creation on current Task
• Examples and documentation
  • Add manual seaborn logging example #628
  • Change package author
  • Change pipeline example to run locally #642
  • Update Pytorch Lightning example for pytorch-lightning>=v1.6.0 #650

Bug Fixes

• Fix Keras model config serialization in PatchKerasModelIO #616 (thanks @bzamecnik!)
• Fix task.get_parameters_as_dict(cast=True) casts False to True #622 (thanks @bewt85!)
• Fix Fire integration is not compatible with typing library #610
• Fix remote execution with argparse mutually exclusive groups raises "required" error even when no argument is required
• Fix Hydra tasks never fail and are only set to completed (fix handling return code)
• Fix clearml-data wildcard support
• Fix HPO randomly aborts running tasks before the time limit
• Fix matplotlib capture
• Fix issue with accessing images in projects containing /
• AutoScaler
  • Fix resource name with a prefix matching a resource type may cause the auto-scaler to avoid spinning down idle instances
  • Fix Idle workers should contain resource name and not instance type
• Fix backwards compatibility issue when using abstractmethod
• Matplotlib
  • Fix uploading 3D plots with matplotlib plt shows 2D plot on task results page
  • Fix wrong Histogram plotting using when matplotlib
• Fix PyTorch ScriptModule autobind
• Fix PyTorch auto-magic logging torchscript models
• Fix forked process will not call _at_exit and flush all outstanding reports
• Fix matplotlib to plotly conversion fails on subplots (convert as image if figure has subplots)
• Fix Windows sub process might end up waiting forever for uploads to finish if subprocess is very shot lived
• Fix StorageManager.get_local_copy() returning None for a valid path in Windows
• Fix Jupyter notebook cannot be detected
• Fix PipelineController does not change node Task name, only pipeline step name
• Fix Task.query_tasks() specifying page size or page number

PyPI v1.3.2 - ClearML

New Features and Improvements

• Add support for setting reported values for NaN and Inf #604
• Add reserved OS environments warning
• Add git credentials to colab example #621 (thanks @thepycoder!)
• Add jsonargparse support #403 (thanks @ajecc and @mauvilsa!)
• Update autokeras example

Bug Fixes

• Fix sub-project separators are incorrectly quoted in generated URLs #584
• Revert Optuna deprecation fix #613
• Fix HPO randomly aborts running tasks before the time limit
• Fix cloud driver overwrites agent.extra_docker_arguments
• Fix Pipeline Controller auto-magic framework connect
• Fix unused scroll is not cleared in Task.get_reported_plots()

PyPI v1.3.1 - ClearML

Features

• Add Python 3.10 support

Bug Fixes

• Update Slack SDK requirement #597 (thanks @mmiller-max!)
• Fix fork after task.close() is called #605
• Fix Azure storage upload #598
• Fix offline mode crash
• Fix task delete response not checked
• Fix pipeline controller kwargs with list
• Fix PipelineDecorator.debug_pipeline()
• Fix PipelineDecorator example
• Fix Python 3.10 issues
• Fix handling of legacy fileserver (files.community.clear.ml)
• Fix cloud driver may use None credentials
• Fix APIClient worker raises exception when accessing .name attribute
• Fix minimum/default API version setting

PyPI v1.3.0 - ClearML

Features and Bug Fixes

• Add new pipeline visualization support (requires ClearML Server v1.3)
• Support IAM Instance Profile in AWS auto-scaler
• Remove old server API versions support (pre-ClearML Server)
• Restructure FastAI examples
• Fix failed catboost bind on GPU (#592)
• Fix Optuna n_jobs deprecation warning
• Fix invalid method called on delete() error

PyPI v1.2.1 - ClearML

Bug Fixes

• Fix HTTP download fails constructing URL (#593)

PyPI v1.2.0 - ClearML

Features

• Add fastai v2 support (#571)
• Add catboost support (#542)
• Add Python Fire support (#550)
• Add new Azure Storage driver support (#548)
• Add requirements file support in Task.add_requirements (#575)
• Allow overriding auto_delete_file in Task.update_output_model() (#554)
• Support artifact_object empty string
• Add skip_zero_size_check to StorageManager.download_folder()
• Add support for extra HTTP retry codes (see here or use CLEARML_API_EXTRA_RETRY_CODES)
• Add Task.get_parameters() cast back to original type
• Add callback support to Task.delete()
• Add autoscaler CPU-only support
• Add AWS autoscaler IAM instance profile support
• Update examples
  • Edit HTML reporting examples (#546)
  • Add model reporting examples (#553)

Bug Fixes

• Fix nargs="?" without type does not properly cast the default value (#531)
• Fix using invalid configurations (#544)
• Fix extra_layout not passed to report_matrix (#559)
• Fix group arguments in click (#561)
• Fix no warning when failing to patch argparse (#576)
• Fix crash in Dataset.upload() when there is nothing to upload (#579)
• Fix requirements, refactor and reformat examples (#567, #573, #582)
• Auto-scaler
  • Change confusing log message
  • Fix AWS tags support
  • Fix instance startup script fails on any command (should only fail on the agent failing to launch)
  • Fix spin down stuck machine, ignore unknown stale workers
• Fix pandas object passed as Task.upload_artifact() preview object
• Fix incorrect timeout used for stale workers
• Fix clearml-task calls Task.init() in the wrong place when a single local file is used
• Fix ArgumentParser SUPPRESS as default should be resolved at remote execution in the same way (i.e. empty string equals SUPPRESS)
• Upgrade six version (in case pathlib2>2.3.7 is installed)
• Fix connected object base class members are not used
• Fix clearml-init changing web host after pasting full credentials
• Fix fileserver upload does not support path in URL
• Fix crash on semaphore acquire error
• Fix docs and docstrings (#558, #560)

Thanks @eugen-ajechiloae-clearml, @pollfly and @Rizwan-Hasan for contributing!