v3.11.0
Quick links
New feature highlights
JupyterLab launcher: Find out what's new in Elyra
The JupyterLab launcher now includes a What's new tile in the Elyra category, which links to the release summary of the release you are using, e.g. https://github.com/elyra-ai/elyra/releases/tag/v3.11.0 for Elyra version 3.11. The release summary highlights new features and provides links to release specific resources.
Python code editor: improved debugger integration
This feature is currently experimental. The Elyra Python editor was extended to make it easier to use the JupyterLab debugger. Refer to the user guide for more information.
New Scala code editor
This feature is currently experimental. The Elyra family of editors for JupyterLab now includes a Scala code editor. This editor can also be installed as a stand-alone extension from PyPI.
Note that Scala files are not supported by the Visual Pipeline Editor.
Pipeline editor: support Kubernetes tolerations
The Visual Pipeline Editor now allows for optional input of Kubernetes pod tolerations. Tolerations can be defined as pipeline defaults (applying to all nodes) and for individual nodes and are supported for Kubeflow Pipelines and Apache Airflow.
Pipeline editor: support Kubernetes pod annotations
The Visual Pipeline Editor now allows for optional input of Kubernetes [pod] annotations. Annotations can be defined as pipeline defaults (applying to all nodes) and for individual nodes and are supported for Kubeflow Pipelines and Apache Airflow.
Pipeline editor: remove resource caps for CPU and RAM
In earlier releases the Visual Pipeline Editor capped CPU and RAM resource requests at 99. The caps have been removed.
Component catalog connectors: support loading from local sources
The Apache Airflow package component catalog connector, the Apache Airflow provider package component catalog connector, and the URL component catalog connector, now support locally stored files as source.
Locally stored files can improve the performance of the Visual Pipeline Editor by eliminating the need to download them from remote locations.
Runtime configuration: support for optional public object storage endpoint
Runtime configurations provide Elyra access to external resources, such as Kubeflow Pipelines or Apache Airflow for scalable pipeline execution. In prior releases runtime configurations only allowed for specification of a single URL for cloud object storage. This limitation causes issues in the Elyra UI when object storage deployment policies are configured to enforce separation of read-only and write operations.
To support those deployments it's now possible to optionally configure a read-only endpoint (Public Cloud Object Storage Endpoint) in addition to the existing write endpoint (Cloud Object Storage Endpoint). Refer to the documentation for details.
What's Changed
New Features
- Add support for schema validators by @kevin-bates in #2829
- Add Scala editor by @lresende in #2850
- Add support for Kubernetes annotations by @ptitzler in #2868
- Add support for 'file' URI scheme to URL-based connectors by @ptitzler in #2873
- Add support for Kubernetes tolerations by @ptitzler in #2848
- Makefile: Add capability to validate individual runtime images by @ptitzler in #2879
- Add "what's new" tile to launcher by @salonee13 in #2857
- Add support for COS public endpoint to Kubeflow Pipelines runtime config by @portellaa in #2887
- Add support for COS public endpoint to Airflow runtime config by @ptitzler in #2890
Bug Fixes
- Fix container image build issues for official releases by @ptitzler in #2845
- Fix invalid URL in extension descriptions by @ptitzler in #2860
- Update user guide to enable elyra[all] install on zsh by @leucir in #2839
- Fix Airflow Operator execution bugs in handling of Elyra-owned properties by @kiersten-stokes in #2865
- Fix invalid variable names in error messages by @ptitzler in #2883
- Fix release script and instructions by @ptitzler in #2843
- Fix linting errors in server code by @ptitzler in #2885
- Remove .ONESHELL Makefile directive so multi-step targets properly fail by @kevin-bates in #2888
- Address SVG rendering issues by @ajbozarth in #2895
Other
- Address test warnings by @kevin-bates in #2833
- Add Open Data Hub image refresh instructions by @ptitzler in #2847
- Fix doc requirements to address build issue by @kevin-bates in #2853
- Removes max limit for the GPU and RAM properties by @VNA818-RPI in #2856
- Added development environment dockerfile and requirements file by @salonee13 in #2808
- Remove deprecation warning for local runtime type by @kiersten-stokes in #2862
- Improve 'Running Elyra in an air-gapped environment' documentation topic by @ptitzler in #2871
- Improve repository README by @ptitzler in #2835
- Dev workflow documentation updates by @salonee13 in #2832
- Add export and validation handler tests by @akchinSTC in #2876
- Bump kfp-tekton dependency to 1.3.0 by @ptitzler in #2884
- Add image verification steps to 'Creating a custom runtime container image' documentation by @ptitzler in #2882
- Improve JSON output of 'elyra-pipeline describe' command by @ptitzler in #2878
- Update documentation for elyra development image by @akchinSTC in #2889
- Script editor debugger - experimental by @karlaspuldaro in #2087
- Update release script container builds by @akchinSTC in #2891
- Node package security updates by @akchinSTC in #2896
New Contributors
- @salonee13 made their first contribution in #2808
- @leucir made their first contribution in #2839
- @portellaa made their first contribution in #2887
Full Changelog: v3.10.1...v3.11.0
