v0.9.0rc3
Pre-release
Pre-release
This is the release notes of v0.9.0rc3. See here for the complete list of solved issues and merged PRs.
New Features
- Tensor
- Implementing Ellipsoidal Harmonics Functions (#2891, thanks @shantam-8!)
- Services
Enhancements
- Add execution API to enable custimization of Mars Task Service (#2894)
- Optimize serialization performance (#2914)
- Skip adding band in meta when fetch shuffle data (#2922)
- Store complete meta on worker and update supervisor meta via fetching from workers (#2912)
- Use cython to accelerate core serialization (#2924)
- Refine lifecycle api to support incref or decref with ref counts (#2926)
- Ignore fetch operands when assign initial nodes (#2929)
- Use cython to accelerate message serialization (#2932)
- Ignore broadcaster's locality when assign subtasks (#2943)
- Allow spawning serialization to threads for large objects (#2944)
- Add metrics and event report for Ray channels (#2936)
- Add more logs about execution info (#2940)
- Add support for
dask.persist
(#2953, thanks @loopyme!) - Remove
should_be_monotonic
property (#2949) - Add metrics on operand and subtask executions (#2947, thanks @zhongchun!)
- [Ray] optimize ray fetcher by query in remote node (#2957)
- Improve deploy backend (#2958)
- Support reporting tile progress (#2954)
- Add logic key for tileable graph (#2961, thanks @zhongchun!)
- [Ray] Loads the subtask inputs from meta (#2976)
- New ExecutionConfig API (#2968)
- Fix speculative execution compatibility with coloring (#2995)
- Make functions that may take long run in thread for lifecycle tracker (#2992)
- Optimize metric configs (#2996, thanks @zhongchun!)
- Expand the ability of resource evaluator (#2997, thanks @zhongchun!)
- Optimize gen subtask graph (#3004)
- [Ray] Ray execution state (#3002)
Bug fixes
- Fix paramter issue of worker actor pool (#2911, thanks @zhongchun!)
- Fix default config to ensure storage backends configured (#2935)
- Wrap errors in operand execution to protect scheduling service (#2964)
- Fix dtype of series result for
DataFrame.apply
(#2978) - Fix potential data leak for shuffle tasks (#2975)
- Fix potential empty chunks when creating DataFrame from pandas (#2987)
- [Ray] Support new ray cluster through ray client (#2981)
- Fix missing extra_params when constructing operands (#2999)
- Fix
msg_to_simple_str
in Ray backend and add tests (#3003) - Fix incorrect result for
df.sort_values
when specifying multiple ascending (#2984)
Documentation
- Add development documents for metrics (#2955, thanks @zhongchun!)