from_modin method is deprecated

[tsaoyu]

Description

I have tried the from_modin API but it seems PandasOnRayFrame is a depreacted API in Modin. What is the plan to support this API? Also, is this a zero-copy method from the Modin dataframe partitions?

Modin version 0.13.1

Use case

nums is useful together with Modin for distributed ML stack that requires numpy-alike format. However, current support on from_modin is broken due to compatability.

[briancpark]

Thanks for using NumS. Does your use case need a higher version of Modin?

For reference, we've only tested against modin==0.11.3. Downgrading Modin via this command should resolve the from_modin error.

pip3 install modin==0.11.3

Please let us know if you need features from Modin 0.13.1 to continue.

[tsaoyu]

There were some big changes in documentation and performance on Modin since 0.13.0. https://github.com/modin-project/modin/releases/tag/0.13.0 and the support on Pandas 1.4 is very attractive as well

[elibol]

@devin-petersohn at one point we discussed adding formal support to Modin for this type of integration. Do you have any recommendations on how we ought to correct this issue for long-term stability?

[devin-petersohn]

@elibol we have a developer API now that should be useful here:

https://modin.readthedocs.io/en/stable/flow/modin/distributed/dataframe/pandas.html

Would this work? We are testing this API and it is public/stable. Happy to discuss other ways too!

[elibol]

Thanks @devin-petersohn! This looks like it will work for us.