Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: FileNotFoundError: [Errno 2] No such file or directory #758

Open
simplew2011 opened this issue Nov 29, 2023 · 2 comments
Open

BUG: FileNotFoundError: [Errno 2] No such file or directory #758

simplew2011 opened this issue Nov 29, 2023 · 2 comments
Labels
bug Something isn't working
Milestone

Comments

@simplew2011
Copy link

Describe the bug

A clear and concise description of what the bug is.
image

To Reproduce

To help us to reproduce this bug, please provide information below:

# download dataset
wget https://atp-modelzoo.oss-cn-hangzhou.aliyuncs.com/release/datasets/WuDaoCorpus2.0_base_sample.tgz
tar zxvf WuDaoCorpus2.0_base_sample.tgz
import xorbits.pandas as pd
import xorbits.datasets as xdatasets
from datasets import load_dataset

import xorbits
xorbits.init()

data = load_dataset("./WuDaoCorpus2.0_base_sample")
print(data)

df = pd.DataFrame(pd.DataFrame(data['train']), chunk_size=1000)
print(df.shape)
print(df.dtypes)
print(df.head())
from xorbits.experimental import dedup

res = dedup(df, col="content")
print(10*"---")
print(res)
  1. Your Python version:3.8.5
  2. The version of Xorbits you use:0.7.1
  3. Versions of crucial packages, such as numpy, scipy and pandas
  4. Full stack of the error.
  5. Minimized code to reproduce the error.

Expected behavior

A clear and concise description of what you expected to happen.

Additional context

Add any other context about the problem here.

@XprobeBot XprobeBot added the bug Something isn't working label Nov 29, 2023
@XprobeBot XprobeBot added this to the v0.7.2 milestone Nov 29, 2023
@simplew2011
Copy link
Author

add a line is ok:
xorbits.shutdown()

@aresnow1
Copy link
Contributor

So, it was raised when process exit?

@XprobeBot XprobeBot modified the milestones: v0.7.2, v0.7.3 Jan 5, 2024
@XprobeBot XprobeBot modified the milestones: v0.7.3, v0.7.4 Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants