Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Out of disk space throws generic Bus Error #507

Open
ejmeitz opened this issue Nov 20, 2023 · 3 comments
Open

Out of disk space throws generic Bus Error #507

ejmeitz opened this issue Nov 20, 2023 · 3 comments

Comments

@ejmeitz
Copy link
Contributor

ejmeitz commented Nov 20, 2023

Hello,

I'm not totally sure how to reproduce this but I have some code that looks like the snippet below and it crashes in the call to jldsave with a Bus error. Is there a reason this happens? I don't see why I can't write unique files in a multithreaded manner. Thanks.

@sync for i in 1:4
     @async begin
          ....
            for j in 1:100
                 jldsave('unique_path')
            end
           ......
     end
end
@ejmeitz
Copy link
Contributor Author

ejmeitz commented Nov 20, 2023

Ok I realized I made a post like this awhile back and I am out of disk space. Is there some way to have JLD2 relay this information in the crash message?

@JonasIsensee
Copy link
Collaborator

Hi @ejmeitz,

I don't know but also don't think so.
This error is thrown (i think) when JLD2 tries to increase the Mmap file size. (ftruncate ?)
I'm not sure if there one can ask the OS whether an increase will be granted. (With multiple tasks that's more difficult to guarantee working)

@JonasIsensee JonasIsensee changed the title Parallel writes to separate files crashes JLD2 Out of disk space throws generic Bus Error Jan 3, 2024
@yha
Copy link

yha commented Mar 17, 2024

Maybe related to julia issue with propagating full disk errors?
JuliaLang/julia#44535

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants