Skip to content

Commit

Permalink
Merge branch 'master' into rc0.5.50
Browse files Browse the repository at this point in the history
  • Loading branch information
jzwang43 authored May 13, 2021
2 parents 14bd6ea + fb8dd14 commit 668e5d3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion codalab/worker/file_util.py
Original file line number Diff line number Diff line change
Expand Up @@ -341,7 +341,7 @@ def un_bz2_file(source, dest_path):
# fileno(). Our version requires only read() and close().

BZ2_BUFFER_SIZE = 100 * 1024 * 1024 # Unzip in chunks of 100MB
with FileSystems.create(dest_path, compression_type=CompressionTypes.UNCOMPRESSED) as dest:
with open(dest_path, 'wb') as dest:
decompressor = bz2.BZ2Decompressor()
for data in iter(lambda: source.read(BZ2_BUFFER_SIZE), b''):
dest.write(decompressor.decompress(data))
Expand Down

0 comments on commit 668e5d3

Please sign in to comment.