Skip to content

Commit

Permalink
[SPARK-44418][PYTHON][CONNECT] Upgrade protobuf from 3.19.5 to 3.20.3
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

This PR proposes to upgrade protobuf from 3.19.5 to 3.20.3.

### Why are the changes needed?

To use the latest version in protobuf 3.x

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

CI int his PR should verify them.

Closes apache#41999 from HyukjinKwon/upgrade.

Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
  • Loading branch information
HyukjinKwon committed Jul 14, 2023
1 parent ad1f108 commit 3e0b83f
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -256,7 +256,7 @@ jobs:
- name: Install Python packages (Python 3.8)
if: (contains(matrix.modules, 'sql') && !contains(matrix.modules, 'sql-'))
run: |
python3.8 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio==1.56.0' 'protobuf==3.19.5'
python3.8 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio==1.56.0' 'protobuf==3.20.3'
python3.8 -m pip list
# Run the tests.
- name: Run tests
Expand Down Expand Up @@ -634,7 +634,7 @@ jobs:
curl -LO https://github.com/bufbuild/buf/releases/download/v1.23.1/buf-Linux-x86_64.tar.gz
mkdir -p $HOME/buf
tar -xvzf buf-Linux-x86_64.tar.gz -C $HOME/buf --strip-components 1
python3.9 -m pip install 'protobuf==3.19.5' 'mypy-protobuf==3.3.0'
python3.9 -m pip install 'protobuf==3.20.3' 'mypy-protobuf==3.3.0'
- name: Python code generation check
run: if test -f ./dev/connect-check-protos.py; then PATH=$PATH:$HOME/buf/bin PYTHON_EXECUTABLE=python3.9 ./dev/connect-check-protos.py; fi
- name: Install JavaScript linter dependencies
Expand Down
2 changes: 1 addition & 1 deletion dev/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ py
# Spark Connect (required)
grpcio>=1.48,<1.57
grpcio-status>=1.48,<1.57
protobuf==3.19.5
protobuf==3.20.3
googleapis-common-protos==1.56.4

# Spark Connect python proto generation plugin (optional)
Expand Down

0 comments on commit 3e0b83f

Please sign in to comment.