error with pip install

[oszlak]

hey, getting this error:

creating /tmp/pip-install-_qamu845/pyarrow_033c42cee0724965b7cca24309f76aff/build/cpp
#0 190.2 -- Running CMake for PyArrow C++
#0 190.2 cmake -DARROW_BUILD_DIR=build -DCMAKE_BUILD_TYPE=release -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/tmp/pip-install-_qamu845/pyarrow_033c42cee0724965b7cca24309f76aff/build/dist -DPYTHON_EXECUTABLE=/usr/local/bin/python3.9 -DPython3_EXECUTABLE=/usr/local/bin/python3.9 -DPYARROW_CXXFLAGS= -DPYARROW_WITH_DATASET=off -DPYARROW_WITH_PARQUET_ENCRYPTION=off -DPYARROW_WITH_HDFS=off -DPYARROW_WITH_FLIGHT=off /tmp/pip-install-_qamu845/pyarrow_033c42cee0724965b7cca24309f76aff/pyarrow/src
#0 190.2 error: command 'cmake' failed: No such file or directory
#0 190.2 [end of output]
#0 190.2
#0 190.2 note: This error originates from a subprocess, and is likely not a problem with pip.
#0 190.2 ERROR: Failed building wheel for pyarrow
#0 190.2 Failed to build pyarrow
#0 190.2 ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects
#0 190.2 [end of output]
#0 190.2

this is my dockerfile

FROM nogil/python

set environment variables

ENV PYTHONPATH "${PYTHONPATH}:/code/src"

prerequisites for some python packages

RUN apt-get update && apt-get -y install gcc

WORKDIR /code

copy project

COPY . .

Install python dependencies

RUN pip install --no-cache-dir -r requirements.txt

CMD ["taskset", "-a", "-c", "0,1","python", "/code/main.py"]

and this is requirements.txt

requests>=2.27.1
boto3>=1.21.10
warrant>=0.6.1
prometheus-client>=0.13.1
cognitojwt>=1.4.1
schedule>=1.1.0
pytz>=2022.2.1
bottle>=0.12.23
vac_snowflake_client
python-jose[cryptography]
pandas>=1.4.3

[colesbury]

You'll need to build pyarrow wheels from source. I haven't figured out how to do that yet.

[oszlak]

thanks,
so i can i incorporate this inside the docker?

[colesbury]

so i can i incorporate this inside the docker?

@oszlak, I'm not sure I understand your question. Your log indicates that you are trying to build PyArrow. I do not provide PyArrow wheels for nogil because I haven't figured out how to build it from source. If you want to use PyArrow, you'll have to figure out how to build it from source yourself based on their documentation. I don't expect that to be easy - the last time I tried to do it I could not figure out how to build the wheels and gave up.

[marchostau]

Thank you very much for your hard work and dedication; I will certainly benefit from your efforts.