Struggle with installation

[LDO86]

Dear all, I am a newbie of both python and anaconda and I am trying to install Watertap. I installed the latest versions of Python (3.11.1) and anaconda (310_2023.03-0) and from the anaconda prompt I ran the following command:

conda create --name watertap --yes python=3.8 pip=21.1 (i tried with python 3.11 but it won't work)
conda activate watertap
pip install watertap
idaes get-extensions

everything goes smooth at this point I ran

pip install "watertap[testing]"
pytest --pyargs watertap

and the following errors pops up

<<<<<

ValueError: Unhandled property: dens_mass_solvent. This is mostly likely due to the property not being defined in this PropertySet.
collected 2841 items / 1 error

======================================================= ERRORS ========================================================
_ ERROR collecting anaconda3/envs/watertap3/lib/site-packages/watertap/property_models/tests/test_cryst_prop_pack.py __
anaconda3\envs\watertap3\lib\site-packages\watertap\property_models\tests\test_cryst_prop_pack.py:38: in <module>
    class TestDefaultNaClwaterProperty:
anaconda3\envs\watertap3\lib\site-packages\watertap\property_models\tests\test_cryst_prop_pack.py:43: in TestDefaultNaClwaterProperty
    m.fs.properties = props.NaClParameterBlock(
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:649: in __setattr__
    self.add_component(name, val)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:1219: in add_component
    val.construct(data)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:2210: in construct
    self._getitem_when_not_present(_idx)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:2135: in _getitem_when_not_present
    obj = self._rule(_block, idx)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\initializer.py:304: in __call__
    return self._fcn(parent, idx)
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\process_block.py:39: in _rule_default
    b.build()
anaconda3\envs\watertap3\lib\site-packages\watertap\property_models\cryst_prop_pack.py:117: in build
    self.H2O = Solvent(valid_phase_types=[PT.liquidPhase, PT.vaporPhase])
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:649: in __setattr__
    self.add_component(name, val)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:1219: in add_component
    val.construct(data)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:2210: in construct
    self._getitem_when_not_present(_idx)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\block.py:2135: in _getitem_when_not_present
    obj = self._rule(_block, idx)
anaconda3\envs\watertap3\lib\site-packages\pyomo\core\base\initializer.py:304: in __call__
    return self._fcn(parent, idx)
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\process_block.py:39: in _rule_default
    b.build()
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\components.py:216: in build
    base_units = self.parent_block().get_metadata().default_units
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\property_meta.py:80: in get_metadata
    cls.define_metadata(pcm)
anaconda3\envs\watertap3\lib\site-packages\watertap\property_models\cryst_prop_pack.py:832: in define_metadata
    obj.add_properties(
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\property_meta.py:513: in add_properties
    n, i = self._properties.get_name_and_index(k)
anaconda3\envs\watertap3\lib\site-packages\idaes\core\base\property_set.py:591: in get_name_and_index
    raise ValueError(
E   ValueError: Unhandled property: dens_mass_solvent. This is mostly likely due to the property not being defined in this PropertySet.
================================================== warnings summary ===================================================
anaconda3\envs\watertap3\lib\site-packages\pyomo\contrib\pynumero\sparse\block_matrix.py:25
  c:\users\tm01318\anaconda3\envs\watertap3\lib\site-packages\pyomo\contrib\pynumero\sparse\block_matrix.py:25: DeprecationWarning: Please use `get_index_dtype` from the `scipy.sparse` namespace, the `scipy.sparse.sputils` namespace is deprecated.
    from scipy.sparse.sputils import get_index_dtype

anaconda3\envs\watertap3\lib\site-packages\watertap\unit_models\tests\test_cstr_injection.py:254
  c:\users\tm01318\anaconda3\envs\watertap3\lib\site-packages\watertap\unit_models\tests\test_cstr_injection.py:254: PytestUnknownMarkWarning: Unknown pytest.mark.ui - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.ui

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=============================================== short test summary info ===============================================
ERROR anaconda3/envs/watertap3/lib/site-packages/watertap/property_models/tests/test_cryst_prop_pack.py - ValueError: Unhandled property: dens_mass_solvent. This is mostly likely due to the property not being defined in t...

I retrieved the first error's file "test_cryst_prop_pack.py" and ran it with "Idle" obtaining as output
<<<

= RESTART: C:\Users\tm01318\anaconda3\envs\watertap3\Lib\site-packages\watertap\property_models\tests\test_cryst_prop_pack.py
Traceback (most recent call last):
  File "C:\Users\tm01318\anaconda3\envs\watertap3\Lib\site-packages\watertap\property_models\tests\test_cryst_prop_pack.py", line 13, in <module>
    import pytest
ModuleNotFoundError: No module named 'pytest'

I also tried to Run in Jupiterbook the following code fromt the Watertap Tutorial page (https://watertap.readthedocs.io/en/latest/how_to_guides/how_to_run_models_in_a_py_script.html )
<<<

# Import concrete model from Pyomo
from pyomo.environ import ConcreteModel
# Import flowsheet block from IDAES core
from idaes.core import FlowsheetBlock
# Import NaCl property model
import watertap.property_models.NaCl_prop_pack as props
# Import utility tool for calculating scaling factors
from idaes.core.util.scaling import calculate_scaling_factors
# Import RO model
from watertap.unit_models.reverse_osmosis_0D import ReverseOsmosis0D
# import the solver
from idaes.core.solvers import get_solver

but I obtained a bunch of errors
<<<

---------------------------------------------------------------------------
DeferredImportError                       Traceback (most recent call last)
~\AppData\Local\Temp\ipykernel_60472\3483628074.py in <cell line: 4>()
      2 from pyomo.environ import ConcreteModel
      3 # Import flowsheet block from IDAES core
----> 4 from idaes.core import FlowsheetBlock
      5 # Import NaCl property model
      6 import watertap.property_models.NaCl_prop_pack as props

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\__init__.py in <module>
     13 from .base.process_base import ProcessBlockData, useDefault, MaterialFlowBasis
     14 from .base.process_block import ProcessBlock, declare_process_block_class
---> 15 from .base.unit_model import UnitModelBlockData, UnitModelBlock
     16 from .base.flowsheet_model import FlowsheetBlockData, FlowsheetBlock
     17 from .base.property_base import StateBlockData, PhysicalParameterBlock, StateBlock

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\base\unit_model.py in <module>
     23     useDefault,
     24 )
---> 25 from idaes.core.base.property_base import StateBlock
     26 from idaes.core.base.control_volume_base import (
     27     ControlVolumeBlockData,

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\base\property_base.py in <module>
     28 from idaes.core.base.process_block import ProcessBlock
     29 from idaes.core import ProcessBlockData, MaterialFlowBasis
---> 30 from idaes.core.base import property_meta
     31 from idaes.core.base.phases import PhaseData
     32 from idaes.core.base.components import ComponentData

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\base\property_meta.py in <module>
     51 
     52 from idaes.core.util.exceptions import PropertyPackageError
---> 53 from idaes.core.base.property_set import StandardPropertySet, PropertySetBase
     54 import idaes.logger as idaeslog
     55 

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\base\property_set.py in <module>
    603 
    604 
--> 605 class StandardPropertySet(PropertySetBase):
    606     """
    607     This object defines all the standard properties supported by IDAES, and also allows for

~\AppData\Roaming\Python\Python310\site-packages\idaes\core\base\property_set.py in StandardPropertySet()
    616         name="act",
    617         doc="Chemical Activity",
--> 618         units=pyunits.dimensionless,
    619     )
    620     compress_fact = PropertyMetadata(

~\anaconda3\lib\site-packages\pyomo\core\base\units_container.py in __getattribute__(self, attr)
   1464         else:
   1465             # Generate the ImportError
-> 1466             return getattr(pint_module, attr)
   1467 
   1468 # Define a module level instance of a PyomoUnitsContainer to use for

~\anaconda3\lib\site-packages\pyomo\common\dependencies.py in __getattr__(self, attr)
     73             raise AttributeError("'%s' object has no attribute '%s'"
     74                                  % (type(self).__name__, attr))
---> 75         raise DeferredImportError(self._moduleunavailable_message())
     76 
     77     def __getstate__(self):

DeferredImportError: The "pint" package failed to import. This package is necessary to use Pyomo units. (import raised ModuleNotFoundError: No module named 'pint')

Are the two things related? can anyone give some advice?
Thanks

[lbianchi-lbl]

Hi @LDO86, thanks for bringing this up and the detailed error report. As I understand, these seem to be 3 separate issues:

1. Errors occurring while following the WaterTAP installation and testing procedure for users, following the documentation
2. Running a test file with Idle (which I assume refers to https://docs.python.org/3/library/idle.html)
3. Import errors when running WaterTAP code in a Jupyter notebook

For (1), this is most likely due to an incompatibility between the latest stable version of WaterTAP and the latest stable version of IDAES (FWIW, we're in the process of releasing the next stable version of WaterTAP which doesn't have this problem). You can try the following to uninstall and then reinstall a more recent version of WaterTAP:

conda activate watertap3
pip uninstall --yes watertap idaes-pse pyomo
pip install "watertap[testing] >= 0.8.0rc1"

For (2), and possibly (3) as well, I suspect the problem could be related to the fact that IDLE / the Jupyter kernel is not using the environment (virtualenv, or, in this case, Conda) where WaterTAP is installed. In other words, the code that uses WaterTAP is being run through a different Python interpreter on the system where WaterTAP is not available. This shouldn't be specific to WaterTAP, and you can refer to the tool's own documentation for information on how to select a specific Python environment.

For Jupyter, you can try the following:

conda activate watertap3
pip install ipykernel
python -m ipykernel --user --name watertap3

After doing this, there should be an entry named watertap3 in the Jupyter kernel menu corresponding to the watertap3 Conda environment where WaterTAP is installed.

To debug environment issues, you can use the following snippets to display the path to the Python interpreter executable:

import sys; print(sys.executable)

For your watertap3 conda environment, the result should be something like C:\Users\tm01318\anaconda3\envs\watertap3\bin\python.exe.

[LDO86]

Thanks @lbianchi-lbl for the question 1 your answer solved the problem I think. Now pytest run smoothly altough i get about 40 warning (note that i deleted a previous env named "Watertap" were i had made a few tests and re-created it hence the difference in the env name between the posts)

warnings summary ===================================================
anaconda3\envs\watertap\lib\site-packages\pyomo\contrib\pynumero\sparse\block_matrix.py:25
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\pyomo\contrib\pynumero\sparse\block_matrix.py:25: DeprecationWarning: Please use `get_index_dtype` from the `scipy.sparse` namespace, the `scipy.sparse.sputils` namespace is deprecated.
    from scipy.sparse.sputils import get_index_dtype

anaconda3\envs\watertap\lib\site-packages\watertap\core\tests\test_zero_order_base.py:200
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\watertap\core\tests\test_zero_order_base.py:200: DeprecationWarning: invalid escape sequence \(
    " \(index: None\) in database.",

anaconda3\envs\watertap\lib\site-packages\watertap\core\tests\test_zero_order_base.py:220
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\watertap\core\tests\test_zero_order_base.py:220: DeprecationWarning: invalid escape sequence \(
    " \(index: None\) in database.",

anaconda3\envs\watertap\lib\site-packages\watertap\unit_models\tests\test_cstr_injection.py:253
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\watertap\unit_models\tests\test_cstr_injection.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.ui - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
    @pytest.mark.ui

anaconda3/envs/watertap/lib/site-packages/watertap/examples/flowsheets/RO_with_energy_recovery/tests/test_monte_carlo_sampling_RO_ERD.py: 3 warnings
anaconda3/envs/watertap/lib/site-packages/watertap/examples/flowsheets/case_studies/wastewater_resource_recovery/dye_desalination/tests/test_dye_sweep.py: 5 warnings
anaconda3/envs/watertap/lib/site-packages/watertap/tools/parameter_sweep/tests/test_differential_parameter_sweep.py: 9 warnings
anaconda3/envs/watertap/lib/site-packages/watertap/tools/parameter_sweep/tests/test_parameter_sweep.py: 13 warnings
anaconda3/envs/watertap/lib/site-packages/watertap/tools/parameter_sweep/tests/test_parameter_sweep_writer.py: 3 warnings
anaconda3/envs/watertap/lib/site-packages/watertap/tools/parameter_sweep/tests/test_recursive_parameter_sweep.py: 1 warning
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\watertap\tools\parameter_sweep\parameter_sweep_writer.py:87: UserWarning: No results will be writen to disk as h5_results_file_name and csv_results_file_name are both None
    warnings.warn(

anaconda3/envs/watertap/lib/site-packages/watertap/examples/flowsheets/lsrro/tests/test_lssro_multi_sweep.py::test_against_multisweep[1]
anaconda3/envs/watertap/lib/site-packages/watertap/examples/flowsheets/lsrro/tests/test_lssro_multi_sweep.py::test_against_multisweep[2]
anaconda3/envs/watertap/lib/site-packages/watertap/tools/parameter_sweep/tests/test_parameter_sweep.py::TestParallelManager::test_parameter_sweep_probe_fail
  c:\users\tm01318\anaconda3\envs\watertap\lib\site-packages\watertap\tools\parameter_sweep\parameter_sweep_writer.py:136: UserWarning: Too few points to perform interpolation.
    warnings.warn("Too few points to perform interpolation.")

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
================== 3032 passed, 7 skipped, 12 xfailed, 5 xpassed, 41 warnings in 2480.17s (0:41:20)

With regards to question 2 and 3 I tried your suggestion (see also https://statics.teams.cdn.office.net/evergreen-assets/safelinks/1/atp-safelinks.html but nothing changed from the jupiter side. but as you mentioned this is not the right place to ask for jupiter's issue. thanks anyway.