This is the source code for the work done for my Master's thesis. This work is built upon the ELECTRA+AGE architecture propsed in 2022 and the code for the original architecture is at link.
I have expaned the code to work with different language models for vecotrisation and the code currently provides the option to train the model with
- deberta
- GTE
- T5
Please make sure your environment includes:
python (tested on 3.10)
pytorch (tested on 2.0.1)
Then, run the command:
pip install -r requirements.txt
Run the parser using CL: