training_vqa.md

VQA

• Training 1 : vilbert-job-0.1.dev491-ga8ed80a.d20200922182615
• Validation/Evaluation from Training 1 : vilbert-job-0.1.dev492-g62dfbf2.d20200924143315

Training

In comparison of the best results procedure (with 2 training, 1 validation, 1 evaluation), I had run just one training on the VQA dataset.

python3 -u train_tasks.py --model_version 3 --bert_model=bert-base-uncased \
      --from_pretrained_conceptBert None \
      --from_pretrained=/nas-data/data2/kilbert_base_model/pytorch_model_9.bin \
      --config_file config/bert_base_6layer_6conect.json \
      --output_dir=/nas-data/outputs/train_vqa_trained_model \
      --num_workers 16 \
      --tasks 0

• tasks 0: run on the VQA dataset

Validation

Validation is based on the first training results (using "pytorch_model_19.bin").

python3 -u eval_tasks.py --model_version 3 --bert_model=bert-base-uncased \
      --from_pretrained=/nas-data/data2/save_final/VQA_bert_base_6layer_6conect-beta_vilbert_vqa/pytorch_model_11.bin  \
      --from_pretrained_conceptBert=/nas-data/outputs/train_vqa_trained_model/VQA_bert_base_6layer_6conect/pytorch_model_19.bin \
      --config_file config/bert_base_6layer_6conect.json \
      --output_dir=/nas-data/outputs/validation_vqa_trained_model \
      --num_workers 16 \
      --tasks 0 \
      --split val

• from_pretrained_conceptBert: change the value with the result of the previous training path
• tasks 0: run on the VQA dataset

Evaluation

Update vqaEval_okvqa.py file with the following values:

data_dir = '/nas-data/data2/VQA' #VQA version
annFile = "%s/v2_%s_%s_annotations.json" % (data_dir, dataType, dataSubType)
quesFile = "%s/v2_%s_%s_%s_questions.json" % (data_dir, taskType, dataType, dataSubType)

python conceptBert/PythonEvaluationTools/vqaEval_okvqa.py \
      --json_dir /nas-data/outputs/validation_vqa_trained_model \
      --output_dir /nas-data/outputs/validation_vqa_trained_model

• json_dir: change the value with the result of the validation path
• output_dir: change the value with the result of the validation path (same path as json_dir)