From 69da2e47d78b4a993c14273237ae45c0ce37418f Mon Sep 17 00:00:00 2001 From: ImaadM097 <99783026+ImaadM097@users.noreply.github.com> Date: Tue, 13 Sep 2022 17:44:55 +0530 Subject: [PATCH 1/4] Update 2) Gesture Translation Lit Review --- 2) Gesture Translation Lit Review | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/2) Gesture Translation Lit Review b/2) Gesture Translation Lit Review index 650ff8e..d8f3db6 100644 --- a/2) Gesture Translation Lit Review +++ b/2) Gesture Translation Lit Review @@ -6,5 +6,15 @@ Architecture: Faster R-CNN + 3D Conv + LSTM. (Not very feasible for us) Accuracy: 99% on common vocabulary data set. Link: https://ieeexplore.ieee.org/document/8950864 +3. Title:- Neural Sign Language Translation (nslt) + Dataset used:- Continuous SLT dataset, RWTHPHOENIX-Weather 2014T 1 (A set of photos and videos that provide translations of german sign language weather forecasts, around 30 GB in size). Link- + https://www-i6.informatik.rwth-aachen.de/~koller/RWTH-PHOENIX-2014-T/ + Accuracy:- Accuracy has been mentioned in the terms of BLEU-4. The upper bound for translation performance is 19.26 BLEU-4 + Code:- Code is available in the GitHub repo:- https://github.com/neccam/nslt + Implementation:- The experiments were conducted by grouping them in three categories. + 1. Gloss2Text (G2T), in which we simulate having a perfect SLR system as an intermediate tokenization. + 2. Sign2Text (S2T) which covers the end-to-end pipeline translating directly from frame-level sign language video into spoken language. + 3. Sign2Gloss2Text (S2G2T) which uses a SLR system as tokenization layer to add intermediate supervision. + Link:- https://openaccess.thecvf.com/content_cvpr_2018/papers/Camgoz_Neural_Sign_Language_CVPR_2018_paper.pdf From 044621e231dbb04cfaadfeb339b7fdbb04a85087 Mon Sep 17 00:00:00 2001 From: ImaadM097 <99783026+ImaadM097@users.noreply.github.com> Date: Tue, 13 Sep 2022 17:45:25 +0530 Subject: [PATCH 2/4] Update 2) Gesture Translation Lit Review --- 2) Gesture Translation Lit Review | 1 + 1 file changed, 1 insertion(+) diff --git a/2) Gesture Translation Lit Review b/2) Gesture Translation Lit Review index d8f3db6..e2fff96 100644 --- a/2) Gesture Translation Lit Review +++ b/2) Gesture Translation Lit Review @@ -6,6 +6,7 @@ Architecture: Faster R-CNN + 3D Conv + LSTM. (Not very feasible for us) Accuracy: 99% on common vocabulary data set. Link: https://ieeexplore.ieee.org/document/8950864 + 3. Title:- Neural Sign Language Translation (nslt) Dataset used:- Continuous SLT dataset, RWTHPHOENIX-Weather 2014T 1 (A set of photos and videos that provide translations of german sign language weather forecasts, around 30 GB in size). Link- https://www-i6.informatik.rwth-aachen.de/~koller/RWTH-PHOENIX-2014-T/ From b5795ce3fa1e0c30e46e1a0324fbbe2f4ae507be Mon Sep 17 00:00:00 2001 From: ImaadM097 <99783026+ImaadM097@users.noreply.github.com> Date: Tue, 13 Sep 2022 17:45:39 +0530 Subject: [PATCH 3/4] Update 2) Gesture Translation Lit Review --- 2) Gesture Translation Lit Review | 1 - 1 file changed, 1 deletion(-) diff --git a/2) Gesture Translation Lit Review b/2) Gesture Translation Lit Review index e2fff96..d8f3db6 100644 --- a/2) Gesture Translation Lit Review +++ b/2) Gesture Translation Lit Review @@ -6,7 +6,6 @@ Architecture: Faster R-CNN + 3D Conv + LSTM. (Not very feasible for us) Accuracy: 99% on common vocabulary data set. Link: https://ieeexplore.ieee.org/document/8950864 - 3. Title:- Neural Sign Language Translation (nslt) Dataset used:- Continuous SLT dataset, RWTHPHOENIX-Weather 2014T 1 (A set of photos and videos that provide translations of german sign language weather forecasts, around 30 GB in size). Link- https://www-i6.informatik.rwth-aachen.de/~koller/RWTH-PHOENIX-2014-T/ From 7fdd119dc82c103ba9dcb27f9b5f3dba077096e8 Mon Sep 17 00:00:00 2001 From: ImaadM097 <99783026+ImaadM097@users.noreply.github.com> Date: Thu, 15 Sep 2022 19:23:50 +0530 Subject: [PATCH 4/4] Update 2) Gesture Translation Lit Review --- 2) Gesture Translation Lit Review | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/2) Gesture Translation Lit Review b/2) Gesture Translation Lit Review index d8f3db6..0833568 100644 --- a/2) Gesture Translation Lit Review +++ b/2) Gesture Translation Lit Review @@ -16,5 +16,10 @@ 2. Sign2Text (S2T) which covers the end-to-end pipeline translating directly from frame-level sign language video into spoken language. 3. Sign2Gloss2Text (S2G2T) which uses a SLR system as tokenization layer to add intermediate supervision. Link:- https://openaccess.thecvf.com/content_cvpr_2018/papers/Camgoz_Neural_Sign_Language_CVPR_2018_paper.pdf - - +4. Title:- Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison + Dataset used:- Word-Level American Sign Language (WLASL) (Collection videos of more than 2000 words by different signers) https://dxli94.github.io/WLASL/ + Consists of only RGB videos. Around 34,404 video samples of 3,126 glosses for further annotations. + Implementation:- The model has been made by using temporal graph convolutional network (TGCN). The models, VGG-GRU, Pose-GRU, Pose-TGCN and + I3D are implemented in PyTorch. The ratio of training, validation and testing set was 4:1:1. + Accuracy:- 62.63% at top-10 accuracy on 2,000words/glosses + Link:- with code- https://github.com/dxli94/WLASL