logo
  • Home (current)
  • Leaderboards
  • Datasets
  • FAQ
  • Log in
 

  LinCE   LID   POS   NER   SA   MT

Rank Team Model Avg LID POS NER SA MT More
- LinCE Organizers
LinCE Organizers
Model mBERT
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 177M
Date Jul 24, 2020 (01:43)
mBERT - 95.12 91.68 67.33 56.43 - ...
mBERT
LID 95.12
POS 91.68
NER 67.33
SA 56.43
MT -
- LinCE Organizers
LinCE Organizers
Model BERT base, cased
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 108M
Date Jul 24, 2020 (01:27)
BERT base, cased - 94.89 91.97 65.02 58.40 - ...
BERT base, cased
LID 94.89
POS 91.97
NER 65.02
SA 58.40
MT -
- LinCE Organizers
LinCE Organizers
Model ELMo small
Affiliation University of Houston
URL http://ritual.uh.edu/lince
Parameters 13.6M
Date May 11, 2020 (19:42)
ELMo small - 93.95 91.53 59.35 52.88 - ...
ELMo small
LID 93.95
POS 91.53
NER 59.35
SA 52.88
MT -
- GeoReactor
GeoReactor
Model Spanish-based BERT
Affiliation Tufts University
URL https://github.com/dccuchile/beto
Parameters Trained with SimpleTransformers
Date Jul 04, 2020 (18:27)
Spanish-based BERT - - - - 56.47 - ...
Spanish-based BERT
LID -
POS -
NER -
SA 56.47
MT -
- Remy
Remy
Model Fine-tuned M-BERT
Affiliation University of Groningen
URL https://nowebsite.com
Parameters 0
Date Aug 17, 2020 (09:10)
Fine-tuned M-BERT - - - - 57.54 - ...
Fine-tuned M-BERT
LID -
POS -
NER -
SA 57.54
MT -
- UH & Salesforce Research
UH & Salesforce Research
Model Char2subword mBERT
Affiliation University of Houston
URL https://github.com/salesforce/char2subword
Parameters 136M
Date Oct 19, 2020 (06:32)
Char2subword mBERT - 95.48 92.55 68.05 59.07 - ...
Char2subword mBERT
LID 95.48
POS 92.55
NER 68.05
SA 59.07
MT -
- HKUST
HKUST
Model HME-Ensemble
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 42M
Date Mar 13, 2021 (05:00)
HME-Ensemble - - 93.04 69.93 - - ...
HME-Ensemble
LID -
POS 93.04
NER 69.93
SA -
MT -
- HKUST
HKUST
Model HME
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 36M
Date Mar 13, 2021 (06:17)
HME - - 92.60 67.66 - - ...
HME
LID -
POS 92.60
NER 67.66
SA -
MT -
- HKUST
HKUST
Model XLM-R Base
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 278M
Date Mar 14, 2021 (14:06)
XLM-R Base - - 93.98 68.60 - - ...
XLM-R Base
LID -
POS 93.98
NER 68.60
SA -
MT -
- HKUST
HKUST
Model XLM-R Large
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 565M
Date Mar 15, 2021 (06:44)
XLM-R Large - - 94.38 72.01 - - ...
XLM-R Large
LID -
POS 94.38
NER 72.01
SA -
MT -
- HKUST
HKUST
Model XLM-MLM-100
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 572M
Date Mar 15, 2021 (15:18)
XLM-MLM-100 - - 93.07 68.62 - - ...
XLM-MLM-100
LID -
POS 93.07
NER 68.62
SA -
MT -
- IBM
IBM
Model mBERT
Affiliation IBM IRL
URL https://huggingface.co/google/bert-base-multilingual-cased
Parameters mbert
Date Sep 22, 2021 (14:12)
mBERT - - - - 57.27 - ...
mBERT
LID -
POS -
NER -
SA 57.27
MT -
- UBA & UNC
UBA & UNC
Model RoBERTuito
Affiliation Universidad de Buenos Aires, Universidad de Córdoba, CONICET
URL https://github.com/pysentimiento/robertuito
Parameters 108M
Date Jan 13, 2022 (15:40)
RoBERTuito - - - - 60.57 - ...
RoBERTuito
LID -
POS -
NER -
SA 60.57
MT -
- anonymous
anonymous
Model XLMR_multi-labels
Affiliation anonymous
URL https://github.com/anonymous
Parameters anonymous
Date Jan 25, 2022 (16:37)
XLMR_multi-labels - 96.49 94.48 72.72 62.21 - ...
XLMR_multi-labels
LID 96.49
POS 94.48
NER 72.72
SA 62.21
MT -
Rank Team Model Avg SPA-ENG HIN-ENG NEP-ENG MSA-EA More
1 anonymous
anonymous
Model XLMR_multi-labels
Affiliation anonymous
URL https://github.com/anonymous
Parameters anonymous
Date Jan 25, 2022 (16:37)
XLMR_multi-labels 96.49 98.64 97.07 96.74 93.51 ...
XLMR_multi-labels
SPA-ENG 98.64
HIN-ENG 97.07
NEP-ENG 96.74
MSA-EA 93.51
2 UH & Salesforce Research
UH & Salesforce Research
Model Char2subword mBERT
Affiliation University of Houston
URL https://github.com/salesforce/char2subword
Parameters 136M
Date Oct 19, 2020 (06:32)
Char2subword mBERT 95.48 98.33 96.23 96.19 91.19 ...
Char2subword mBERT
SPA-ENG 98.33
HIN-ENG 96.23
NEP-ENG 96.19
MSA-EA 91.19
3 LinCE Organizers
LinCE Organizers
Model mBERT
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 177M
Date Jul 24, 2020 (01:43)
mBERT 95.12 98.36 94.24 96.32 91.55 ...
mBERT
SPA-ENG 98.36
HIN-ENG 94.24
NEP-ENG 96.32
MSA-EA 91.55
4 LinCE Organizers
LinCE Organizers
Model BERT base, cased
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 108M
Date Jul 24, 2020 (01:27)
BERT base, cased 94.89 98.35 96.40 96.46 88.36 ...
BERT base, cased
SPA-ENG 98.35
HIN-ENG 96.40
NEP-ENG 96.46
MSA-EA 88.36
5 LinCE Organizers
LinCE Organizers
Model ELMo small
Affiliation University of Houston
URL http://ritual.uh.edu/lince
Parameters 13.6M
Date May 11, 2020 (19:42)
ELMo small 93.95 97.93 95.43 95.90 86.53 ...
ELMo small
SPA-ENG 97.93
HIN-ENG 95.43
NEP-ENG 95.90
MSA-EA 86.53
- Remy
Remy
Model Fine-tuned M-BERT
Affiliation University of Groningen
URL https://nowebsite.com
Parameters 0
Date Jul 25, 2020 (15:36)
Fine-tuned M-BERT - 97.27 - - - ...
Fine-tuned M-BERT
SPA-ENG 97.27
HIN-ENG -
NEP-ENG -
MSA-EA -
- Dana, Sara & Rasmus
Dana, Sara & Rasmus
Model Viterbi Decoding
Affiliation IT University of Copenhagen
URL https://github.com/RalleGr/msc-code-switching/
Parameters Transition probability: 0.85, initial probability 0.6 English and 0.4 Spanish.
Date Apr 26, 2021 (12:27)
Viterbi Decoding - 92.23 - - - ...
Viterbi Decoding
SPA-ENG 92.23
HIN-ENG -
NEP-ENG -
MSA-EA -
- IRLab@IITBHU
IRLab@IITBHU
Model BERT
Affiliation IIT BHU
URL https://github.com/SupriyaChanda/LinCE_Hindi_English_LID
Parameters lr = 0.01, batch_size=32, epochs=20
Date Sep 08, 2021 (18:05)
BERT - - 96.14 - - ...
BERT
SPA-ENG -
HIN-ENG 96.14
NEP-ENG -
MSA-EA -
- IRLab@IITBHU
IRLab@IITBHU
Model BERT
Affiliation IIT BHU
URL https://github.com/SupriyaChanda/LinCE_Hindi_English_LID
Parameters lr = 0.01, batch_size=32, epochs=10
Date Sep 10, 2021 (11:04)
BERT - 87.34 - - - ...
BERT
SPA-ENG 87.34
HIN-ENG -
NEP-ENG -
MSA-EA -
- IRLab@IITBHU
IRLab@IITBHU
Model GloVe
Affiliation IIT BHU
URL https://github.com/SupriyaChanda/LinCE_Hindi_English_LID
Parameters lr = 0.01, batch_size=32, epochs=40
Date Sep 10, 2021 (11:16)
GloVe - - 89.14 - - ...
GloVe
SPA-ENG -
HIN-ENG 89.14
NEP-ENG -
MSA-EA -
- LLAMA
LLAMA
Model XLM Baseline
Affiliation Boston University
URL https://huggingface.co/xlm-roberta-base
Parameters 277M
Date Jul 14, 2023 (23:11)
XLM Baseline - - 95.66 - - ...
XLM Baseline
SPA-ENG -
HIN-ENG 95.66
NEP-ENG -
MSA-EA -
- Igor Sterner
Igor Sterner
Model Any-English (AnE)
Affiliation University of Cambridge
URL https://aclanthology.org/2024.vardial-1.14/
Parameters 559M
Date Dec 18, 2023 (14:33)
Any-English (AnE) - 98.44 96.86 96.66 - ...
Any-English (AnE)
SPA-ENG 98.44
HIN-ENG 96.86
NEP-ENG 96.66
MSA-EA -
Rank Team Model Avg SPA-ENG HIN-ENG More
1 anonymous
anonymous
Model XLMR_multi-labels
Affiliation anonymous
URL https://github.com/anonymous
Parameters anonymous
Date Jan 25, 2022 (16:37)
XLMR_multi-labels 94.48 97.22 91.73 ...
XLMR_multi-labels
SPA-ENG 97.22
HIN-ENG 91.73
2 HKUST
HKUST
Model XLM-R Large
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 565M
Date Mar 15, 2021 (06:44)
XLM-R Large 94.38 97.18 91.59 ...
XLM-R Large
SPA-ENG 97.18
HIN-ENG 91.59
3 HKUST
HKUST
Model XLM-R Base
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 278M
Date Mar 14, 2021 (14:06)
XLM-R Base 93.98 96.96 91.00 ...
XLM-R Base
SPA-ENG 96.96
HIN-ENG 91.00
4 HKUST
HKUST
Model XLM-MLM-100
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 572M
Date Mar 15, 2021 (15:18)
XLM-MLM-100 93.07 97.04 89.10 ...
XLM-MLM-100
SPA-ENG 97.04
HIN-ENG 89.10
5 HKUST
HKUST
Model HME-Ensemble
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 42M
Date Mar 13, 2021 (05:00)
HME-Ensemble 93.04 96.78 89.30 ...
HME-Ensemble
SPA-ENG 96.78
HIN-ENG 89.30
6 HKUST
HKUST
Model HME
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 36M
Date Mar 13, 2021 (06:17)
HME 92.60 96.66 88.55 ...
HME
SPA-ENG 96.66
HIN-ENG 88.55
7 UH & Salesforce Research
UH & Salesforce Research
Model Char2subword mBERT
Affiliation University of Houston
URL https://github.com/salesforce/char2subword
Parameters 136M
Date Oct 19, 2020 (06:32)
Char2subword mBERT 92.55 96.88 88.23 ...
Char2subword mBERT
SPA-ENG 96.88
HIN-ENG 88.23
8 LinCE Organizers
LinCE Organizers
Model BERT base, cased
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 108M
Date Jul 24, 2020 (01:27)
BERT base, cased 91.97 96.92 87.02 ...
BERT base, cased
SPA-ENG 96.92
HIN-ENG 87.02
9 LinCE Organizers
LinCE Organizers
Model mBERT
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 177M
Date Jul 24, 2020 (01:43)
mBERT 91.68 97.07 86.30 ...
mBERT
SPA-ENG 97.07
HIN-ENG 86.30
10 LinCE Organizers
LinCE Organizers
Model ELMo small
Affiliation University of Houston
URL http://ritual.uh.edu/lince
Parameters 13.6M
Date May 11, 2020 (19:42)
ELMo small 91.53 96.34 86.71 ...
ELMo small
SPA-ENG 96.34
HIN-ENG 86.71
- Remy
Remy
Model Fine-tuned M-BERT
Affiliation University of Groningen
URL https://nowebsite.com
Parameters 0
Date Jul 13, 2020 (06:18)
Fine-tuned M-BERT - 97.13 - ...
Fine-tuned M-BERT
SPA-ENG 97.13
HIN-ENG -
- UBA & UNC
UBA & UNC
Model RoBERTuito
Affiliation Universidad de Buenos Aires, Universidad de Córdoba, CONICET
URL https://github.com/pysentimiento/robertuito
Parameters 108M
Date Jan 13, 2022 (15:40)
RoBERTuito - 97.17 - ...
RoBERTuito
SPA-ENG 97.17
HIN-ENG -
Rank Team Model Avg SPA-ENG HIN-ENG MSA-EA More
1 anonymous
anonymous
Model XLMR_multi-labels
Affiliation anonymous
URL https://github.com/anonymous
Parameters anonymous
Date Jan 25, 2022 (16:37)
XLMR_multi-labels 72.72 68.84 81.16 68.17 ...
XLMR_multi-labels
SPA-ENG 68.84
HIN-ENG 81.16
MSA-EA 68.17
2 HKUST
HKUST
Model XLM-R Large
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 565M
Date Mar 15, 2021 (06:44)
XLM-R Large 72.01 69.55 80.70 65.78 ...
XLM-R Large
SPA-ENG 69.55
HIN-ENG 80.70
MSA-EA 65.78
3 HKUST
HKUST
Model HME-Ensemble
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 42M
Date Mar 13, 2021 (05:00)
HME-Ensemble 69.93 65.11 75.97 68.71 ...
HME-Ensemble
SPA-ENG 65.11
HIN-ENG 75.97
MSA-EA 68.71
4 HKUST
HKUST
Model XLM-MLM-100
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 572M
Date Mar 15, 2021 (15:18)
XLM-MLM-100 68.62 64.16 74.49 67.22 ...
XLM-MLM-100
SPA-ENG 64.16
HIN-ENG 74.49
MSA-EA 67.22
5 HKUST
HKUST
Model XLM-R Base
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 278M
Date Mar 14, 2021 (14:06)
XLM-R Base 68.60 64.95 75.72 65.13 ...
XLM-R Base
SPA-ENG 64.95
HIN-ENG 75.72
MSA-EA 65.13
6 UH & Salesforce Research
UH & Salesforce Research
Model Char2subword mBERT
Affiliation University of Houston
URL https://github.com/salesforce/char2subword
Parameters 136M
Date Oct 19, 2020 (06:32)
Char2subword mBERT 68.05 64.65 73.38 66.13 ...
Char2subword mBERT
SPA-ENG 64.65
HIN-ENG 73.38
MSA-EA 66.13
7 HKUST
HKUST
Model HME
Affiliation HKUST
URL Paper: https://arxiv.org/pdf/2103.13309.pdf
Parameters 36M
Date Mar 13, 2021 (06:17)
HME 67.66 63.06 73.78 66.14 ...
HME
SPA-ENG 63.06
HIN-ENG 73.78
MSA-EA 66.14
8 LinCE Organizers
LinCE Organizers
Model mBERT
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 177M
Date Jul 24, 2020 (01:43)
mBERT 67.33 64.05 72.57 65.39 ...
mBERT
SPA-ENG 64.05
HIN-ENG 72.57
MSA-EA 65.39
9 LinCE Organizers
LinCE Organizers
Model BERT base, cased
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 108M
Date Jul 24, 2020 (01:27)
BERT base, cased 65.02 61.15 74.46 59.44 ...
BERT base, cased
SPA-ENG 61.15
HIN-ENG 74.46
MSA-EA 59.44
10 LinCE Organizers
LinCE Organizers
Model ELMo small
Affiliation University of Houston
URL http://ritual.uh.edu/lince
Parameters 13.6M
Date May 11, 2020 (19:42)
ELMo small 59.35 52.58 68.79 56.68 ...
ELMo small
SPA-ENG 52.58
HIN-ENG 68.79
MSA-EA 56.68
- Remy
Remy
Model Fine-tuned M-BERT
Affiliation University of Groningen
URL https://nowebsite.com
Parameters 0
Date Jul 15, 2020 (06:30)
Fine-tuned M-BERT - 63.85 - - ...
Fine-tuned M-BERT
SPA-ENG 63.85
HIN-ENG -
MSA-EA -
- IBM
IBM
Model indicBERT
Affiliation IBM IRL
URL https://huggingface.co/ai4bharat/indic-bert
Parameters IndicBERT (Romanized)
Date Oct 06, 2021 (05:48)
indicBERT - - 80.09 - ...
indicBERT
SPA-ENG -
HIN-ENG 80.09
MSA-EA -
- UBA & UNC
UBA & UNC
Model RoBERTuito
Affiliation Universidad de Buenos Aires, Universidad de Córdoba, CONICET
URL https://github.com/pysentimiento/robertuito
Parameters 108M
Date Jan 13, 2022 (15:40)
RoBERTuito - 68.50 - - ...
RoBERTuito
SPA-ENG 68.50
HIN-ENG -
MSA-EA -
- Anonymous
Anonymous
Model Roberta-large
Affiliation Anonymous
URL https://nowebsite.com
Parameters 354M
Date Apr 16, 2022 (20:53)
Roberta-large - - 80.47 - ...
Roberta-large
SPA-ENG -
HIN-ENG 80.47
MSA-EA -
- Amazon IML
Amazon IML
Model IndicBERT
Affiliation Amazon IML
URL https://github.com/AI4Bharat/indic-bert
Parameters 32.8M
Date Oct 18, 2022 (13:52)
IndicBERT - - 80.65 - ...
IndicBERT
SPA-ENG -
HIN-ENG 80.65
MSA-EA -
- Amazon IML
Amazon IML
Model Comix (Ph)
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 37.30
Date Nov 29, 2022 (09:06)
Comix (Ph) - - 82.16 - ...
Comix (Ph)
SPA-ENG -
HIN-ENG 82.16
MSA-EA -
- Amazon IML
Amazon IML
Model Comix (WSG)
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 33M
Date Dec 08, 2022 (11:16)
Comix (WSG) - - 81.78 - ...
Comix (WSG)
SPA-ENG -
HIN-ENG 81.78
MSA-EA -
- Amazon IML
Amazon IML
Model Comix (DKGA)
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 33M
Date Dec 12, 2022 (11:38)
Comix (DKGA) - - 81.42 - ...
Comix (DKGA)
SPA-ENG -
HIN-ENG 81.42
MSA-EA -
- Amazon IML
Amazon IML
Model Comix DKGA+WSG Ensemble
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 33M
Date Dec 13, 2022 (10:17)
Comix DKGA+WSG Ensemble - - 82.40 - ...
Comix DKGA+WSG Ensemble
SPA-ENG -
HIN-ENG 82.40
MSA-EA -
- Amazon IML
Amazon IML
Model Comix (DKGA+WSG)
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 33M
Date Dec 13, 2022 (11:15)
Comix (DKGA+WSG) - - 81.62 - ...
Comix (DKGA+WSG)
SPA-ENG -
HIN-ENG 81.62
MSA-EA -
- Amazon IML
Amazon IML
Model Comix DKGA+WSG+Phonetics Ensemble
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 37.30
Date Dec 13, 2022 (17:03)
Comix DKGA+WSG+Phonetics Ensemble - - 83.07 - ...
Comix DKGA+WSG+Phonetics Ensemble
SPA-ENG -
HIN-ENG 83.07
MSA-EA -
- a
a
Model bert
Affiliation b
URL http://localhost:8888/edit/pavan/NER/BertToken.py
Parameters x
Date Mar 24, 2024 (11:00)
bert - - 69.97 - ...
bert
SPA-ENG -
HIN-ENG 69.97
MSA-EA -
Rank Team Model Avg SPA-ENG More
1 anonymous
anonymous
Model XLMR_multi-labels
Affiliation anonymous
URL https://github.com/anonymous
Parameters anonymous
Date Jan 25, 2022 (16:37)
XLMR_multi-labels 62.21 62.21 ...
XLMR_multi-labels
SPA-ENG 62.21
2 UBA & UNC
UBA & UNC
Model RoBERTuito
Affiliation Universidad de Buenos Aires, Universidad de Córdoba, CONICET
URL https://github.com/pysentimiento/robertuito
Parameters 108M
Date Jan 13, 2022 (15:40)
RoBERTuito 60.57 60.57 ...
RoBERTuito
SPA-ENG 60.57
3 UH & Salesforce Research
UH & Salesforce Research
Model Char2subword mBERT
Affiliation University of Houston
URL https://github.com/salesforce/char2subword
Parameters 136M
Date Oct 19, 2020 (06:32)
Char2subword mBERT 59.07 59.07 ...
Char2subword mBERT
SPA-ENG 59.07
4 LinCE Organizers
LinCE Organizers
Model BERT base, cased
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 108M
Date Jul 24, 2020 (01:27)
BERT base, cased 58.40 58.40 ...
BERT base, cased
SPA-ENG 58.40
5 Remy
Remy
Model Fine-tuned M-BERT
Affiliation University of Groningen
URL https://nowebsite.com
Parameters 0
Date Aug 17, 2020 (09:10)
Fine-tuned M-BERT 57.54 57.54 ...
Fine-tuned M-BERT
SPA-ENG 57.54
6 IBM
IBM
Model mBERT
Affiliation IBM IRL
URL https://huggingface.co/google/bert-base-multilingual-cased
Parameters mbert
Date Sep 22, 2021 (14:12)
mBERT 57.27 57.27 ...
mBERT
SPA-ENG 57.27
7 GeoReactor
GeoReactor
Model Spanish-based BERT
Affiliation Tufts University
URL https://github.com/dccuchile/beto
Parameters Trained with SimpleTransformers
Date Jul 04, 2020 (18:27)
Spanish-based BERT 56.47 56.47 ...
Spanish-based BERT
SPA-ENG 56.47
8 LinCE Organizers
LinCE Organizers
Model mBERT
Affiliation University of Houston
URL https://ritual.uh.edu/lince
Parameters 177M
Date Jul 24, 2020 (01:43)
mBERT 56.43 56.43 ...
mBERT
SPA-ENG 56.43
9 LinCE Organizers
LinCE Organizers
Model ELMo small
Affiliation University of Houston
URL http://ritual.uh.edu/lince
Parameters 13.6M
Date May 11, 2020 (19:42)
ELMo small 52.88 52.88 ...
ELMo small
SPA-ENG 52.88
Rank Team Model Avg ENG-HINGLISH SPANGLISH-ENG ENG-SPANGLISH MSAEA-ENG ENG-MSAEA More
- UBC_HImt
UBC_HImt
Model mT5
Affiliation University of British Columbia
URL https://github.com/UBC-NLP
Parameters mT5; word2vec method; native; ngram=3;
Date Apr 22, 2021 (19:22)
mT5 - 12.67 - - - - ...
mT5
ENG-HINGLISH 12.67
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- IITP-MT
IITP-MT
Model synthetic-code-mixed
Affiliation Indian Institute of Technology Patna
URL https://github.com/OpenNMT/OpenNMT-py/tree/1.2.0
Parameters 114M
Date Apr 24, 2021 (18:00)
synthetic-code-mixed - 10.09 - - - - ...
synthetic-code-mixed
ENG-HINGLISH 10.09
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model Big Transformer ZS
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters 100k
Date Apr 25, 2021 (06:14)
Big Transformer ZS - - - - 21.34 - ...
Big Transformer ZS
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 21.34
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model mT5
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters without T, FT egy data, eg2en_mT5_1M_base_ckpt_prediction
Date Apr 25, 2021 (23:18)
mT5 - - - - 16.41 - ...
mT5
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 16.41
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model mT5 TC
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters True cased
Date Apr 25, 2021 (23:56)
mT5 TC - - - - 18.80 - ...
mT5 TC
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 18.80
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model Big Transformer FT
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters Big Transformer FT egy2eng data
Date Apr 26, 2021 (01:23)
Big Transformer FT - - - - 22.51 - ...
Big Transformer FT
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 22.51
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model Big Transformer FT TC
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters
Date Apr 26, 2021 (01:34)
Big Transformer FT TC - - - - 25.72 - ...
Big Transformer FT TC
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 25.72
ENG-MSAEA -
- CMMTOne
CMMTOne
Model Gated Sequence to Sequence convolutions
Affiliation International Institute of Information Technology, Hyderabad.
URL https://github.com/suman101112/CMMT.git
Parameters N_EPOCHS = 10, CLIP = 0.1,EMB_DIM = 256, HID_DIM = 512,Enc_dec_layers=10, kernel=3,dropout=0.25,max_length=400
Date Apr 26, 2021 (06:42)
Gated Sequence to Sequence convolutions - 2.58 - - - - ...
Gated Sequence to Sequence convolutions
ENG-HINGLISH 2.58
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- UBC_ARmt
UBC_ARmt
Model mBART
Affiliation The University of British Columbia
URL https://github.com/UBC-NLP/
Parameters madar_eg_FT_wz_mBART50.zip
Date Apr 26, 2021 (08:09)
mBART - - - - 19.79 - ...
mBART
ENG-HINGLISH -
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG 19.79
ENG-MSAEA -
- LTRC-PreCog
LTRC-PreCog
Model mBART-en
Affiliation IIIT Hyderabad
URL https://github.com/devanshg27/cm_translation
Parameters 403M
Date Apr 26, 2021 (08:53)
mBART-en - 12.22 - - - - ...
mBART-en
ENG-HINGLISH 12.22
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- LTRC-PreCog
LTRC-PreCog
Model mBART-hien
Affiliation IIIT Hyderabad
URL https://github.com/devanshg27/cm_translation
Parameters 403M
Date Apr 26, 2021 (08:53)
mBART-hien - 11.86 - - - - ...
mBART-hien
ENG-HINGLISH 11.86
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- IBM
IBM
Model mBART Test
Affiliation IBM IRL Bangalore
URL https://huggingface.co/facebook/mbart-large-cc25
Parameters 403M
Date Jun 16, 2021 (05:20)
mBART Test - 11.60 - - - - ...
mBART Test
ENG-HINGLISH 11.60
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- B2BT EMNLP 2022 Findings
B2BT EMNLP 2022 Findings
Model mBART Multilingual
Affiliation IIT Bombay
URL https://abhirut.github.io/papers/b2bt_paper.pdf
Parameters 610M
Date Jul 22, 2021 (09:08)
mBART Multilingual - - 49.29 - - - ...
mBART Multilingual
ENG-HINGLISH -
SPANGLISH-ENG 49.29
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- B2BT EMNLP 2022 Findings
B2BT EMNLP 2022 Findings
Model mBART Multilingual B2BT
Affiliation IIT Bombay
URL https://abhirut.github.io/papers/b2bt_paper.pdf
Parameters 610M
Date Jul 23, 2021 (14:00)
mBART Multilingual B2BT - - 50.37 - - - ...
mBART Multilingual B2BT
ENG-HINGLISH -
SPANGLISH-ENG 50.37
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- B2BT EMNLP 2022 Findings
B2BT EMNLP 2022 Findings
Model mBART Multilingual + E → S BT
Affiliation IIT Bombay
URL https://abhirut.github.io/papers/b2bt_paper.pdf
Parameters 610M
Date Aug 14, 2021 (15:45)
mBART Multilingual + E → S BT - - 50.03 - - - ...
mBART Multilingual + E → S BT
ENG-HINGLISH -
SPANGLISH-ENG 50.03
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- Amazon IML
Amazon IML
Model Comix
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 273M
Date Jun 19, 2022 (13:06)
Comix - 12.98 - - - - ...
Comix
ENG-HINGLISH 12.98
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- Amazon IML
Amazon IML
Model Human
Affiliation Amazon IML
URL https://yettobemadepublic.com
Parameters 0
Date Jun 24, 2022 (12:46)
Human - 10.43 - - - - ...
Human
ENG-HINGLISH 10.43
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- TUG-MT
TUG-MT
Model t5-small_6_3 LinCE BackTranslation
Affiliation Technische Universität Graz
URL https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en_LinCE_bt
Parameters 47904768.00
Date Jun 25, 2022 (17:51)
t5-small_6_3 LinCE BackTranslation - 4.97 - - - - ...
t5-small_6_3 LinCE BackTranslation
ENG-HINGLISH 4.97
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- TUG-MT
TUG-MT
Model t5-small_6_3 LinCE
Affiliation Technische Universität Graz
URL https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en_LinCE
Parameters 47904768.00
Date Jun 25, 2022 (17:57)
t5-small_6_3 LinCE - 4.88 - - - - ...
t5-small_6_3 LinCE
ENG-HINGLISH 4.88
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- TUG-MT
TUG-MT
Model t5-small_6_3 cmu+LinCE
Affiliation Technische Universität Graz
URL https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en__noBT
Parameters 47904768.00
Date Jun 25, 2022 (18:05)
t5-small_6_3 cmu+LinCE - 5.47 - - - - ...
t5-small_6_3 cmu+LinCE
ENG-HINGLISH 5.47
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -
- TUG-MT
TUG-MT
Model t5-small_6_3 cmu+LinCE BackTranslate
Affiliation Technische Universität Graz
URL https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en_bt
Parameters 47904768.00
Date Jun 25, 2022 (18:16)
t5-small_6_3 cmu+LinCE BackTranslate - 4.71 - - - - ...
t5-small_6_3 cmu+LinCE BackTranslate
ENG-HINGLISH 4.71
SPANGLISH-ENG -
ENG-SPANGLISH -
MSAEA-ENG -
ENG-MSAEA -