Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing

UT (Universal Transformation) AppendIrr Extend sentences by irrelevant sentencesBackTrans BackTrans (Trans short for translation) replaces test data with paraphrases by leveraging back translation, which is able to figure out whether or not the target models merely capture the literal features instead of semantic meaning. Contraction Contraction replaces phrases like `will not` and `he has` with contracted forms, namely, `won’t` and `he’s`InsertAdv Transforms an input by add adverb word before verbKeyboard Keyboard turn to the way how people type words and change tokens into mistaken ones with errors caused by the use of keyboard, like `word → worf` and `ambiguous → amviguius`.MLMSuggestion MLMSuggestion (MLM short for masked language model) generates new sentences where one

 

 

 

To finish reading, please visit source site