Shypd.aiThe largest open index of AI toolsMT-DNN is an open-source Multi-Task Deep Neural Network for Natural Language Understanding. It supports adversarial training for language models and offers robust fine-tuning for pre-trained models.
Trending
Also listed in
About
MT-DNN (Multi-Task Deep Neural Networks) is a PyTorch-based package designed for Natural Language Understanding. It implements advanced techniques such as adversarial training for both LM pre-training/finetuning and f-divergence, as well as large-scale adversarial training for language models (ALUM). The tool also features SMART, a principled regularized optimization method for robust and efficient fine-tuning of pre-trained natural language models. MT-DNN supports various NLP tasks including GLUE benchmark reproduction, SciTail & SNLI domain adaptation, sequence labeling, and question answering. It provides functionalities for extracting text embeddings and offers options for speeding up training through gradient accumulation and FP16 support.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
