Shypd.aiThe largest open index of AI toolsfinetune-transformer-lm is an open-source code and model implementation for the paper "Improving Language Understanding by Generative Pre-Training." It allows researchers and developers to replicate and experiment with the ROCStories Cloze Test.
Trending
Also listed in
About
finetune-transformer-lm provides the code and model for the research paper "Improving Language Understanding by Generative Pre-Training." This open-source project is designed for researchers and developers interested in replicating and experimenting with the generative pre-training techniques described in the paper. Specifically, it includes an implementation for the ROCStories Cloze Test, allowing users to run experiments and analyze results. While the code is provided as-is with no expected updates, it serves as a valuable resource for understanding the foundational concepts of generative pre-training and language understanding models. The repository also notes that the code is currently non-deterministic due to various GPU operations, with a median accuracy slightly lower than the paper's reported single run.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
