How to Train and Run a Simple Language Model (opens in new tab)

This article will show how to run a simple language model, KenLM. It’s not as powerful as transformer-based models like BERT or GPT-3, but depending on what you’re trying to accomplish it may be more than enough. This tutorial should take you about 15 minutes, including the time to run the scripts. Let’s work backwards from where we’re trying to get to. When you’ve finished, you should be able to run the following script: