Hi everybody! I hope all is well. I just wanted to share a project that I have been working on for the last several months called BULaMU. It is the first large language model that has been trained from scratch on Luganda. It has 20M parameters so it should be really easy to run on a phone, laptop, or other low powered device and does not require connecting to the internet, since inference happens in C. The details of how I trained it are here. If you would like to download it, use it, or adapt it for your own use, it is available for free on my Huggingface account. I am open to any feedback that you are willing to share because I am going to c...
Hi everybody! I hope all is well. I just wanted to share a project that I have been working on for the last several months called BULaMU. It is the first large language model that has been trained from scratch on Luganda. It has 20M parameters so it should be really easy to run on a phone, laptop, or other low powered device and does not require connecting to the internet, since inference happens in C. The details of how I trained it are here. If you would like to download it, use it, or adapt it for your own use, it is available for free on my Huggingface account. I am open to any feedback that you are willing to share because I am going to continue working on improving BULaMU. I really believe that tiny language models like this decrease the high barrier to entry that AI often has by allowing people to use these models without a super powerful computer or access to the internet.