diff --git a/README.md b/README.md index 7323680..8a93c63 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ Welcome! In this repository you will find the code for all examples throughout t

"The Illustrated LLM Book"

-Through the visually educational nature of this book and with **over 250 custom made figures**, learn the practical tools and concepts you need to use Large Language Models today! +Through the visually educational nature of this book and with **almost 300 custom made figures**, learn the practical tools and concepts you need to use Large Language Models today! @@ -81,12 +81,17 @@ We advise to run all examples through Google Colab for the easiest setup. Google ## Additional Resources -We attempted to put as much information into the book without it being overwhelming. However, even with a 400-page book there is still much to discover! If you are interested in similar illustrated/visual guides we created, these might be of interest to you: +We attempted to put as much information into the book without it being overwhelming. However, even with a 400-page book there is still much to discover! + +We continue to create more guides that compliment the book and go more in-depth into new and exciting topics: | [A Visual Guide to Mamba](https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mamba-and-state) | [A Visual Guide to Quantization](https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-quantization) | [The Illustrated Stable Diffusion](https://jalammar.github.io/illustrated-stable-diffusion/) | :-------------------------:|:-------------------------:|:-------------------------: ![](images/mamba.png) | ![](images/quant.png) | ![](images/diffusion.png) +**[A Visual Guide to Mixture of Experts](https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mixture-of-experts)** | | +![](images/moe.png) | | +For more information on these visual/illustrated guides, check out the [bonus](.bonus/) folder. ## Citation diff --git a/bonus/README.md b/bonus/README.md new file mode 100644 index 0000000..0422384 Binary files /dev/null and b/bonus/README.md differ diff --git a/images/bonus_bitnet.png b/images/bonus_bitnet.png new file mode 100644 index 0000000..1c44d16 Binary files /dev/null and b/images/bonus_bitnet.png differ diff --git a/images/bonus_int8.png b/images/bonus_int8.png new file mode 100644 index 0000000..1b3b851 Binary files /dev/null and b/images/bonus_int8.png differ diff --git a/images/bonus_moe.png b/images/bonus_moe.png new file mode 100644 index 0000000..34bb5f1 Binary files /dev/null and b/images/bonus_moe.png differ diff --git a/images/bonus_overview.png b/images/bonus_overview.png new file mode 100644 index 0000000..8c24878 Binary files /dev/null and b/images/bonus_overview.png differ diff --git a/images/bonus_sd.png b/images/bonus_sd.png new file mode 100644 index 0000000..4c399dd Binary files /dev/null and b/images/bonus_sd.png differ diff --git a/images/bonus_sd1.png b/images/bonus_sd1.png new file mode 100644 index 0000000..da523d5 Binary files /dev/null and b/images/bonus_sd1.png differ diff --git a/images/bonus_ssm.png b/images/bonus_ssm.png new file mode 100644 index 0000000..fa5721d Binary files /dev/null and b/images/bonus_ssm.png differ diff --git a/images/bonus_ssm1.png b/images/bonus_ssm1.png new file mode 100644 index 0000000..a4fd90d Binary files /dev/null and b/images/bonus_ssm1.png differ diff --git a/images/bonus_vmoe.png b/images/bonus_vmoe.png new file mode 100644 index 0000000..b7f2852 Binary files /dev/null and b/images/bonus_vmoe.png differ diff --git a/images/moe.png b/images/moe.png new file mode 100644 index 0000000..757a15d Binary files /dev/null and b/images/moe.png differ