Jul 13, 2024
Good insights, also I feel the new MobileLLM from Meta construes that depth (GQA etc) also plays a significant role compared to sheer spread with more parameters.
Written by Niranjan Akella
A scientist by heart and a passionate researcher in my field of expertise. I love philosophy.