Just saw that yesterday 64k ctx was introduced to L3.1 70b, this is very, very important for a lot of use cases. Would really love 405b to also get the same as it’s a much more capable model. Thank you guys for the amazing work!
3 Likes
Hey Xiaoqianwx!
Glad you are enjoying the new capabilities. Although I can’t say when, I will say we are working very hard behind the scenes to help every developer get the features they need.
Stay tuned!!
Thanks
Seth
1 Like