Possibility of introducing larger ctx to 405b?

Just saw that yesterday 64k ctx was introduced to L3.1 70b, this is very, very important for a lot of use cases. Would really love 405b to also get the same as it’s a much more capable model. Thank you guys for the amazing work!

3 Likes

Hey Xiaoqianwx!
Glad you are enjoying the new capabilities. Although I can’t say when, I will say we are working very hard behind the scenes to help every developer get the features they need.
Stay tuned!!

Thanks

Seth

1 Like