Any specific limits for SambaNova?

SambaNova Devs Discussion
1

We’re using SambaNova’s inference engine to power our applications that will be in production very soon. We’re worried that we might hit any limits very soon (the website stated that there is a very low rate limit). What is the specific limit for free users, and is there any way we can be bumped into the Pay-as-you-go plan? Thanks!
P/S: We’re using Meta Llama 3.1 405B 4096

1 Like
2

Hey Alex,

I’ll message you privately with some details.
If you would like you can also email me at seth.kneeland@sambanova.ai

Thanks!
Seth

1 Like
3

@alex

We have published rate limit information here.

-Coby

1 Like