Managing Credits

SambaNova Devs Discussion
,
1

Hello, I am trying to use sambanova for inference as part of a voice agent application. I am trying it out along with other providers, I have a one major concern:

I purchased a $5 credit only to realize that the $5 expires the next month, essentially credits expire in within a month of purchase; which is not good unlike the usual process of 1 year expiry post purchase.

Sambanova is a great inference platform, I love that it’s low latency; however 1 month expiry on purchased credit is a bummer.

Secondly, the rate limit RPD for developer seems rather low, also the docs mentioned the rate limit headers will be response from the API, on testing the headers were not there.

RPM (Requests per minute)

  • x-ratelimit-limit-requests – Maximum requests allowed per minute
  • x-ratelimit-remaining-requests – Remaining requests in current minute
  • x-ratelimit-reset-requests – Time until reset

RPD (Requests per day)

  • x-ratelimit-limit-requests-day – Maximum requests allowed per day
  • x-ratelimit-remaining-requests-day – Remaining requests in current day
  • x-ratelimit-reset-requests-day – Time until reset
2

Hi,

Thanks for taking the time to share this detailed feedback, and we’re glad to hear you’ve had a good experience with SambaNova’s low-latency inference.

We understand your concerns around the purchased credit expiration, the developer RPD limits, and the missing rate-limit headers. We are looking into your concerns. We’ll get back to you with an update asap.

Thank you.

3

Thank you so much. I look forward to hear back from you.