hi guys why sambanova api is taking so much time to respond
the model is llama 3.3 70b
my prompt: hello
response: one sentence
1 Like
@zizou.boss00 Thank you for Joining our developer community. I know we were doing some back end node maintenance around that time frame , can you please try again ? I just hit the model with 5 curls and my average latency was sub second, with max at 1.27 seconds .
-Coby
1 Like