Deepseek r1 stopped working suddenly

SambaNova Devs Discussion
1

Help me.
I am using the deepseek through sambanova api .
Now it stopped working suddenly

2

Hi @kollikiran456

Can you give us some more details on this like an example response from the Curl command that can be found within the following page: SambaNova Cloud using your API Key.

Thanks

3

i am accessing through preview.snova, should i change to api.sambanova?

4

Hi,

For the example Curl provided on the API’s page, you can use the URL of your choice. In the example provided, it is https://api.sambanova.ai/v1/chat/completions.

Thanks

5

The problem was with the conext length.

The query soze exceeds 8k :sweat_smile:

1 Like
6

Please increase it to altleast 16k for the reason model

1 Like
7

@kollikiran456 increases are on the road map . I cannot commit to the timing

-Coby

1 Like
8

@kollikiran456 we updated Deepseek to run at 16k sequence length and it runs even faster :smile:

2 Likes
9

I also often receive the following code:
raise self._make_status_error_from_response(err.response) from None
openai.InternalServerError: Something went wrong!

This might also be connected to the context length used, but a better error message would be helpful.