Gemma-4 image in tool call response

SambaNova Devs Discussion
1

Following up on previous thread, I have attempted migrating my service to sambanova, but running into a showstopper issue -and this means I can’t move to you now.

Specifically: images in tool response result in 500 unexpected_error. Full minimal reproduction JSON:

{
  "model": "gemma-4-31B-it",
  "messages": [
    { "role": "user", "content": "who is this?" },
    {
      "role": "assistant",
      "content": null,
      "tool_calls": [
        {
          "type": "function",
          "id": "call_1",
          "function": { "name": "view_image", "arguments": "{}" }
        }
      ]
    },
    {
      "role": "tool",
      "tool_call_id": "call_1",
      "content": [
        { "type": "text", "text": "image.png (image/png)" },
        {
          "type": "image_url",
          "image_url": {
            "url": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNk+M9QDwADhgGAWjR9awAAAABJRU5ErkJggg=="
          }
        }
      ]
    }
  ]
}

Response:

{"error":"unexpected_error","error_code":null,"error_param":null,"error_type":"unexpected_error"}

Reproduces 100% deterministically. This means, for the time being I am unable to move to Sambanova.

2

Hello @joel ,
Thanks for sharing the detailed reproduction steps and payload. We’ve noted the issue with the 500 unexpected_error when images are included in tool responses and will investigate it with the relevant team.

We understand this is currently blocking your migration to SambaNova, and we’ll provide an update once we have more information.

Regards,
Rohit Vyawahare

3

@joel

While the tool call is being investigated you can work around it by including the image in the message . @Rohit.Vyawahare open an engineering investigation and provide the originall testcase and the workaround.

$ curl -s -X POST https://api.sambanova.ai/v1/chat/completions \
  -H "Authorization: Bearer $SAMBANOVA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "gemma-4-31B-it",
  "messages": [
    {
      "role": "user",
      "content": [
        { "type": "text", "text": "who is this?" },
        {
          "type": "image_url",
          "image_url": {
            "url": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNk+M9QDwADhgGAWjR9awAAAABJRU5ErkJggg=="
          }
        }
      ]
    }
  ]
}'

{"choices":[{"finish_reason":"stop","index":0,"logprobs":null,"message":{"content":"The image you provided is a solid black square. There is no person or object visible in it.","role":"assistant"}}],"created":1782104970,"id":"22059f29-4f66-4ce1-993d-13d55f8c9100","model":"gemma-4-31B-it","object":"chat.completion","system_fingerprint":"fastcoe","usage":{"completion_tokens":20,"completion_tokens_after_first_per_sec":190.7441849332446,"completion_tokens_after_first_per_sec_first_ten":192.39601455310992,"completion_tokens_after_first_per_sec_graph":192.39601455310992,"completion_tokens_per_sec":19.321003919198546,"end_time":1782104970.761471,"is_last_response":true,"prompt_tokens":275,"stop_reason":"stop","time_to_first_token":0.9355330467224121,"time_to_first_token_graph":0.7833845615386963,"total_latency":1.0351428985595703,"total_tokens":295,"total_tokens_per_sec":284.9848078081785}}

-Coby