Question - anybody know if SambaNova can support parallel tool calls.
For example currently what i see for SambaNova is ;
// First API call
{
“model”: “Meta-Llama-3.1-8B-Instruct”,
“messages”: [{“role”: “user”, “content”: “Compare Bitcoin and Ethereum prices and get weather in Sydney”}],
“tools”: […],
“tool_choice”: “auto”
}
// Response 1: Only one tool call
{
“choices”: [{
“message”: {
“tool_calls”: [{
“id”: “call_abc123”,
“type”: “function”,
“function”: {
“name”: “coin_data”,
“arguments”: “{"coinId": "bitcoin"}”
}
}]
}
}]
}
// Then another API call needed for the second tool…
but what is OpenAI/Anthropic standard is;
// Single API call
{
“model”: “Meta-Llama-3.1-8B-Instruct”,
“messages”: [{“role”: “user”, “content”: “Compare Bitcoin and Ethereum prices and get weather in Sydney”}],
“tools”: […],
“tool_choice”: “auto”
}
// Response with multiple parallel tool calls
{
“choices”: [{
“message”: {
“tool_calls”: [
{
“id”: “call_abc123”,
“type”: “function”,
“function”: {
“name”: “coin_data”,
“arguments”: “{"coinId": "bitcoin"}”
}
},
{
“id”: “call_def456”,
“type”: “function”,
“function”: {
“name”: “coin_data”,
“arguments”: “{"coinId": "ethereum"}”
}
},
{
“id”: “call_ghi789”,
“type”: “function”,
“function”: {
“name”: “get_weather_data”,
“arguments”: “{"location": "Sydney, Australia"}”
}
}
]
}
}]
}