Is there a way to get the available model names via HTTP request?

SambaNova Devs
1

I am concerned some current models will not be available any more if some newer version of llama is available and takes the place of the old one (for example, llama 3.0 70B). Is there any way to get the model list available?

  • Here is an example of OpenAI:
from openai import OpenAI

client = OpenAI(
    api_key="API KEY"
)

models = client.models.list()

It will access https://api.openai.com/v1/models with the API key.

  • Here is another example from Groq:

https://console.groq.com/docs/models

curl -X GET "https://api.groq.com/openai/v1/models" \
     -H "Authorization: Bearer $GROQ_API_KEY" \
     -H "Content-Type: application/json"

It will access https://api.groq.com/openai/v1/models with the API key.

6 Likes
3

@JRDollar31 First, let me welcome you to the community. I definitely understand the requirement and I have submitted a feature request to engineering. I cannot commit to a delivery time frame but will keep you updated periodically.

-Coby

4

Is there any update on it, please? Thanks!

1 Like
5

@JRDollar31 engineering has not committed to a delivery as of yet. I’ll chase this week.

Coby

2 Likes