However sambaNova doesn’t seem to offer the /models and some clients will not work (open-webui for example) without validating the /models and pulling the list of available models.
2 Likes
@j.castillo Welcome to the community . There is an enhancement request opened for this functionality as discussed in topic Is there a way to get the available model names via HTTP request? . I will link your topic to the same enhancement. We’re working on an ETA.
-Coby
Thanks, understood. This seems like an important feature to get out since many clients require the /models endpoint and many like me won’t be able to use this platform until available. Thank you.
1 Like
What can help your problem, if you write a proxy which one part proxy the requests to the SambaNova cloud, and for the models use a mock interface which returns the models in the format you need.