Just dropping this in here so that if someone else runs into this issue they can spare themselves the trouble.
The Samba Nova python package for Llama-index requires, somewhere in the dependency tree, vllm. If you are using an intel-based Mac, you will eventually see this pip error:
ERROR: Could not find a version that satisfies the requirement torch==2.4.0
This is because PyTorch has dropped support for Intel Macs since version 2.3: [RFC] macOS x86 builds / test deprecation · Issue #114602 · pytorch/pytorch · GitHub
I was able to use Samba Nova by installing the llama-index-llms-openai-like module and setting up my client as an instance of that:
openai_like.OpenAILike(api_base=“https://api.sambanova.ai/v1/”,
api_key=sambanova_api_key, model=model)