Samba Copilot : Agent Storm Generator
Watch Video DemoThis Copilot is highly customizable multi purpose widget with agentic capabilities, which assists user as they speak and press send button, mimicing iron-man jarvis style. can read dozens of documents (10000 words per second), and give you high level overview. can use Web or your personal notes!
It can be used for a variety of tasks such as
- Note Taker/Maker, with speech to text
- meme explainer, OCR image to text
- document analysis, presentations exporter
- realtime online conference support,
- content writing, translation, quick web research
to keep this list small, what you can do with a mouth, eyes, hands and secondary brain, you can do with this copilot.
Currently a hackathon proof of concept, but can be extended to a full fledged product. please open issue and tell us what you do, we will add functionality carefully so it may benefit people who do same task as you!
Features a plug-n-play architecture with many batteries included so a user can easily add or remove features as per their needs (you can keep as light or as heavy).
- BYOM : Bring your own model / finetune
- BYOT : Bring your own tools (Agent)
- BYOC : Bring your own context / data
- BYOP : Bring your own prompt / template
Gallery
Quick Start
Option 1 : Standard
first clone repo to a folder:
git clone https://github.com/nikhil-swamix/sambanova-copilot.git
cd sambanova-copilot
pip install -r requirements.txt
python copilot.py
Try to directly run the run__.ps1 or .sh. here _ is platform. it will install dependencies and run the app. run 2 times if it fails the first time, (troubleshoot tip).
Option 2 : Easiest (windows):
download fow win
Go to releases section and download the executable, and double click!
Option 3 : Preferred (poetry):
# Cd to directory after git clone
git clone https://github.com/nikhil-swamix/sambanova-copilot.git
cd sambanova-copilot
poetry install
poetry run python copilot.py
A great care has been taken to make it distributable and easy to use, please open issue in repo if any encountered.
Requirements
make sure you have SAMBANOVA_API_KEY, GROQ_API_KEY , configured in .env , some keys are provided.
How it works
Frontend
Backend
SambaNova Copilot Guide
How to Use
- Press 1 (
) - Start/stop voice recording - Press 2 (
) - Capture current screen - Press 3 (
) - Send to AI for processing, it will show response in dedicated popup - Press 4 (
) - Auto-type response (100 chars/sec) - Toggle Clipboard - Use copied text as additional context
- Toggle Workspace - Reference local documents
- Toggle Web Search - Include internet results
- Reset (
) - Clear current session data
Example Use Cases (can extend with plugins)
- Code Review: Screenshot code + voice ask âexplain this codeâ
- Meeting Notes: Record conversations for instant transcription and summary
- Meme Explainer: Capture meme image + ask for cultural context
- Document Analysis: Screenshot text + ask for key points summary
- Technical Support: Capture error screen + ask for solutions
- Content/Blog Writing: Dictate rough ideas for AI enhancement
- Translation Helper: Record foreign language for translation and tips
- Quick Research: Combine clipboard articles + voice questions
- UI/UX Review: Screenshot designs for instant feedback
- Email Assistant (with plugin): Dictate main points for professional email drafts
Pro Tip: Combine voice + image + clipboard for best results
Useful Features
- generate executive reports after scanning few webpages, Save Generated content to PDF/Markdown (artifacts)
- Does not require API for web search, use local browser for free search! (msedge, chrome, firefox) !
- Can use local documents as context for better results
- Can use clipboard text as additional context
- Can use voice recording as primary instruction.
- Automatic Tool Decision Based on user query (Agentic/Smart Mode) (Experimental, please comment out code if any issue)
Highlights
Configuration help
KEYS_WILL_BE_DELETED_POST_HACKATHON_DATE recommended to get your own keys, these keys are in .env file
SAMBANOVA_API_KEY_HELP
https://cloud.sambanova.ai/apis
GROQ_API_KEY_HELP
Used for text to speech
https://console.groq.com/keys
VOYAGE_API_KEY_HELP
https://dash.voyageai.com/api-keys
WORKSPACE_DIR_HELP
Upcoming
- Reasoning mode (some challenge with llama to act as thinker, in progress)
- Save history and submit to SambaStudio finetune job so model just âgets itâ
- ui based prompt editor , add remove rules in system prompt on the fly
- Share json backed OPEN API compatible Workflows using âSambaHubâ maybe.
(un)Known Issues
- Please open issues if any encountered. will be added and try to resolve.
