SambaCloud Integration with Dify:

:pushpin: Overview

This document explains how to integrate SambaCloud LLMs into the Dify AI application platform. Dify enables fast development of LLM apps with a no-code/low-code approach.

:puzzle_piece: What is Dify?

Dify (Dify: Leading Agentic AI Development Platform ) is an open-source platform designed for building and deploying LLM-based applications like chatbots, agents, and tools without extensive coding.

:handshake: Integration Benefits

  • Use SambaCloud’s optimized LLMs directly within Dify.
  • Build, test, and deploy LLM-powered apps easily.
  • Maintain centralized control using your SambaNova API key.

:rocket: Integration Steps

  1. Create a Dify Account
    Go to Dify: Leading Agentic AI Development Platform and sign up.
  2. Navigate to Model Providers
  • In Dify, go to SettingsLLM Providers.
  • Or find the model provider under the Marketplace tab.
  1. Select SambaCloud
  • Choose SambaCloud as your provider.
  • You will be prompted to enter your API key.
  1. Enter API Key
  • Copy your API key from the SambaCloud portal.
  • Paste it into Dify.
  1. Choose a Model
  • Select one of the available SambaNova LLM models to use in your app.
  1. Build Your App
  • Start creating flows, chatbots, or agents using SambaNova LLMs.
  • Deploy them via API or Dify’s UI.

:locked_with_key: API Key Management

  • Keep your SambaNova API key confidential.
  • Regenerate keys if compromised from your SambaNova account settings.
2 Likes