Introduction
AI development is evolving rapidly, and selecting the right development environment is crucial. Enter GENAI Sandbox—a ready-to-use platform that simplifies AI exploration and development. Powered by Nuvepro, GENAI Sandbox provides developers with a pre-configured environment, eliminating the complexity of setting up and managing local AI infrastructure.
With Ollama pre-installed and optimized for the Deepseek model, developers can immediately focus on building sophisticated chatbot applications without the hassle of configuration.
Why use the GENAI Sandbox?
GENAI Sandbox simplifies AI development by providing a pre-configured environment that eliminates setup complexities. It enables seamless experimentation with powerful LLMs and allows developers to focus on innovation.
This Nuvepro GenAI sandbox includes two primary tools for running models currently:
- Ollama: A streamlined, open-source tool to download, run, and manage LLMs locally with a focus on simplicity and speed.
- LM Studio: A user-friendly interface for discovering, downloading, and running LLMs locally.
While the sandbox supports multiple LLMs, we’re particularly excited about its optimization for Deepseek, which is gaining attention for its impressive reasoning capabilities.
Getting Started with Deepseek
Basic environment setup
Ollama comes pre-configured, you can verify with a command in the terminal.
Depending on the requirement you can download the model.
Now run the downloaded model in the terminal.
You will be asked for a prompt, type it and get response.
Tip: Ctrl + D for exit
Let’s see how effortlessly developers can explore DeepSeek’s capabilities by building an application in the Nuvepro Sandbox.
Tools Used: This chatbot leverages ollama library and gradio package for the user interface, enabling seamless interaction with the Deepseek model.
Note: Nuvepro Sandbox provides the essential libraries needed to build an application, and you have the flexibility to install any additional libraries if required.
- Basic Interaction with Deepseek Using ollama
- Real-Time Responses: Enabling Streaming
- Building an Interactive Chatbot with gradio and ollama (complete code)
This section transforms our terminal-based model into a full-featured web application.
Features of Gradio Integration:
- ️ Clean Web Interface with Gradio
- Chatbot with Real-time Streaming
- Conversation History
- Interactive and Stateful Chat
Now Run the Python file : python app.py
Tip: Ctrl + C to stop.
Voila!!
Your reasoning chatbot is ready! Test its capabilities, experiment in Nuvepro’s GENAI Sandbox, and share your feedback!
Conclusion
Experience the future of Generative AI development with Nuvepro’s GENAI Sandbox. Whether you’re building a customer service bot, a coding assistant, or an analytical tool, the sandbox allows you to focus on innovation without the hassle of maintaining LLMs or dealing with complex downloads and configurations. This platform eliminates traditional setup hurdles, providing a pre-configured environment where you can:
- Start coding immediately with pre-installed tools
- Experiment with state-of-the-art LLMs
- Build and test applications in real-time
- Focus on ideas rather than infrastructure
Ready to build your own LLM based applications? Access Nuvepro’s GENAI Sandbox to explore the full potential of Deepseek and other cutting-edge models. Whether you’re a seasoned developer or just starting with GenAI, our sandbox provides the perfect environment to bring your ideas to life.
Visit https://nuvepro.com/ to get started with your free sandbox environment today. Join our community of innovators and share your experiences building with GENAI Sandbox.
Start building, start innovating!