Synology Install Serge With Portainer

by

Synology Install Serge With Portainer

MyĀ previous guide for SergeĀ involved the use of Task Scheduler. Today Iā€™m offering a recommended and excellent alternative for installing the latest SergeĀ version via Portainer. Serge is an AI chat interface based on llama.cpp for running Alpaca models. Entirely self-hosted, no API keys needed. Fits on 4GB of RAM and runs on the CPU. In this step by step guide I will show you how to installĀ SergeĀ on yourĀ Synology NAS with Docker & Portainer.

šŸ’”Note: This guide works perfectly with the latest version of Serge 0.9.0

  • STEP 1

Please Support My work by Making a Donation.

  • STEP 2

InstallĀ Portainer using my step by step guide. If you already have Portainer installed on your Synology NAS, skip this STEP. Attention: Make sure you have installed the latest Portainer version.

  • STEP 3

Go toĀ File StationĀ and open the docker folder. Inside the docker folder, create one new folder and name itĀ serge. Follow the instructions in the image below.
Note: Be careful to enter only lowercase, not uppercase letters.

Serge Synology NAS Portainer Set up 1

  • STEP 4

Now create two new foldersĀ inside the serge folder that you created at STEP 3 and name them data and weights. Follow the instructions in the image below.
Note: Be careful to enter only lowercase, not uppercase letters.

Serge Synology NAS Portainer Set up 2

  • STEP 5

Log into Portainer using your username and password. On the left sidebar in Portainer, click on StacksĀ thenĀ + Add stack. Follow the instructions in the image below.

1 Synology Portainer Add Stack

  • STEP 6

In the Name field type in serge. Follow the instructions in the image below.

Note: Copy Paste the code below in the Portainer Stacks Web editor.

version: "3.9"
services:
  serge:
    container_name: Serge
    image: ghcr.io/serge-chat/serge:latest
    mem_limit: 32g
    security_opt:
      - no-new-privileges:true
    restart: on-failure:5
    ports:
      - 4622:8008
    volumes:
      - /volume1/docker/serge/data:/data/db/:rw
      - /volume1/docker/serge/weights:/usr/src/app/weights:rw

Serge Synology NAS Portainer Set up 3

  • STEP 7

Scroll down on the page until you see a button namedĀ Deploy the stack. Click on it. Follow the instructions in the image below. The installation process can take up to a few minutes. It will depend on your Internet speed connection.

Serge Synology NAS Portainer Set up 4

  • STEP 8

If everything goes right, you will see the following message at the top right of your screen: ā€œSuccess Stack successfully deployedā€œ.

Serge Synology NAS Portainer Set up 5

  • STEP 9

šŸŸ¢Please Support My work by Making a Donation. Almost 99,9% of the people that install something using my guidesĀ forget to support my work, or justĀ ignoreĀ STEP 1. Iā€™ve been very honest about this aspect of my work since the beginning: I donā€™t run any ADS, I donā€™t require subscriptions, paid or otherwise, I donā€™t collect IPs, emails, and I donā€™t have any referral links from Amazon or other merchants. I also donā€™t have any POP-UPs or COOKIES. I have repeatedly been told over the years how much I have contributed to the community. Itā€™s something I love doing and have been honest about my passion since the beginning. But I also Need The Community to Support me Back to be able to continue doing this work.

  • STEP 10

The installation process can take up to a few seconds/minutes. It will depend on your Internet speed connection. Now open your browser andĀ type in http://Synology-ip-address:4622 Click DOWNLOAD MODELS. Follow the instructions in the image below. āš ļøWarning: Serge will not work on older NAS models without AVX support such as the x20 series.

Serge Synology NAS Portainer Set up 6

  • STEP 11

From the list, download one chat AI model, for example, Neural. Follow the instructions in the image below.

Serge Synology NAS Portainer Set up 7

  • STEP 12

Wait until the download is complete.

Serge Synology NAS Portainer Set up 8

  • STEP 13

Once the download is complete, click New Chat on the left sidebar. Follow the instructions in the image below.

Serge Synology NAS Portainer Set up 9

  • STEP 14

Click START A NEW CHAT. Follow the instructions in the image below.

Serge Synology NAS Portainer Set up 10

  • STEP 15

Ask a question, then click the SEND icon. Follow the instructions in the image below.

Serge Synology NAS Portainer Set up 11

Enjoy Serge!

šŸ†˜TROUBLESHOOTING

If you encounter issues by using this container, make sure to check out the Common Docker issuesĀ article.

Note: If you want to run the Serge container over HTTPS, check my guide on How to Run Docker Containers Over HTTPS. āš ļøWarning: I do not recommend running Serge via Reverse Proxy. This product should be used only on localhost. Why don’t I recommend running it via Reverse Proxy? Because if someone were to know your HTTPS address, then they can use your Serge AI to ask questions and overload your NAS RAM and CPU.

Note: Can I run Docker on my Synology NAS?Ā See the supported models.
Note: How to Back Up Docker Containers on your Synology NAS.
Note: Find outĀ how to update the Serge container with the latest image.
Note: How to Free Disk Space on Your NAS if You Run Docker.
Note: How to Schedule Start & Stop For Docker Containers.
Note: How to Activate Email Notifications.
Note: How to Add Access Control Profile on Your NAS.
Note: How to Change Docker Containers Restart Policy.
Note: How to Use Docker Containers With VPN.
Note: Convert Docker Run Into Docker Compose.
Note: How to Clean Docker.
Note: How to Clean Docker Automatically.
Note: Best Practices When Using Docker and DDNS.
Note: Some Docker Containers Need WebSocket.
Note: Find out the Best NAS Models For Docker.
Note: Activate Gmail SMTP For Docker Containers.

This post was updated on Monday / January 6th, 2025 at 4:02 PM

šŸ§” I Need Your Help!