How to Install Serge on Your Synology NAS

How to Install Serge on Your Synology NAS

Serge is an AI chat interface based on llama.cpp for running Alpaca models. Entirely self-hosted, no API keys needed. Fits on 4GB of RAM and runs on the CPU. In this step by step guide I will show you how to install Serge on your Synology NAS with Docker.

💡Note: This guide works perfectly with the latest version of Serge 0.1.3

  • STEP 1

Please Support My work by Making a Donation.

  • STEP 2

Install Container Manager via Synology “Package Center”. If you run an older DSM version (under 7.2), search for Docker instead of Container Manager.

Download Container Manager Synology Docker

  • STEP 3

Go to File Station and open the docker folder. Inside the docker folder, create one new folder and name it serge. Follow the instructions in the image below.
Note: Be careful to enter only lowercase, not uppercase letters.

Serge Synology NAS Set up 1

  • STEP 4

Now create two new folders inside the serge folder that you created at STEP 3 and name them data and weights. Follow the instructions in the image below.
Note: Be careful to enter only lowercase, not uppercase letters.

Serge Synology NAS Set up 2

  • STEP 5

Go to Control Panel / Task Scheduler / Create / Scheduled Task / User-defined script. Follow the instructions in the image below.

Serge Synology NAS Set up 3

  • STEP 6

Once you click on User-defined script, a new window will open. Follow the instructions below:

  1. General: In the Task field type in Install Serge. Uncheck the “Enabled” option. Select root User.
  2. Schedule: Select Run on the following date then select “Do not repeat“.
  3. Task Settings: Check “Send run details by email“, add your email then copy paste the code below in the Run command area. After that, click OK.
docker run -d --name=Serge \
-p 4622:8008 \
-v /volume1/docker/serge/data:/data/db/ \
-v /volume1/docker/serge/weights:/usr/src/app/weights \
--restart always \
ghcr.io/nsarrazin/serge:latest

Serge Synology NAS Set up 4

  • STEP 7

After you click OK on STEP 6 a new warning pop up window will open. Click OK.

Serge Synology NAS Set up 5

After you click OK, type in your DSM Password then click Submit. Follow the instructions in the image below.

Synology Task Scheduler Confirm Admin Password

  • STEP 8

After you click Submit on STEP 7, select your “Install Serge” Task then click the “Run” tab. You will be asked to run Install Serge – click OK. Follow the instructions in the image below.

Serge Synology NAS Set up 6

⌛Now just wait because the Serge image is about 1.3GB.

  • STEP 9

Go back to STEP 1 or you will deal with karma 🙂

  • STEP 10

The installation process can take up to a few seconds/minutes. It will depend on your Internet speed connection. Now open your browser and type in http://Synology-ip-address:4622 Click DOWNLOAD MODELS. Follow the instructions in the image below. ⚠️Warning: Serge will not work on older NAS models without AVX support such as the x20 series.

Serge Synology NAS Set up 7

  • STEP 11

Download one chat AI model, for example, gpt4all. Wait until the download is complete then click HOME. Follow the instructions in the image below.

Serge Synology NAS Set up 8

  • STEP 12

Click STARTE A NEW CHAT. Follow the instructions in the image below.

Serge Synology NAS Set up 9

  • STEP 13

Ask a question then click SEND. Follow the instructions in the image below.

Serge Synology NAS Set up 10

Enjoy Serge!

Note: If you want to run the Serge container over HTTPS, check my guide on How to Run Docker Containers Over HTTPS. ⚠️Warning: I do not recommend running Serge via Reverse Proxy. This product should be used only on localhost. Why don’t I recommend running it via Reverse Proxy? Because if someone were to know your HTTPS address, then they can use your Serge AI to ask questions and overload your NAS RAM and CPU.

Note: Can I run Docker on my Synology NAS? See the supported models.
Note: Find out how to update the Serge container with the latest image.
Note: How to Free Disk Space on Your NAS if You Run Docker.
Note: How to Schedule Start & Stop For Docker Containers.
Note: How to Activate Email Notifications.
Note: How to Add Access Control Profile on Your NAS.
Note: How to Change Docker Containers Restart Policy.
Note: How to Use Docker Containers With VPN.
Note: Convert Docker Run Into Docker Compose.
Note: How to Clean Docker.
Note: How to Clean Docker Automatically.
Note: Best Practices When Using Docker and DDNS.
Note: Some Docker Containers Need WebSocket.
Note: Find out the Best NAS Models For Docker.
Note: Activate Gmail SMTP For Docker Containers.

This post was updated on Thursday / June 1st, 2023 at 11:40 PM