[Guide] Database backup in Truenas #8809
Replies: 9 comments 23 replies
-
|
I love immich but all the breaking changes on major released stopped me from using it. I was waiting for exactly the same. How to restore from truenas apps instead of container. Thank you for the info. Ill try |
Beta Was this translation helpful? Give feedback.
-
|
This does allow me to connect to the database with pgadmin, but it doesn't seem to work to restore the pgbackup files that are automatically saved by the current immich image. Those are .SQL files that want to be restored with psql. |
Beta Was this translation helpful? Give feedback.
-
|
Same happened to me . Yes you can I tested and it works. The instructions are a little confusing You have to select save as sql . Click on the ? Mark to see the details in pgadmin. This is a game changer at least for me. Now I can backup the db in truenas scale. I was able to backup and restore from scratch
Thank you,
Diego
…________________________________
From: Wayne Scott ***@***.***>
Sent: Monday, May 6, 2024 9:08:05 PM
To: immich-app/immich ***@***.***>
Cc: Dievale ***@***.***>; Comment ***@***.***>
Subject: Re: [immich-app/immich] [Guide] Database backup in Truenas (Discussion #8809)
This does allow me to connect to the database with pgadmin, but it doesn't seem to work to restore the pgbackup files that are automatically saved by the current immich image. Those are .SQL files that want to be restored with psql.
—
Reply to this email directly, view it on GitHub<#8809 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AI4F45AQO2CE5WE7COLILJTZBASPLAVCNFSM6AAAAABGHK6IW6VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TGMZVGUZTS>.
You are receiving this because you commented.Message ID: ***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
I would love to improve the guide, could you elaborate more on what you mean? Maybe include a screenshot? |
Beta Was this translation helpful? Give feedback.
-
|
Well the the database credentials show up right in the sidebar of the pgadmin app so all of those steps in order to get the credentials seem to be not needed now. |
Beta Was this translation helpful? Give feedback.
-
|
Do you think its possible to migrate from a standalone immich environment running on docker to the trunas application? I have typical docker-compose immich server running on a separate machine and I want to migrate over to my new trunas machine and I have been struggling to figure out how. Some of the folder names are different, like Following your instructions and so far they've been flawless -- however when it comes to restoring a backup .. how do i get my backup from my other server into the scope of pgadmin in the immich-postgres container? |
Beta Was this translation helpful? Give feedback.
-
|
Sorta. You have to do a custom installation and specify the location of everything during the setup and then manually setup a cronjob task to do the dB backups. I created a new dataset call immich and set all of the paths during the immich install to point to that dataset. At least then you can have direct access to the files. |
Beta Was this translation helpful? Give feedback.
-
|
exactly like that! Therefore you must generate under Type of Storage the Host Path and define the system installations for Immich with the correct names. For example: |
Beta Was this translation helpful? Give feedback.
-
|
My restore seems to keep failing. When I see the logs on pgAdmin, it says something about 'postgres' role not being found. That's one last hurdle I seem to be encountering now |
Beta Was this translation helpful? Give feedback.
-
bump! |
Beta Was this translation helpful? Give feedback.
-
|
Of you moving from thr standalone docker app to the trunas app it is significantly more involved due to the folder structure being different, the pg user and roles being different, and the file system user and group. If you look through the support tickets in the immich discord I have a thread in there which by the end of it I detailed everything I did to make it work. But just s heads up, it is very convoluted. Looks like you at least didn't have to worry about a different pg version though |
Beta Was this translation helpful? Give feedback.
-
|
How to start pgAdmin in TrueNAS to backup immich database? |
Beta Was this translation helpful? Give feedback.
-
|
I hope it's not too late... |
Beta Was this translation helpful? Give feedback.
-
|
Tried to, but pgAdmin is deploying forever, guess I have to wait for TrueNAS Electric Eel. |
Beta Was this translation helpful? Give feedback.
-
i had this trouble too, check the logs of the container, it probably have a error there |
Beta Was this translation helpful? Give feedback.
-
How connect from pgAdmin container to Immich dB container? Which parameter I need to use as hostname, port, user and password? |
Beta Was this translation helpful? Give feedback.
-
|
i tryed the commands above from my immich with 60gb of disk usage with images and videos |
Beta Was this translation helpful? Give feedback.
-
|
Yeah. It's only the database. You still have to copy over your media |
Beta Was this translation helpful? Give feedback.
-
Can you help me with how to do this? |
Beta Was this translation helpful? Give feedback.
-
|
You can use something like rsync |
Beta Was this translation helpful? Give feedback.
-
|
i just want to access my files, and download them, but i dont know where i can find the files |
Beta Was this translation helpful? Give feedback.
-
|
Hey thanks for the information. I'm moving from the TrueCharts deployment to the TrueNAS one, since TrueCharts will be deprecated and also was not updating for me anymore. I've come very far with all the available information. The only issue I have left is that the current PostgreSQL version of the TrueNAS app is 15 and the ProstgreSQL version of the TrueCharts deployment was/is 16 with their Cloudnative-PG. |
Beta Was this translation helpful? Give feedback.
-
|
Now that HeavyScript is no longer supporting TrueNAS, is there another way to do backups? |
Beta Was this translation helpful? Give feedback.
-
|
@Tr0gdorTheBurninator I just installed HeavyScripts yesterday and it's still working fine. Idk if support for it will be completely dropping soon though. Follow the installation instructions on this page: https://github.com/Heavybullets8/heavy_script?tab=readme-ov-file |
Beta Was this translation helpful? Give feedback.
-
|
Maybe you can try this, if you are running Immich on TrueNAS: |
Beta Was this translation helpful? Give feedback.
-
|
So this is what I've been trying to do, either through pgAdmin or this way doesn't really matter. |
Beta Was this translation helpful? Give feedback.
-
|
I've done without HeavyScripts or pgadmin. I've detailed the steps here . |
Beta Was this translation helpful? Give feedback.
-
Are there backup steps? I only see restore steps in the guide. |
Beta Was this translation helpful? Give feedback.
-
|
Not long ago, backups were made automatically, but I don't know how. Obviously that's no longer the case, so I use cron to schedule backup. I've edited my little documentation with the dump command. |
Beta Was this translation helpful? Give feedback.
-
|
Now it's time to update it with TrueNAS 24.10 Electric Eel as Kubernetes is no more, just plain Docker Compose. |
Beta Was this translation helpful? Give feedback.
-
|
Below, my updated documentation. BackupI make my backups with this script (run as root): #!/bin/bash
immich_pod="ix-immich";
backup_path="/mnt/ronflex/immich/pgbackup";
backup_file="immich_$(date --utc +%Y-%m-%d_%H-%M-%S).sql";
# Make the dump
docker exec ix-immich-pgvecto-1 pg_dump --username="immich" immich | sudo tee "${backup_path}/${backup_file}" > /dev/null
# Remove old backups
find "${backup_path}" -mtime +7 -path "*.sql" -deleteRestoreStop all immich containers except pgvecto: $ ssh <truenas>
$ for container in $(docker ps -a | grep immich | grep -v pgvecto | awk '{print $1}'); do sudo docker stop $container; donePush the dump file on postgres immich container: $ find . -mtime 1 -name "*.sql" -exec sudo docker cp {} ix-immich-pgvecto-1:/tmp/last.sql \;Connect to the container: $ sudo docker exec -it ix-immich-pgvecto-1 bashConnect to the database: postgres@0b438c858f77:/$ psql --username=immich postgres
psql (15.5 (Debian 15.5-1.pgdg120+1))
Type "help" for help.
postgres=#Delete and recreate immich database: postgres=# DROP DATABASE immich WITH (FORCE);
DROP DATABASE
postgres=# CREATE DATABASE immich;
CREATE DATABASE
postgres=# exitImport the dump (plain text file): $ cat /tmp/last.sql | sed "s/SELECT pg_catalog.set_config('search_path', '', false);/SELECT pg_catalog.set_config('search_path', 'public, pg_catalog', true);/g" | psql -v ON_ERROR_STOP=1 -h 127.0.0.1 -U immich immich; exitRestart containers previously stopped: $ for container in $(docker ps -a | grep immich | grep -v pgvecto | awk '{print $1}'); do sudo docker start $container; doneEnjoy! |
Beta Was this translation helpful? Give feedback.
-
I recently started using Truenas to deploy Immich, I ran into a lot of missing information about how it's deployed.
As part of this their layout includes a different name for the database (immich&immich) rather than immich and postgres which has led to a lot of confusion.
In addition the database password is generated randomly without the user knowing what it is (It does not appear in the Truenas documentation).
How is it tested?
The backup was created on Immich with an environment of 260 images (including machine learning running)
and successful restoration of the backup.
Problems:
During the restoration process I encountered a problem that the names of the places were not restored at all, this is a known problem #7004.
Guide
Truenas Dragonfish version
Backup
immich old version < v1.105.1
1. [HeavyScript](https://github.com/Heavybullets8/heavy_script) and pgAdmin must be installed. 2. Go to System Settings -> Shell and enter: `sudo heavyscript dns immich` Copy the entry of immich-postgres It should look something like this: `immich-postgres.ix-immich.svc.cluster.local` 3. Now enter: `heavyscript pod -s immich` 4. Select immich-postgres. 5. Now write `env` and copy the POSTGRES_PASSWORD value. 6. Identify your database password, save it!Now go to pgAdmin
Connect to the browser interface.
Select Add New Server.
Enter the following values:
The value from section 25432immichimmichThe value from section 6Under Databases select Immich -> right click -> backup.
Select the backup location and click Backup.
In order to connect to the database and perform a backup, we will need login details, the password will appear on the right side together with all the details required to connect to the database
Now go to pgAdmin
Connect to the browser interface.
Select Add New Server.
Enter the following values:
The value that appears in Database Details5432immichimmichThe value that appears in Database DetailsUnder Databases select Immich -> right click -> backup.
Select the backup location and click Backup.
You have successfully backed up your database!
Recovery
If you have suggestions or other ways in which you take a backup, you are welcome to write to me, I will edit accordingly.
Beta Was this translation helpful? Give feedback.
All reactions