Skip to content

Commit

Permalink
Merge pull request #2981 from truenas/PD-1052-true-cloud-content-for-…
Browse files Browse the repository at this point in the history 
…expanded-true-nas-storj-integration-and-snapshot-managemen

Pd 1052 true cloud content for expanded true nas storj integration and snapshot management
  • Loading branch information
@micjohnson777
micjohnson777 authored Aug 19, 2024
2 parents 2a46db0 + 6a12511 commit a225b02
Show file tree
Hide file tree
Showing 30 changed files with 549 additions and 284 deletions.
25 changes: 14 additions & 11 deletions content/SCALE/GettingStarted/Configure/SetUpBackupScale.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ You should also set up a data storage backup method using either a cloud sync or

TrueNAS provides for data backup through cloud sync or replication.

### Using Cloud Sync for Data Backup
### Using TrueCloud Backup or Cloud Sync

{{< hint type=note title="3rd Party Account Required" >}}
Cloud sync requires an account with a cloud storage provider and a storage location created with that provider, like an Amazon S3 bucket.
Expand All @@ -36,27 +36,30 @@ These providers can charge fees for data transfer and storage, so please review
{{< /hint >}}

You can configure TrueNAS to send, receive, or synchronize data with a cloud storage provider.
The simplest way to set up a cloud sync task is using an iX-Storj account.
The simplest way to set up a TrueCloud backup task is using an Storj iX account.
See [Managing TrueCloud Backup Tasks]({{< relref "TrueCloudTasks.md" >}}) for a full tutorial.

{{< expand "Cloud Sync Quickstart with a Storj Account" "v" >}}

1. Create an iX Storj account and link to TrueNAS.
{{< expand "TrueCloud Backup Quickstart with a Storj Account" "v" >}}
You can create a Storj cloud credential and set up your Storj account from the **Add TrueCloud Backup Task** screen or from the **Credentials > Backup Credentials** screen.
1. Create a Storj iX account and link to TrueNAS.

From the TrueNAS **Dashboard**, find the **Backup Tasks** widget and click **Cloud Sync to Storj or similar provider**.

Open the **Credentials** dropdown and select **Add New**.

The **Storj iX** provider is preselected.
Click **Signup for account** to open a browser tab, then register, select a plan, and activate an iX-Storj Account.
Click **Signup for account** to open a browser tab, then register, select a plan, and activate an Storj iX Account.

After creating the iX-Storj account, log in to the Storj portal, create a new bucket, and create new S3 access credentials ([details]({{< relref "AddStorjCloudSyncTask.md#adding-storj-cloud-credentials" >}})).
When the new S3 Credentials are created, download the **Access Key** and **Secret Key** and paste each string into the TrueNAS **Access Key ID** and **Secret Access Key** fields, respectively.
After creating the Storj iX account, log in to the Storj portal to create a new bucket and new S3 access credentials ([details]({{< relref "TrueCloudTasks.md#adding-storj-cloud-credentials" >}})).
After the new S3 credentials are created, download the **Access Key** and **Secret Key** and paste each string into the TrueNAS **Access Key ID** and **Secret Access Key** fields, respectively.
Click **Save**.

2. Define the backup targets and schedule.

In the TrueNAS Cloud sync task wizard, review the fields in the **What and When** section ([details]({{< relref "AddStorjCloudSyncTask.md#setting-up-the-storj-cloud-sync-task" >}})).
Select the created Storj **Bucket** before choosing a **Folder**.
To add the TrueCloud backup task, go to **Data Protection > TrueCloud Backup Tasks** and click **Add** to open the **Add TrueCloud Backup Task** screen.

Review the fields in the **Local**, **Remote**, **Task Settings**, and **Control** sections.
Select the created Storj **Credentials** and **Bucket** before choosing a **Folder**.

There are several predefined **Schedules** to choose from, or you can select **Custom** to define your own.

Expand All @@ -65,7 +68,7 @@ The simplest way to set up a cloud sync task is using an iX-Storj account.

See [Adding Cloud Credentials]({{< relref "/scale/scaletutorials/credentials/backupcredentials/addcloudcredentials.md" >}}) for information on connecting TrueNAS SCALE to other cloud storage providers.

### Using Replication for Data Backup
### Using Replication

Replication is the process of taking a moment-in-time snapshot of data and then copying that snapshot to another location.
Snapshot technology typically uses less storage than full file backups and has more management and snapshot storage options.
Expand Down
121 changes: 71 additions & 50 deletions content/SCALE/GettingStarted/SCALEReleaseNotes.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -62,56 +62,37 @@ More details are available from [Software Releases]({{< relref "/TrueNASUpgrades
Users with both LDAP and SMB shares configured should migrate legacy Samba domains to Active Directory before upgrading to 24.10.

<!--
### Upgrade Paths
There are a variety of options for upgrading to SCALE 24.04.
{{< include file="/static/includes/24.04UpgradeMethods.md" >}}
See the <a href="https://www.truenas.com/software-status/" target="_blank">TrueNAS Software Status</a> page for recommendations about which software version to use based on your user type.
Update the system to the latest maintenance release of the installed major version before attempting to upgrade to a new TrueNAS SCALE major version.
**TrueNAS SCALE (Anticipated)**
{{< mermaid class="mermaid_sizing" >}}
flowchart LR
A["22.02.4 (Angelfish)"] |update| C
B[CORE 13.0-U6.1] |ISO install| E
C["22.12.4.2 (Bluefin)"] |update| D
C["22.12.4.2 (Bluefin)"] |update| E
D["23.10.2 (Cobia)"] |update| E
E["24.04.0 (Dragonfish)"]
{{< /mermaid >}}
**TrueNAS SCALE Enterprise (Anticipated)**
{{< mermaid class="mermaid_sizing" >}}
flowchart LR
A["CORE 13.0-U6.1"] |ISO install| D
B["Current 23.10 (Cobia) release"] |update| C["23.10.2 (Cobia)"] |update| D["24.04.0 (Dragonfish)"]
{{< /mermaid >}}
### Upgrade Paths
### CORE > SCALE Migrations
{{< include file="/_includes/MigrateCOREtoSCALEWarning.md" >}}
{{< enterprise >}}
Enterprise customers with HA systems should contact iXsystems Support for assistance with migrating to TrueNAS SCALE.
{{< expand "iXsystems Support" "v" >}}
{{< include file="content/_includes/iXsystemsSupportContact.md" >}}
{{< /expand >}}
{{< /enterprise >}}
When attempting to migrate from TrueNAS CORE, the general recommendation is to back up the system configuration file and use a SCALE **.iso** file to fresh install TrueNAS.
After install, restore the system configuration and import the pools.
Depending on the specific system configuration, this can be a straightforward or complicated process.
See the [Migration articles]({{< relref "/SCALE/GettingStarted/Migrate/_index.md" >}}) for cautions and notes about differences between each software and the CORE to SCALE migration process.
You must either clean install or use an upgrade ***iso** file to migrate a TrueNAS CORE system to SCALE 24.04 (Dragonfish).
Enterprise customers should [contact Support](https://www.truenas.com/docs/scale/gettingstarted/migrate/migratecorehatoscaleha/#expand-1-Enterprise%20HA%20Migrations) for assistance with transitioning from CORE to SCALE.
There are a variety of options for upgrading to SCALE 24.10.
include file="/static/includes/24.04UpgradeMethods.md"
See the <a href="https://www.truenas.com/software-status/" target="_blank">TrueNAS Software Status</a> page for recommendations about which software version to use based on your user type.
Update the system to the latest maintenance release of the installed major version before attempting to upgrade to a new TrueNAS SCALE major version.
include file="/static/includes/SCALEUpgradePaths.md"
### CORE > SCALE Migrations
{{< include file="/_includes/MigrateCOREtoSCALEWarning.md" >}}
{{< enterprise >}}
Enterprise customers with HA systems should contact iXsystems Support for assistance with migrating to TrueNAS SCALE.
{{< expand "iXsystems Support" "v" >}}
{{< include file="content/_includes/iXsystemsSupportContact.md" >}}
{{< /expand >}}
{{< /enterprise >}}
When attempting to migrate from TrueNAS CORE, the general recommendation is to back up the system configuration file and use a SCALE **.iso** file to fresh install TrueNAS.
After install, restore the system configuration and import the pools.
Depending on the specific system configuration, this can be a straightforward or complicated process.
See the [Migration articles]({{< relref "/SCALE/GettingStarted/Migrate/_index.md" >}}) for cautions and notes about differences between each software and the CORE to SCALE migration process.
You must either clean install or use an upgrade ***iso** file to migrate a TrueNAS CORE system to SCALE 24.04 (Dragonfish).
Enterprise customers should [contact Support](https://www.truenas.com/docs/scale/gettingstarted/migrate/migratecorehatoscaleha/#expand-1-Enterprise%20HA%20Migrations) for assistance with transitioning from CORE to SCALE.
-->

## Component Versions
Expand All @@ -138,4 +119,44 @@ Any new feature flags introduced since the previous OpenZFS version that was int

For more details on feature flags, see [OpenZFS Feature Flags](https://openzfs.github.io/openzfs-docs/Basic%20Concepts/Feature%20Flags.html) and [OpenZFS zpool-feature.7](https://openzfs.github.io/openzfs-docs/man/7/zpool-features.7.html).

<!-- 24.10-BETA.1 (relnotes)-->
<!-- 24.10-BETA.1 (relnotes)
{{< hint type=warning title="Early Release Software" >}}
Early releases are intended for testing and feedback purposes.
Do not use early-release software for critical tasks.
{{< /hint >}}
**August 29, 2024**
iXsystems is pleased to release TrueNAS SCALE 24.10-BETA.1!
This has software component updates and new features that are in the polishing phase.
Notable changes:
* Dashboard reworked with more widgets, data reporting, and customization ([NAS-127217](https://ixsystems.atlassian.net/browse/NAS-127217)).
* Applications backend framework is shifted from Kubernetes to Docker ([](https://ixsystems.atlassian.net/browse/)). See the official [announcement](https://forums.truenas.com/t/the-future-of-electric-eel-and-apps/5409) for more information. The **Custom App** installation screen is disabled in 24.10-BETA.1. A redesigned screen, including Docker Compose support, is projected for the RC.1 version.
* New [TrueCloud Backup Tasks]({{< relref "TrueCloudTasks.md" >}}) with streamlined functionality for Storj iX cloud backups and restoration ([NAS-127165](https://ixsystems.atlassian.net/browse/NAS-127165)).
* [Extend a RAIDZ vdev]({{< relref "ManagePoolsScale.md #extending-a-raidz-vdev" >}}) with individual disks (OpenZFS feature sponsored by iXsystems) ([NAS-123548](https://ixsystems.atlassian.net/browse/NAS-123548)).
* New [global search]({{< relref "GlobalSearch.md" >}}) for finding pages and settings in the SCALE UI ([NAS-127224](https://ixsystems.atlassian.net/browse/NAS-127224)).
* UI support for NVMe SMART tests [NAS-128116](https://ixsystems.atlassian.net/browse/NAS-128116)
* Align Enclosure Management code with CORE and improve the feature's performance ([NAS-123474](https://ixsystems.atlassian.net/browse/NAS-123474)).
* Preserve SMB alternate data streams when ingesting data from remote servers ([NAS-127114](https://ixsystems.atlassian.net/browse/NAS-127114)).
* Rewrite TrueNAS installer to better support future development efforts ([NAS-127092](https://ixsystems.atlassian.net/browse/NAS-127092)).
<a href="https://ixsystems.atlassian.net/issues/?filter=######" target="_blank">Click here for the full changelog</a> of completed tickets that are included in the 24.10-BETA.1 release.
{{< include file="/static/includes/JiraFilterInstructions.md" >}}
### 24.04-BETA.1 Known Issues
*
<a href="https://ixsystems.atlassian.net/issues/?filter=######" target="_blank">Click here to see the latest information</a> about public issues discovered in 24.10-BETA.1 that are being resolved in a future TrueNAS SCALE release.
-->
2 changes: 1 addition & 1 deletion content/SCALE/SCALETutorials/Credentials/BackupCredentials/AddCloudCredentials.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Have any authentication information your cloud storage provider requires on-hand

### Adding Storj Cloud Credentials

The process to set up the Storj-TrueNAS account, buckets, create the S3 access and download the credentials is documented fully in [Adding a Storj Cloud Sync Task]({{< relref "AddStorjCloudSyncTask.md" >}}) in the **Adding Storj Cloud Credentials** section.
The process to set up the Storj-TrueNAS account, buckets, create the S3 access and download the credentials is documented fully in [Adding a Storj Cloud Sync Task]({{< relref "TrueCloudTasks.md" >}}) in the **Adding Storj Cloud Credentials** section.

### Adding Amazon S3 Cloud Credentials

Expand Down
Loading

0 comments on commit a225b02

Please sign in to comment.