Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pd 1052 true cloud content for expanded true nas storj integration and snapshot management #2981

Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
313b617
Update SetUpBackupScale.md
DjP-iX Aug 15, 2024
30e32a5
Update AddCloudCredentials.md
DjP-iX Aug 15, 2024
9b27fdd
Delete AddStorjCloudSyncTask.md
DjP-iX Aug 15, 2024
8c1d378
Create TrueCloudTasks.md
DjP-iX Aug 15, 2024
b7aa7a8
Update CloudCredentialScreens.md
DjP-iX Aug 15, 2024
2f50246
Create AddTrueCloudTask.png
DjP-iX Aug 15, 2024
33fffea
Delete StorjCreateAccessDownloadedEncryptionPassphrase.png
DjP-iX Aug 15, 2024
003d00d
Delete StorjCreateAccessEncryptionDialog.png
DjP-iX Aug 15, 2024
0eac34b
Update StorjCreateAccessSelectBuckets.png
DjP-iX Aug 15, 2024
d01f60f
Create StorjCreateAccessSelectConfig.png
DjP-iX Aug 15, 2024
94fab35
Update StorjCreateAccessSelectDuration.png
DjP-iX Aug 15, 2024
3f3b8ea
Create StorjCreateAccessSelectPermissions.png
DjP-iX Aug 15, 2024
1182579
Update StorjCreateAccessWindow.png
DjP-iX Aug 15, 2024
a5e95be
Update StorjS3ConfirmDetails.png
DjP-iX Aug 15, 2024
abc9723
Update StorjS3CredentialsGenerated.png
DjP-iX Aug 15, 2024
ae4cff5
Update TrueCloudTasks.md
DjP-iX Aug 15, 2024
d6b9569
Update CloudSyncTasksScreensSCALE.md
DjP-iX Aug 15, 2024
b11db60
Create TrueCloudBackupTasksScreen.md
DjP-iX Aug 15, 2024
a818bd3
Update AddTrueCloudTask.png
DjP-iX Aug 15, 2024
97caf22
Create AddTrueCloudTaskAdvancedOptions.png
DjP-iX Aug 15, 2024
65b0b51
Create AddTrueCloudTaskBasicOptions.png
DjP-iX Aug 15, 2024
9242f39
Create TrueCloudBackupTasksScreenComplete.png
DjP-iX Aug 15, 2024
f63978a
Create TrueCloudDeleteSnapshot.png
DjP-iX Aug 15, 2024
6518679
Create TrueCloudLogs.png
DjP-iX Aug 15, 2024
5121aea
Create TrueCloudRestore.png
DjP-iX Aug 15, 2024
7d0f3c3
Create TrueCloudSnapshots.png
DjP-iX Aug 15, 2024
9ab4a43
Create TrueCloudTaskSuccess.png
DjP-iX Aug 15, 2024
ff6b13a
Update TrueCloudBackupTasksScreen.md
DjP-iX Aug 15, 2024
9720aef
Update SCALEReleaseNotes.md
DjP-iX Aug 16, 2024
e5edbaa
Update 24.10FeatureList.md
DjP-iX Aug 16, 2024
7a1a4a3
Update SCALEReleaseNotes.md
DjP-iX Aug 16, 2024
a3fba8b
Update SCALEReleaseNotes.md
DjP-iX Aug 16, 2024
68b6768
Update 24.10FeatureList.md
DjP-iX Aug 16, 2024
c4dc8e9
Update SetUpBackupScale.md
DjP-iX Aug 16, 2024
6a84115
Update _index.md
DjP-iX Aug 16, 2024
7f49d13
Update CloudCredentialScreens.md
DjP-iX Aug 16, 2024
24a6e33
Update _index.md
DjP-iX Aug 16, 2024
9e1bdbf
Update CloudServiceProvidersSCALE.md
DjP-iX Aug 16, 2024
118085a
Merge branch 'master' into PD-1052-true-cloud-content-for-expanded-tr…
DjP-iX Aug 16, 2024
fe86ad7
Merge branch 'master' into PD-1052-true-cloud-content-for-expanded-tr…
DjP-iX Aug 16, 2024
50b8811
Update TrueCloudTasks.md
DjP-iX Aug 16, 2024
b67c6bf
Apply suggestions from code review
DjP-iX Aug 19, 2024
6a12511
Merge branch 'master' into PD-1052-true-cloud-content-for-expanded-tr…
DjP-iX Aug 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 14 additions & 11 deletions content/SCALE/GettingStarted/Configure/SetUpBackupScale.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ You should also set up a data storage backup method using either a cloud sync or

TrueNAS provides for data backup through cloud sync or replication.

### Using Cloud Sync for Data Backup
### Using TrueCloud Backup or Cloud Sync

{{< hint type=note title="3rd Party Account Required" >}}
Cloud sync requires an account with a cloud storage provider and a storage location created with that provider, like an Amazon S3 bucket.
Expand All @@ -36,27 +36,30 @@ These providers can charge fees for data transfer and storage, so please review
{{< /hint >}}

You can configure TrueNAS to send, receive, or synchronize data with a cloud storage provider.
The simplest way to set up a cloud sync task is using an iX-Storj account.
The simplest way to set up a TrueCloud backup task is using an Storj iX account.
See [Managing TrueCloud Backup Tasks]({{< relref "TrueCloudTasks.md" >}}) for a full tutorial.

{{< expand "Cloud Sync Quickstart with a Storj Account" "v" >}}

1. Create an iX Storj account and link to TrueNAS.
{{< expand "TrueCloud Backup Quickstart with a Storj Account" "v" >}}
You can create a Storj cloud credential and set up your Storj account from the **Add TrueCloud Backup Task** screen or from the **Credentials > Backup Credentials** screen.
1. Create a Storj iX account and link to TrueNAS.

From the TrueNAS **Dashboard**, find the **Backup Tasks** widget and click **Cloud Sync to Storj or similar provider**.

Open the **Credentials** dropdown and select **Add New**.

The **Storj iX** provider is preselected.
Click **Signup for account** to open a browser tab, then register, select a plan, and activate an iX-Storj Account.
Click **Signup for account** to open a browser tab, then register, select a plan, and activate an Storj iX Account.

After creating the iX-Storj account, log in to the Storj portal, create a new bucket, and create new S3 access credentials ([details]({{< relref "AddStorjCloudSyncTask.md#adding-storj-cloud-credentials" >}})).
When the new S3 Credentials are created, download the **Access Key** and **Secret Key** and paste each string into the TrueNAS **Access Key ID** and **Secret Access Key** fields, respectively.
After creating the Storj iX account, log in to the Storj portal to create a new bucket and new S3 access credentials ([details]({{< relref "TrueCloudTasks.md#adding-storj-cloud-credentials" >}})).
After the new S3 credentials are created, download the **Access Key** and **Secret Key** and paste each string into the TrueNAS **Access Key ID** and **Secret Access Key** fields, respectively.
Click **Save**.

2. Define the backup targets and schedule.

In the TrueNAS Cloud sync task wizard, review the fields in the **What and When** section ([details]({{< relref "AddStorjCloudSyncTask.md#setting-up-the-storj-cloud-sync-task" >}})).
Select the created Storj **Bucket** before choosing a **Folder**.
To add the TrueCloud backup task, go to **Data Protection > TrueCloud Backup Tasks** and click **Add** to open the **Add TrueCloud Backup Task** screen.

Review the fields in the **Local**, **Remote**, **Task Settings**, and **Control** sections.
Select the created Storj **Credentials** and **Bucket** before choosing a **Folder**.

There are several predefined **Schedules** to choose from, or you can select **Custom** to define your own.

Expand All @@ -65,7 +68,7 @@ The simplest way to set up a cloud sync task is using an iX-Storj account.

See [Adding Cloud Credentials]({{< relref "/scale/scaletutorials/credentials/backupcredentials/addcloudcredentials.md" >}}) for information on connecting TrueNAS SCALE to other cloud storage providers.

### Using Replication for Data Backup
### Using Replication

Replication is the process of taking a moment-in-time snapshot of data and then copying that snapshot to another location.
Snapshot technology typically uses less storage than full file backups and has more management and snapshot storage options.
Expand Down
121 changes: 71 additions & 50 deletions content/SCALE/GettingStarted/SCALEReleaseNotes.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,56 +62,37 @@ More details are available from [Software Releases]({{< relref "/TrueNASUpgrades
Users with both LDAP and SMB shares configured should migrate legacy Samba domains to Active Directory before upgrading to 24.10.

<!--
### Upgrade Paths

There are a variety of options for upgrading to SCALE 24.04.

{{< include file="/static/includes/24.04UpgradeMethods.md" >}}

See the <a href="https://www.truenas.com/software-status/" target="_blank">TrueNAS Software Status</a> page for recommendations about which software version to use based on your user type.

Update the system to the latest maintenance release of the installed major version before attempting to upgrade to a new TrueNAS SCALE major version.

**TrueNAS SCALE (Anticipated)**

{{< mermaid class="mermaid_sizing" >}}
flowchart LR

A["22.02.4 (Angelfish)"] |update| C
B[CORE 13.0-U6.1] |ISO install| E
C["22.12.4.2 (Bluefin)"] |update| D
C["22.12.4.2 (Bluefin)"] |update| E
D["23.10.2 (Cobia)"] |update| E
E["24.04.0 (Dragonfish)"]
{{< /mermaid >}}

**TrueNAS SCALE Enterprise (Anticipated)**

{{< mermaid class="mermaid_sizing" >}}
flowchart LR
A["CORE 13.0-U6.1"] |ISO install| D
B["Current 23.10 (Cobia) release"] |update| C["23.10.2 (Cobia)"] |update| D["24.04.0 (Dragonfish)"]
{{< /mermaid >}}
### Upgrade Paths

### CORE > SCALE Migrations

{{< include file="/_includes/MigrateCOREtoSCALEWarning.md" >}}

{{< enterprise >}}
Enterprise customers with HA systems should contact iXsystems Support for assistance with migrating to TrueNAS SCALE.
{{< expand "iXsystems Support" "v" >}}
{{< include file="content/_includes/iXsystemsSupportContact.md" >}}
{{< /expand >}}
{{< /enterprise >}}

When attempting to migrate from TrueNAS CORE, the general recommendation is to back up the system configuration file and use a SCALE **.iso** file to fresh install TrueNAS.
After install, restore the system configuration and import the pools.

Depending on the specific system configuration, this can be a straightforward or complicated process.
See the [Migration articles]({{< relref "/SCALE/GettingStarted/Migrate/_index.md" >}}) for cautions and notes about differences between each software and the CORE to SCALE migration process.

You must either clean install or use an upgrade ***iso** file to migrate a TrueNAS CORE system to SCALE 24.04 (Dragonfish).
Enterprise customers should [contact Support](https://www.truenas.com/docs/scale/gettingstarted/migrate/migratecorehatoscaleha/#expand-1-Enterprise%20HA%20Migrations) for assistance with transitioning from CORE to SCALE.
There are a variety of options for upgrading to SCALE 24.10.

include file="/static/includes/24.04UpgradeMethods.md"

See the <a href="https://www.truenas.com/software-status/" target="_blank">TrueNAS Software Status</a> page for recommendations about which software version to use based on your user type.

Update the system to the latest maintenance release of the installed major version before attempting to upgrade to a new TrueNAS SCALE major version.

include file="/static/includes/SCALEUpgradePaths.md"

### CORE > SCALE Migrations

{{< include file="/_includes/MigrateCOREtoSCALEWarning.md" >}}

{{< enterprise >}}
Enterprise customers with HA systems should contact iXsystems Support for assistance with migrating to TrueNAS SCALE.
{{< expand "iXsystems Support" "v" >}}
{{< include file="content/_includes/iXsystemsSupportContact.md" >}}
{{< /expand >}}
{{< /enterprise >}}

When attempting to migrate from TrueNAS CORE, the general recommendation is to back up the system configuration file and use a SCALE **.iso** file to fresh install TrueNAS.
After install, restore the system configuration and import the pools.

Depending on the specific system configuration, this can be a straightforward or complicated process.
See the [Migration articles]({{< relref "/SCALE/GettingStarted/Migrate/_index.md" >}}) for cautions and notes about differences between each software and the CORE to SCALE migration process.

You must either clean install or use an upgrade ***iso** file to migrate a TrueNAS CORE system to SCALE 24.04 (Dragonfish).
Enterprise customers should [contact Support](https://www.truenas.com/docs/scale/gettingstarted/migrate/migratecorehatoscaleha/#expand-1-Enterprise%20HA%20Migrations) for assistance with transitioning from CORE to SCALE.
-->

## Component Versions
Expand All @@ -138,4 +119,44 @@ Any new feature flags introduced since the previous OpenZFS version that was int

For more details on feature flags, see [OpenZFS Feature Flags](https://openzfs.github.io/openzfs-docs/Basic%20Concepts/Feature%20Flags.html) and [OpenZFS zpool-feature.7](https://openzfs.github.io/openzfs-docs/man/7/zpool-features.7.html).

<!-- 24.10-BETA.1 (relnotes)-->
<!-- 24.10-BETA.1 (relnotes)

{{< hint type=warning title="Early Release Software" >}}
Early releases are intended for testing and feedback purposes.
Do not use early-release software for critical tasks.
{{< /hint >}}

**August 29, 2024**

iXsystems is pleased to release TrueNAS SCALE 24.10-BETA.1!
This has software component updates and new features that are in the polishing phase.

Notable changes:

* Dashboard reworked with more widgets, data reporting, and customization ([NAS-127217](https://ixsystems.atlassian.net/browse/NAS-127217)).

* Applications backend framework is shifted from Kubernetes to Docker ([](https://ixsystems.atlassian.net/browse/)). See the official [announcement](https://forums.truenas.com/t/the-future-of-electric-eel-and-apps/5409) for more information. The **Custom App** installation screen is disabled in 24.10-BETA.1. A redesigned screen, including Docker Compose support, is projected for the RC.1 version.

* New [TrueCloud Backup Tasks]({{< relref "TrueCloudTasks.md" >}}) with streamlined functionality for Storj iX cloud backups and restoration ([NAS-127165](https://ixsystems.atlassian.net/browse/NAS-127165)).

* [Extend a RAIDZ vdev]({{< relref "ManagePoolsScale.md #extending-a-raidz-vdev" >}}) with individual disks (OpenZFS feature sponsored by iXsystems) ([NAS-123548](https://ixsystems.atlassian.net/browse/NAS-123548)).

* New [global search]({{< relref "GlobalSearch.md" >}}) for finding pages and settings in the SCALE UI ([NAS-127224](https://ixsystems.atlassian.net/browse/NAS-127224)).

* UI support for NVMe SMART tests [NAS-128116](https://ixsystems.atlassian.net/browse/NAS-128116)

* Align Enclosure Management code with CORE and improve the feature's performance ([NAS-123474](https://ixsystems.atlassian.net/browse/NAS-123474)).

* Preserve SMB alternate data streams when ingesting data from remote servers ([NAS-127114](https://ixsystems.atlassian.net/browse/NAS-127114)).

* Rewrite TrueNAS installer to better support future development efforts ([NAS-127092](https://ixsystems.atlassian.net/browse/NAS-127092)).

<a href="https://ixsystems.atlassian.net/issues/?filter=######" target="_blank">Click here for the full changelog</a> of completed tickets that are included in the 24.10-BETA.1 release.
{{< include file="/static/includes/JiraFilterInstructions.md" >}}

### 24.04-BETA.1 Known Issues

*

<a href="https://ixsystems.atlassian.net/issues/?filter=######" target="_blank">Click here to see the latest information</a> about public issues discovered in 24.10-BETA.1 that are being resolved in a future TrueNAS SCALE release.
-->
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Have any authentication information your cloud storage provider requires on-hand

### Adding Storj Cloud Credentials

The process to set up the Storj-TrueNAS account, buckets, create the S3 access and download the credentials is documented fully in [Adding a Storj Cloud Sync Task]({{< relref "AddStorjCloudSyncTask.md" >}}) in the **Adding Storj Cloud Credentials** section.
The process to set up the Storj-TrueNAS account, buckets, create the S3 access and download the credentials is documented fully in [Adding a Storj Cloud Sync Task]({{< relref "TrueCloudTasks.md" >}}) in the **Adding Storj Cloud Credentials** section.

### Adding Amazon S3 Cloud Credentials

Expand Down
Loading
Loading