Skip to content

Commit

Permalink
fix(misc): minor fixes for nx 10->nx11 migration
Browse files Browse the repository at this point in the history
  • Loading branch information
vsavkin committed Dec 12, 2020
1 parent 6a19a3c commit 0875d19
Show file tree
Hide file tree
Showing 7 changed files with 142 additions and 50 deletions.
95 changes: 70 additions & 25 deletions docs/angular/guides/update.md
Original file line number Diff line number Diff line change
@@ -1,19 +1,57 @@
# Updating Nx

Nx provides migrations which help you stay up to date with the latest version of Nx.
Nx provides the `migrate` command which help you stay up to date with the latest version of Nx.

Not only do we migrate the version of Nx, but we also update the versions of dependencies which we install such as jest and cypress.
Not only `nx migrate` updates the version of Nx, but it also updates the versions of dependencies which we install such as jest and cypress. You can also use the `migrate` command to update any Nx plugin or any Angular package.

We recommend waiting for Nx to update these dependencies for you as we verify that these versions work together.
## What About "Ng Update?"

**TLDR: So if you are using Nx 10, run `nx migrate latest` instead of `ng update`.**

If you haven't used Nx before and used the Angular CLI, you probably ran `ng update`. What is the difference?

`nx migrate` is a much improved version of `ng update`. It runs the same migrations, but allows you to:

- rerun the same migration multiple times
- reorder migrations
- skip migrations
- fix migrations that "almost work"
- commit a partially migrated state
- change versions of packages to match org requirements

And, in general, it is lot more reliable for non-trivial workspaces. Why?

`ng update` tries to perform migration in a single go, automatically. This doesn't work for most non-trivial workspaces.

- `ng update` doesn't separate updating `package.json` from updating the source code of the repo. It all happens in a single go. This often fails for non-trivial workspaces or for organizations that have a custom npm registry, where you might want to use a different version of a package.
- `ng update` relies on `peerDependencies` to figure out what needs to be updated. Many third-party plugin don't have `peerDependencies` set correctly.
- When using `ng update` it is difficult to execute one migration at a time. Sometimes you want to patch things up after executing a migration.
- When using `ng update` it's not possible to fix almost-working migrations. We do our best but sometimes we don't account for the specifics of a particular workspace.
- When using `ng update` it's not possible to commit a partially-migrated repo. Migration can take days for a large repo.
- When using `ng update` it's not possible to rerun some of the migrations multiple times. This is required because you can rebase the branch multiple times while migrating.

The Nx core team have gained a lot of experience migrating large workspaces over the last 4 years, and `nx migrate` has been consistently a lot more reliable and easier to use. It has also been a lot easier to implement migrations that work with `nx migrate` comparing to `ng update`. As a result, folks building React and Node applications with Nx have had better experience migrating because Angular folks use `ng update` out of habit, instead of using the command that works better.

**Starting with Nx 11, you can migrate workspaces only using `nx migrate`**. To reiterate: `nx migrate` runs the migrations written by the Angular CLI team the same way `ng update` runs them. So everything should still work. You just get more control over how it works.

## How to Migrate

### Generate migrations.json
Migration happens in two steps:

- Updating `package.json` (and `node_modules`)
- Updating the source code of the repo to match the new versions of packages in `package.json`

### Step 1: Updating package.json and generating migrations.json

Run the following:

```bash
nx migrate latest # same as nx migrate @nrwl/workspace@latest
```

All you you have to do to update Nx to the latest version is run the following:
You can also specify the name of the package and the version:

```bash
nx migrate @nrwl/workspace
nx migrate @nrwl/workspace@version # you can also specify version
```

Expand All @@ -24,28 +62,45 @@ This will fetch the specified version of `@nrwl/workspace`, analyze the dependen

At this point, no packages have been installed, and no other files have been touched.

Now, you can inspect `package.json` to see if the changes make sense and install the packages by running `npm install` or `yarn`.
Now, you can inspect `package.json` to see if the changes make sense. Sometimes the migration can update some package to the version that is either not allowed or conflicts with with another package. After you are satisfied, run `npm install`, `yarn`, or `pnpm install`.

### Step 2: Running migrations

### Run Migrations
Next, we need to update the repo to match the updated `package.json` and `node_modules`. Every Nx plugin comes with a set of migrations that describe how to update the workspace to make it work with the new version of the plugin. During Step 1 Nx looked at all of the packages being updated and collected their migrations into `migrations.json`. It's important to note that because Nx knows the from and to versions of every package, the `migrations.json` file only contains the relevant migrations.

`migrations.json` contains the transformations that must run to prepare the workspace to the newly installed versions of packages. To run all the migrations, invoke:
Each migration in `migrations.json` updates the source code in the repository. To run all the migrations in order, invoke:

```bash
nx migrate --run-migrations=migrations.json
```

For small projects, running all the migrations at once often succeeds without any issues.

For large projects, more flexibility is often needed:
For small projects, running all the migrations at once often succeeds without any issues. For large projects, more flexibility is sometimes needed:

- You may have to skip a migration.
- You may want to run one migration at a time to address minor issues.
- You may want to reorder migrations.
- You may want to run the same migration multiple time if the process takes a long time and you had to rebase.

Since you can run `nx migrate --run-migrations=migrations.json` as many times as you want, you can achieve all of that by commenting out and reordering items in `migrations.json`.
Since you can run `nx migrate --run-migrations=migrations.json` as many times as you want, you can achieve all of that by commenting out and reordering items in `migrations.json`. The migrate process can take a long time, sometimes a day, so it can be useful to commit the migrations file with the partially-updated repo.

### Step 3: Cleaning up

After you run all the migrations, you can remove `migration.json` and commit the changes.

## Advanced Capabilities & Recommendations

### One Major Version at a Time, Small Steps

The migrate process can take a long time, sometimes day, so it can be useful to commit the migrations file.
Migrating Jest, Cypress, ESLint, React, Angular, Next etc... is a difficult task. All the tools change at different rates, they can conflict with each other etc.. In addition, every workspace is different. Even though our goal is to let you update any version of Nx to any other version in a single go, sometimes it doesn't work. The following process is better for large workspaces.

Say you want to migrate from Nx 10.1.0 to Nx 11.0.1. The following steps are more likely to work comparing to `nx migrate 11.0.1`.

- Run `nx migrate 10.4.5` to update the latest version in the 10x branch.
- Run `npm install`
- Run `nx migrate --run-migrations=migrations.json`
- Next, run `nx migrate 11.0.1`
- Run `npm install`
- Run `nx migrate --run-migrations=migrations.json`

### Overriding versions

Expand All @@ -61,7 +116,7 @@ By default, Nx uses currently installed packages to calculate what migrations ne
nx migrate @nrwl/workspace --to="@nrwl/[email protected]"
```

## Reverting a failed update
### Reverting a failed update

Updates are best done on a clean git history so that it can be easily reversed if something fails.
We try our best to make sure migrations do not fail but if one does, **please report it** on [Github](https://www.github.com/nrwl/nx/issues/new/).
Expand All @@ -71,13 +126,3 @@ If an update fails for any reason, you can revert it as you do any other set of
git reset --hard # Reset any changes
git clean -fd # Delete newly added files and directories
```

## Updating Other Dependencies

Nx does not handle updating the dependencies that Nx did not add. Please refer to those projects for the best updating strategy.

## Using Angular CLI Update

The `nx migrate` command uses the same migrations as `ng update`. You can use either command to update your workspace.

The difference is that `nx migrate` gives you a lot more control over what gets installed, what migrations run, etc.. This is often needed for mid-size or large projects, where `ng-update` falls short.
2 changes: 1 addition & 1 deletion docs/map.json
Original file line number Diff line number Diff line change
Expand Up @@ -985,7 +985,7 @@
{
"name": "Updating Nx",
"id": "update",
"file": "shared/update"
"file": "angular/guides/update"
}
]
},
Expand Down
22 changes: 0 additions & 22 deletions docs/shared/update.md
Original file line number Diff line number Diff line change
Expand Up @@ -96,25 +96,3 @@ If an update fails for any reason, you can revert it as you do any other set of
git reset --hard # Reset any changes
git clean -fd # Delete newly added files and directories
```

## `nx migrate` and `ng upgrade`

`nx migrate` is a much improved version of `ng update`. It runs same migrations, but allows you to:

- rerun the same migration multiple times
- reorder migrations
- skip migrations
- fix migrations that "almost work"
- commit a partially migrated state
- change versions of packages to match org requirements

And, in general, it is lot more reliable for non-trivial workspaces. Why?

`ng update` tries to perform migration in a single go, automatically. This doesn't work for most non-trivial workspaces.

- `ng update` doesn't separate updating `package.json` from updating the source code of the repo. It all happens in a single go. This often fails for non-trivial workspaces or for organizations that have a custom npm registry, where you might want to use a different version of a package.
- `ng update` relies on `peerDependencies` to figure out what needs to be updated. Many third-party plugin don't have `peerDependencies` set correctly.
- When using `ng update` it is difficult to execute one migration at a time. Sometimes you want to patch things up after executing a migration.
- When using `ng update` it's not possible to fix almost-working migrations. We do our best but sometimes we don't account for the specifics of a particular workspace.
- When using `ng update` it's not possible to commit partially-migrated repo. Migration can take days for a large repo.
- When using `ng update` it's not possible to rerun some of the migrations multiple times. This is required because you can rebase the branch multiple times while migrating.
10 changes: 8 additions & 2 deletions packages/cli/lib/init-local.ts
Original file line number Diff line number Diff line change
Expand Up @@ -32,9 +32,12 @@ export function initLocal(workspace: Workspace) {
if (workspace.type === 'nx') {
loadCli(workspace, '@nrwl/tao/index.js');
} else {
if (process.argv[2] === 'update') {
if (
process.argv[2] === 'update' &&
process.env.FORCE_NG_UPDATE != 'true'
) {
console.log(
`Nx provides a much improved version of "ng update". It runs same migrations, but allows you to:`
`Nx provides a much improved version of "ng update". It runs the same migrations, but allows you to:`
);
console.log(`- rerun the same migration multiple times`);
console.log(`- reorder migrations`);
Expand All @@ -48,6 +51,9 @@ export function initLocal(workspace: Workspace) {
console.log(
`Run "nx migrate latest" to update to the latest version of Nx.`
);
console.log(
`If you still want to use "ng update", run "FORCE_NG_UPDATE=true ng update".`
);
} else {
loadCli(workspace, '@angular/cli/lib/init.js');
}
Expand Down
10 changes: 10 additions & 0 deletions packages/workspace/migrations.json
Original file line number Diff line number Diff line change
Expand Up @@ -159,6 +159,16 @@
"version": "11.0.0-beta.15",
"description": "Adds `outputs` based on builders",
"factory": "./src/migrations/update-11-0-0/add-outputs-in-workspace"
},
"update-command-check": {
"version": "11.0.0",
"description": "Check that the right update command is used",
"factory": "./src/migrations/update-11-0-0/update-command-check"
},
"rename-workspace-schematic-script": {
"version": "11.0.2",
"description": "Rename the workspace-schematic script into workspace-generator script",
"factory": "./src/migrations/update-11-0-0/rename-workspace-schematic-script"
}
},
"packageJsonUpdates": {
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
import { updateJsonInTree } from '@nrwl/workspace';

export default function renameWorkspaceSchematicScript() {
return updateJsonInTree('package.json', (json) => {
if (json.scripts && json.scripts['workspace-schematic']) {
delete json.scripts['workspace-schematic'];
json.scripts['workspace-generator'] = 'nx workspace-generator';
}
return json;
});
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
export default function update() {
return () => {
if (process.argv[2] === 'update') {
console.log(
'-------------------------------------------------------------'
);
console.log(
'-------------------------------------------------------------'
);
console.log(
'-------------------------------------------------------------'
);
console.log(
`Nx provides a much improved version of "ng update". It runs the same migrations, but allows you to:`
);
console.log(`- rerun the same migration multiple times`);
console.log(`- reorder migrations`);
console.log(`- skip migrations`);
console.log(`- fix migrations that "almost work"`);
console.log(`- commit a partially migrated state`);
console.log(`- change versions of packages to match org requirements`);
console.log(
`And, in general, it is lot more reliable for non-trivial workspaces. Read more at: https://nx.dev/latest/angular/workspace/update`
);
console.log(
`Run "nx migrate latest" to update to the latest version of Nx.`
);
console.log(
'-------------------------------------------------------------'
);
console.log(
'-------------------------------------------------------------'
);
console.log(
'-------------------------------------------------------------'
);
throw new Error(
`Use "nx migrate" instead of "ng update". Read more at: Read more at: https://nx.dev/latest/angular/workspace/update`
);
}
};
}

0 comments on commit 0875d19

Please sign in to comment.