Do not run aarch64 Linux tests by default

The Fedora tests take very long. I can run them before a release.
Also, I develop the Linux version on aarch64, anyway, so usually
it is fine.

.github/workflows/test.yaml

@@ -21,7 +21,7 @@ on:
         options:
         - 'yes'
         - 'no'
-        default: 'yes'
+        default: 'no'
       inpmacos:
         description: |
           Build macOS
@@ -124,7 +124,7 @@ jobs:
         fi
 
   linux-build-aarch64:
-    if: ${{ github.event.inputs.inplinuxaarch64 == '' || github.event.inputs.inplinuxaarch64 == 'yes' }}
+    if: ${{ github.event.inputs.inplinuxaarch64 == 'yes' }}
     runs-on: [linux-arm64]
     name: Linux build aaarch
     env: