Skip to content

:octocat: Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories.

License

Notifications You must be signed in to change notification settings

Airbase/changed-files

 
 

Repository files navigation

Ubuntu Mac OS Windows Public workflows that use this action.

Codacy Badge CI Update release version.

All Contributors

Screen Shot 2021-11-19 at 4 59 21 PM

changed-files

Retrieve all changed files and directories relative to a target branch, preceeding commit or the last remote commit returning a relative paths from the project root.

Table of contents

Features

  • Fast execution (0-10 seconds on average).
  • Easy to debug.
  • Scales to large repositories.
  • Supports Git submodules.
  • Escaped JSON output which can be used to run matrix jobs based on changed files.
  • List changed directories.
  • Restrict the max depth of changed directories.
  • Write outputs to a .txt or .json file at a specified location for further processing.
  • Monorepos (Fetches a fixed number of commits).
  • Supports all platforms (Linux, MacOS, Windows).
  • GitHub-hosted runners support
  • GitHub Enterprise Server support.
  • self-hosted runners support.
  • List all files and directories that have changed:
    • Between the current pull request branch and the last commit on the target branch.
    • Between the last commit and the current pushed change.
    • Between the last remote branch commit and the current HEAD.
  • Restrict change detection to a subset of files and directories:
    • Boolean output indicating that certain files have been changed.
    • Using Glob pattern matching.
      • Brace expansion.

Usage

Warning:

  • IMPORTANT: For push events when configuring actions/checkout the fetch-depth should be set to either fetch-depth: 0 OR fetch-depth: 2 depending on your use case.
  • For monorepos where pulling all the branch history might not be desired, you can omit actions/checkout - fetch-depth for pull_request events.
  • For files located in a sub-directory ensure that the pattern specified contains **/ (globstar) to match any preceding directories or explicitly pass the full path relative to the project root. See: Pattern Gotcha.
  • All multiline inputs should not use double or single quotes since the value is already a string seperated by a newline character. See Examples for more information.
  • Ensure that persist-credentials is set to true when configuring actions/checkout if fetch-depth isn't set to 0.
name: CI

on:
  push:
    branches:
      - main
  pull_request:
    branches:
      - main

# -------------------------------------------------------------------------------------------------------------------------
# Event `push`: Compare the preceeding commit -> to the current commit of the main branch.
# Event `pull_request`: Compare the last commit of main -> to the current commit of a Pull Request branch.
# -------------------------------------------------------------------------------------------------------------------------

jobs:
  build:
    runs-on: ubuntu-latest  # windows-latest | macos-latest
    name: Test changed-files
    steps:
      - uses: actions/checkout@v3
        with:
          fetch-depth: 0  # OR "2" -> To retrieve the preceding commit.

      # Example 1
      - name: Get changed files
        id: changed-files
        uses: tj-actions/changed-files@v35
        
        # To compare changes between the current commit and the last pushed remote commit set `since_last_remote_commit: true`. e.g
        # with:
        #   since_last_remote_commit: true 

      - name: List all changed files
        run: |
          for file in ${{ steps.changed-files.outputs.all_changed_files }}; do
            echo "$file was changed"
          done

      # Example 2
      - name: Get changed files in the docs folder
        id: changed-files-specific
        uses: tj-actions/changed-files@v35
        with:
          files: docs/*.{js,html}  # Alternatively using: `docs/**` or `docs`

      - name: Run step if any file(s) in the docs folder change
        if: steps.changed-files-specific.outputs.any_changed == 'true'
        run: |
          echo "One or more files in the docs folder has changed."
          echo "List all the files that have changed: ${{ steps.changed-files-specific.outputs.all_changed_files }}"
      
      # Example 3
      - name: Get all changed *.js file(s) or any file in the static folder excluding the docs folder
        id: changed-files-excluded
        uses: tj-actions/changed-files@v35
        with:
          files: |
            **/*.js
            static
          files_ignore: docs

      - name: Run step if any *.js file(s) or any file in the static folder change
        if: steps.changed-files-excluded.outputs.any_changed == 'true'
        run: |
          echo "One or more *.js file(s) or any file in the static folder but not in the doc folder has changed."
          echo "List all the files that have changed: ${{ steps.changed-files-excluded.outputs.all_changed_files }}"

If you feel generous and want to show some extra appreciation:

Support this project with a ⭐

Buy me a coffee

Useful Acronyms

Acronym Meaning
A Added
C Copied
M Modified
D Deleted
R Renamed
T Type changed
U Unmerged
X Unknown

Outputs

OUTPUT TYPE DESCRIPTION
added_files string Returns only files that are
Added (A).
all_changed_and_modified_files string Returns all changed and modified
files i.e. a combination of (ACMRDTUX)
all_changed_files string Returns all changed files i.e.
a combination of all added, copied, modified and renamed files (ACMR)
all_modified_files string Returns all changed files i.e.
a combination of all added, copied, modified, renamed and deleted files (ACMRD).
all_old_new_renamed_files string Returns only files that are
Renamed and list their old
and new names. NOTE: This
requires setting include_all_old_new_renamed_files to true
(R)
any_changed string Returns true when any of
the filenames provided using the
files input has changed. If
no files have been specified,an
empty string '' is returned.
i.e. using a combination of all added, copied, modified and renamed files (ACMR).
any_deleted string Returns true when any of
the filenames provided using the
files input has been deleted.
If no files have been
specified,an empty string '' is
returned. (D)
any_modified string Returns true when any of
the filenames provided using the
files input has been modified.
If no files have been
specified,an empty string '' is
returned. i.e. using a combination of all added, copied, modified, renamed, and deleted files (ACMRD).
copied_files string Returns only files that are
Copied (C).
deleted_files string Returns only files that are
Deleted (D).
modified_files string Returns only files that are
Modified (M).
only_changed string Returns true when only files
provided using the files input
has changed. If no files
have been specified,an empty string
'' is returned. i.e. using a combination of all added, copied, modified and renamed files (ACMR).
only_deleted string Returns true when only files
provided using the files input
has been deleted. If no
files have been specified,an empty
string '' is returned. (D)
only_modified string Returns true when only files
provided using the files input
has been modified. If no
files have been specified,an empty
string '' is returned.(ACMRD).
other_changed_files string Returns all other changed files
not listed in the files
input i.e. using a combination of all added, copied, modified and renamed files (ACMR).
other_deleted_files string Returns all other deleted files
not listed in the files
input i.e. a combination of all deleted files (D)
other_modified_files string Returns all other modified files
not listed in the files
input i.e. a combination of all added, copied, modified, and deleted files (ACMRD)
renamed_files string Returns only files that are
Renamed (R).
type_changed_files string Returns only files that have
their file type changed (T).
unknown_files string Returns only files that are
Unknown (X).
unmerged_files string Returns only files that are
Unmerged (U).

Inputs

INPUT TYPE REQUIRED DEFAULT DESCRIPTION
base_sha string false Specify a different base commit
SHA used for comparing changes
diff_relative string false Exclude changes outside the current
directory and show path names
relative to it. NOTE: This
requires you to specify the
top level directory via the
path input.
dir_names string false "false" Output unique changed directories instead
of filenames. NOTE: This returns
. for changed files located
in the root of the
project.
dir_names_exclude_root string false "false" Exclude the root directory represented
by . from the output
when dir_namesis set to true.
dir_names_max_depth string false Maximum depth of directories to
output. e.g test/test1/test2 with max
depth of 2 returns test/test1.
fetch_depth string false "50" Depth of additional branch history
fetched. NOTE: This can be
adjusted to resolve errors with
insufficient history.
files string false File and directory patterns to
detect changes using only these
list of file(s) (Defaults to the entire repo) NOTE:
Multiline file/directory patterns should not
include quotes.
files_from_source_file string false Source file(s) used to populate
the files input.
files_ignore string false Ignore changes to these file(s)
NOTE: Multiline file/directory patterns should
not include quotes.
files_ignore_from_source_file string false Source file(s) used to populate
the files_ignore input
files_ignore_separator string false "\n" Separator used to split the
files_ignore input
files_separator string false "\n" Separator used to split the
files input
include_all_old_new_renamed_files string false "false" Include all_old_new_renamed_files output. Note this
can generate a large output
See: #501.
json string false "false" Output list of changed files
in a JSON formatted string
which can be used for
matrix jobs.
json_raw_format string false "false" Output list of changed files
in jq raw output format
which means that the output
will not be surrounded by
quotes and special characters will
not be escaped.
match_directories string false "true" Indicates whether to include match
directories
old_new_files_separator string false " " Split character for old and
new renamed filename pairs.
old_new_separator string false "," Split character for old and
new filename pairs.
output_dir string false ".github/outputs" Directory to store output files.
path string false "." Specify a relative path under
$GITHUB_WORKSPACE to locate the repository.
quotepath string false "true" Use non ascii characters to
match files and output the
filenames completely verbatim by setting
this to false
separator string false " " Split character for output strings
sha string false Specify a different commit SHA
used for comparing changes
since string false Get changed files for commits
whose timestamp is older than
the given time.
since_last_remote_commit string false "false" Use the last commit on
the remote branch as the
base_sha. Defaults to the last
non merge commit on the
target branch for pull request
events and the previous remote
commit of the current branch
for push events.
until string false Get changed files for commits
whose timestamp is earlier than
the given time.
write_output_files string false "false" Write outputs to files in
the .github/outputs folder by default.

Versioning

This GitHub Action follows the principles of Semantic Versioning for versioning releases.

In addition to the standard versioning scheme, this action also uses the v[major.minor.patch]-sec convention for versions that implement hardening security strategies as described in the GitHub Actions security hardening guide.

The format of the version string is as follows:

major: is a major release number that indicates significant changes or new features that may not be backward compatible.

minor: is a minor release number that indicates minor changes or new features that are backward compatible.

patch : is a patch release number that indicates bug fixes or other small changes that are backward compatible.

-sec is a suffix that indicates a security-hardened version that implements additional security measures.

For example, v1.2.3-sec would indicate a security-hardened version of the action with major version 1, minor version 2, and patch version 3.

Using this versioning convention helps ensure that users can easily identify and choose security-hardened versions of this action when integrating it into their workflows.

Examples

Get all changed files in the current branch
...
    - name: Get changed files
      id: changed-files
      uses: tj-actions/changed-files@v35
...
Get all changed files and using a comma separator
...
    - name: Get all changed files and use a comma separator in the output
      id: changed-files
      uses: tj-actions/changed-files@v35
      with:
        separator: ","
...

See inputs for more information.

Get all changed files and list all added files
...
    - name: Get changed files
      id: changed-files
      uses: tj-actions/changed-files@v35

    - name: List all added files
      run: |
        for file in ${{ steps.changed-files.outputs.added_files }}; do
          echo "$file was added"
        done
...

See outputs for a list of all available outputs.

Get all changed files and optionally run a step if a file was modified
...
    - name: Get changed files
      id: changed-files
      uses: tj-actions/changed-files@v35

    - name: Run a step if my-file.txt was modified
      if: contains(steps.changed-files.outputs.modified_files, 'my-file.txt')
      run: |
        echo "my-file.txt file has been modified."
...

See outputs for a list of all available outputs.

Get all changed files and write the outputs to a txt file
...

   - name: Get changed files and write the outputs to a txt file
     id: changed-files-write-output-files-txt
     uses: ./
     with:
       write_output_files: true

    - name: Verify the contents of the .github/outputs/added_files.txt file
      run: |
        cat .github/outputs/added_files.txt
...

See action.yml for a list of all available keys.

Get all changed files and write the outputs to a json file
...
   - name: Get changed files and write the outputs to a json file
     id: changed-files-write-output-files-json
     uses: ./
     with:
       json: true
       write_output_files: true

    - name: Verify the contents of the .github/outputs/added_files.json file
      run: |
        cat .github/outputs/added_files.json
...

See action.yml for a list of all available keys.

Get all changed files using a list of files
...
    - name: Get changed files
      id: changed-files
      uses: tj-actions/changed-files@v35
      with:
        files: |
          my-file.txt
          *.sh
          *.png
          !*.md
          test_directory
          **/*.sql
...

See inputs for more information.

Get all changed files using a list of files and take action based on the changes
...
    - name: Get changed files
      id: changed-files-specific
      uses: tj-actions/changed-files@v35
      with:
        files: |
          my-file.txt
          *.sh
          *.png
          !*.md
          test_directory
          **/*.sql

    - name: Run step if any of the listed files above change
      if: steps.changed-files-specific.outputs.any_changed == 'true'
      run: |
        echo "One or more files listed above has changed."

    - name: Run step if only the files listed above change
      if: steps.changed-files-specific.outputs.only_changed == 'true'
      run: |
        echo "Only files listed above have changed."

    - name: Run step if any of the listed files above is deleted
      if: steps.changed-files-specific.outputs.any_deleted == 'true'
      run: |
        for file in ${{ steps.changed-files-specific.outputs.deleted_files }}; do
          echo "$file was deleted"
        done

    - name: Run step if all listed files above have been deleted
      if: steps.changed-files-specific.outputs.only_deleted == 'true'
      run: |
        for file in ${{ steps.changed-files-specific.outputs.deleted_files }}; do
          echo "$file was deleted"
        done
...

See outputs for a list of all available outputs.

Get all changed files using a source file or list of file(s) to populate to files input
...
    - name: Get changed files using a source file or list of file(s) to populate to files input.
      id: changed-files-specific-source-file
      uses: tj-actions/changed-files@v35
      with:
        files_from_source_file: test/changed-files-list.txt
...

See inputs for more information.

Get changed files using a source file or list of file(s) to populate to files input and optionally specify more files
...
    - name: Get changed files using a source file or list of file(s) to populate to files input and optionally specify more files.
      id: changed-files-specific-source-file-and-specify-files
      uses: tj-actions/changed-files@v35
      with:
        files_from_source_file: |
          test/changed-files-list.txt
        files: |
          test.txt
...

See inputs for more information.

Get all changed files using a different SHA
...
    - name: Get changed files using a different SHA
      id: changed-files
      uses: tj-actions/changed-files@v35
      with:
        sha: ${{ github.event.pull_request.head.sha }}
...

See inputs for more information.

Get all changed files using a different base SHA
...
    - name: Get changed files using a different base SHA
      id: changed-files
      uses: tj-actions/changed-files@v35
      with:
        base_sha: ${{ github.event.pull_request.base.sha }}
...

See inputs for more information.

Get all changed files between the previous tag and the current tag
...
on:
  push:
    tags:
      - 'v*'

jobs:
  release:
    name: Release
    runs-on: ubuntu-latest
    steps:
      - name: Checkout
        uses: actions/checkout@v3
        with:
          fetch-depth: 0

      - name: Get changed files
        id: changed-files
        uses: tj-actions/changed-files@v35

      - name: Get changed files in the .github folder
        id: changed-files-specific
        uses: tj-actions/changed-files@v35
        with:
          base_sha: ${{ steps.get-base-sha.outputs.base_sha }}
          files: .github/**

      - name: Run step if any file(s) in the .github folder change
        if: steps.changed-files-specific.outputs.any_changed == 'true'
        run: |
          echo "One or more files in the .github folder has changed."
          echo "List all the files that have changed: ${{ steps.changed-files-specific.outputs.all_changed_files }}"
...

See inputs for more information.

Get all changed files for a repository located in a different path
...
    - name: Checkout into dir1
      uses: actions/checkout@v3
      with:
        fetch-depth: 0
        path: dir1

    - name: Run changed-files with defaults in dir1
      id: changed-files-for-dir1
      uses: tj-actions/changed-files@v35
      with:
        path: dir1

    - name: List all added files in dir1
      run: |
        for file in ${{ steps.changed-files-for-dir1.outputs.added_files }}; do
          echo "$file was added"
        done
...

See inputs for more information.

Get all changed files with non äšćįí characters i.e (Filename in other languages)
...
    - name: Run changed-files with quotepath disabled
      id: changed-files-quotepath
      uses: tj-actions/changed-files@v35
      with:
        quotepath: "false"

    - name: Run changed-files with quotepath disabled for a specified list of file(s)
      id: changed-files-quotepath-specific
      uses: ./
      with:
        files: test/test-è.txt
        quotepath: "false"
...

See inputs for more information.

Get all changed files using the last successful commit of the base branch
  • Push event
    ...
          - name: Get branch name
            id: branch-name
            uses: tj-actions/branch-names@v6
    
          - uses: nrwl/nx-set-shas@v3
            id: last_successful_commit_push
            with:
              main-branch-name: ${{ steps.branch-name.outputs.current_branch }} # Get the last successful commit for the current branch.
              workflow-id: 'test.yml'
    
          - name: Run changed-files with the commit of the last successful test workflow run
            id: changed-files-base-sha-push
            uses: tj-actions/changed-files@v35
            with:
              base_sha: ${{ steps.last_successful_commit_push.outputs.base }}
    ...
  • Pull request events
    ...
          - name: Get branch name
            id: branch-name
            uses: tj-actions/branch-names@v5
    
          - uses: nrwl/nx-set-shas@v3
            id: last_successful_commit_pull_request
            with:
              main-branch-name: ${{ steps.branch-name.outputs.base_ref_branch }} # Get the last successful commit on master or main branch
              workflow_id: 'test.yml'
    
          - name: Run changed-files with the commit of the last successful test workflow run on main
            id: changed-files-base-sha-pull-request
            uses: tj-actions/changed-files@v35
            with:
              base_sha: ${{ steps.last_successful_commit_pull_request.outputs.base }}
    ...

Warning: This setting overrides the commit sha used by setting since_last_remote_commit to true. It is recommended to use either solution that works for your use case.

See inputs for more information.

Get all changed files but only return the directory names
...
    - name: Run changed-files with dir_names
      id: changed-files-dir-names
      uses: tj-actions/changed-files@v35
      with:
        dir_names: "true"
...

See inputs for more information.

Get all changed files and return JSON formatted outputs
...
    - name: Run changed-files with json output
      id: changed-files-json
      uses: tj-actions/changed-files@v35
      with:
        json: "true"
...

See inputs for more information.

Get all changed files by commits pushed in the past
...
    - name: Get changed-files since 2022-08-19
      id: changed-files-since
      uses: tj-actions/changed-files@v35
      with:
        since: "2022-08-19"

    - name: Get changed-files until 2022-08-20
      id: changed-files-until
      uses: tj-actions/changed-files@v35
      with:
        until: "2022-08-20"
...

See inputs for more information.

Real world usage

And many more...

Known Limitation

Warning:

  • Using characters like \n, %, . and \r as separators would be URL encoded

  • Spaces in file names can introduce bugs when using bash loops. See: #216 However, this action will handle spaces in file names, with a recommendation of using a separator to prevent hidden issues.

    Screen Shot 2021-10-23 at 9 37 34 AM

Migration guide

With the switch from using grep's Extended regex to match files to the natively supported workflow glob pattern matching syntax introduced in v13 you'll need to modify patterns used to match files.

...
      - name: Get specific changed files
        id: changed-files-specific
        uses: tj-actions/changed-files@v24
        with:
          files: |
-            \.sh$
-            .(sql|py)$
-            ^(dir1|dir2)
+            *.{sh,sql,py}
+            dir1
+            dir2

Credits

This package was created with cookiecutter-action.

Report Bugs

Report bugs at https://github.com/tj-actions/changed-files/issues.

If you are reporting a bug, please include:

  • Your operating system name and version.
  • Any details about your workflow that might be helpful in troubleshooting. (NOTE: Ensure that you include full log outputs with debugging enabled)
  • Detailed steps to reproduce the bug.

Contributors ✨

Thanks goes to these wonderful people (emoji key):

Josh Soref
Josh Soref

📖
Nick Landers
Nick Landers

💻
Krasimir Nikolov
Krasimir Nikolov

💻 📖
Ivan Pizhenko
Ivan Pizhenko

💻 📖
talva-tr
talva-tr

💻
Ikko Ashimine
Ikko Ashimine

📖
James
James

📖
James Cheng
James Cheng

📖
Masaya Suzuki
Masaya Suzuki

💻
fagai
fagai

📖
Constantine Peresypkin
Constantine Peresypkin

💻
Mathieu Dupuy
Mathieu Dupuy

📖
Joe Moggridge
Joe Moggridge

📖
Charles Santos
Charles Santos

💻
Kostiantyn Korniienko
Kostiantyn Korniienko

📖
Logan Pulley
Logan Pulley

💻
Kenji Miyake
Kenji Miyake

💻
adonisgarciac
adonisgarciac

💻 📖
Chiel Fernhout
Chiel Fernhout

📖
Alberto Perdomo
Alberto Perdomo

📖

This project follows the all-contributors specification. Contributions of any kind welcome!

About

:octocat: Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 100.0%