[Errno 102] Operation not supported on socket ...

[ncalexan]

When running locally, I'm getting errors with copying a Git repository. The relevant file is a socket related to fsmonitor. It's possible that we could disable fsmonitor for this git repository, but this is fragile -- new features might add new uncopyable files -- but why do we need to copy at all?

(venv) nalexander@proto ~/M/jetstream (filters)> time jetstream rerun --project-id=mozdata --dataset-id=tmp --bucket=mozdata-analysis --experiment-slug=mr2022-backgroundtaskmessage-notification-release-2pct-with-holdback --config-file=../metric-hub/jetstream/mr2022-backgroundtaskmessage-notification-release-2pct-with-holdback.toml --config-repos=/Users/nalexander/Mozilla/metric-hub --sql-output-dir output --period-filter=overall
WARNING:2023-09-15 11:29:25,972:google.auth._default:No project ID could be determined. Consider running `gcloud config set project` or setting the GOOGLE_CLOUD_PROJECT environment variable
WARNING:2023-09-15 11:29:48,146:google.auth._default:No project ID could be determined. Consider running `gcloud config set project` or setting the GOOGLE_CLOUD_PROJECT environment variable
Traceback (most recent call last):
  File "/Users/nalexander/Mozilla/jetstream/venv/bin/jetstream", line 8, in <module>
    sys.exit(cli())
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/Users/nalexander/Mozilla/jetstream/venv/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/nalexander/Mozilla/jetstream/jetstream/cli.py", line 1049, in rerun
    success = AnalysisExecutor(
  File "/Users/nalexander/Mozilla/jetstream/jetstream/cli.py", line 309, in execute
    run_configs = self._experiment_configs_to_analyse(experiment_getter, config_getter)
  File "/Users/nalexander/Mozilla/jetstream/jetstream/cli.py", line 435, in _experiment_configs_to_analyse
    run_configs = self._experiments_to_configs(existing_experiments, config_getter)
  File "/Users/nalexander/Mozilla/jetstream/jetstream/cli.py", line 385, in _experiments_to_configs
    configs = pool.map(_load_experiment_config, experiments)
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/pool.py", line 367, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/pool.py", line 774, in get
    raise self._value
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
    return list(map(*args))
  File "/Users/nalexander/Mozilla/jetstream/jetstream/cli.py", line 365, in _load_experiment_config
    config_collection = config_getter.configs.as_of(first_updated)
  File "/Users/nalexander/Mozilla/metric-config-parser/metric_config_parser/config.py", line 494, in as_of
    shutil.copytree(git_dir.parent, tmp_dir, dirs_exist_ok=True)
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/shutil.py", line 559, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/opt/homebrew/Cellar/[email protected]/3.10.11/Frameworks/Python.framework/Versions/3.10/lib/python3.10/shutil.py", line 513, in _copytree
    raise Error(errors)
shutil.Error: [('/var/folders/3s/_m9prk6n7g5cx6hhs_33q2f80000gn/T/tmpo2bc4835/.git/fsmonitor--daemon.ipc', '/var/folders/3s/_m9prk6n7g5cx6hhs_33q2f80000gn/T/tmpmbzyysqb/.git/fsmonitor--daemon.ipc', "[Errno 102] Operation not supported on socket: '/var/folders/3s/_m9prk6n7g5cx6hhs_33q2f80000gn/T/tmpo2bc4835/.git/fsmonitor--daemon.ipc'")]

┆Issue is synchronized with this Jira Task