- Clone the repo
- Install dependencies
- Architecture
- Create a new plugin
- Tests
- Integrity
- Formatting, Linting and Compiling
- Open Source compliance
- Documentation
- Publishing
- Misc. Tooling
git clone [email protected]:DataDog/build-plugins.git
Use Volta (recommended)
brew install volta
volta setup
# From the repo's root.
volta install node yarn
Or install Yarn yourself
brew install yarn
Note
Do not worry about the version, it's dealt with by the repo.
Ensure dependencies are up to date in the repository.
# From the repo's root.
yarn
We have two types of workspaces:
@datadog/*
: The packages we're publishing publically on NPM.@datadog/eslint-plugin
: The eslint plugin.@datadog/rollup-plugin
: The rollup plugin.@datadog/vite-plugin
: The vite plugin.@datadog/webpack-plugin
: The webpack plugin.
@dd/*
: The packages we're only using internally.@dd/assets
|./packages/assets
: Only the static files used as assets.@dd/core
|./packages/core
: The core package that contains the shared code between the plugins.@dd/factory
|./packages/factory
: The factory package that contains the logic to aggregate all the plugins together.@dd/*-plugin
|./packages/plugins/*
: The actual features of our bundler plugins.@dd/tests
|./packages/tests
: The tests package that contains the shared tests between the all the workspaces.@dd/tools
|./packages/tools
: The tools package that contains the shared tools we use locally for the development.
Here's a diagram to help you understand the structure:
---
title: Datadog Build Plugins Design
---
stateDiagram-v2
published: Published Packages
productPlugins: Product Plugins
productPlugin: @dd/{product}-plugin
productPlugin2: [...]
esbuildplugin: @datadog/esbuild-plugin
viteplugin: @datadog/vite-plugin
rollupplugin: @datadog/rollup-plugin
webpackplugin: @datadog/webpack-plugin
tools: @dd/tools
factory: @dd/factory
core: @dd/core
types: Shared Types
sharedHelpers: Shared Helpers
sharedConstants: Shared Constants
helpers: Aggregated Helpers
atypes: Aggregated Types
aplugins: Aggregated List of Plugins
contextCreation: Creation of the Global Context
cli: Internal CLIs
internalPlugins: Internal Plugins
buildReportPlugin: @dd/internal-build-report-plugin
bundlerReportPlugin: @dd/internal-bundler-report-plugin
contextPlugin: @dd/internal-context-plugin
injectionPlugin: @dd/internal-injection-plugin
gitPlugin: @dd/internal-git-plugin
state internalPlugins {
buildReportPlugin
bundlerReportPlugin
contextPlugin
gitPlugin
injectionPlugin
}
state core {
sharedHelpers
sharedConstants
types
}
state published {
esbuildplugin
viteplugin
rollupplugin
webpackplugin
}
state productPlugins {
productPlugin
productPlugin2
}
state factory {
contextCreation
helpers
atypes
aplugins
}
state tools {
cli
}
internalPlugins --> factory
productPlugins --> factory: CONFIG_KEY<br/>helpers<br/>types<br/>getPlugins()
core --> tools
core --> factory
core --> internalPlugins
core --> productPlugins
factory --> productPlugins: Global Context
factory --> published: Unplugin Factory
published --> NPM: types<br/>helpers<br/>datadogBundlerPlugin
We have a small wizard that will help you create a new plugin. Bootstrapping all the files you'll need to start coding.
yarn cli create-plugin
Then learn more about what you can use from the ecosystem.
📝 Full testing documentation ➡️
Important
If you're modifying a behavior or adding a new feature, update/add the required tests to your PR.
We have a command to check the integrity of the files in the repository. To ensure everything is in order and follow our different compliance rules. This is also checked in the CI.
You can run this command and commit the changes if needed.
yarn cli integrity
It will:
- update all the
.md
files.- ensure each plugin has a well formated README.
- generate and update the Table of Contents delimited by
<!-- #toc -->
. - update the root README with the list of plugins and their configuration.
- update the necessary
.ts
andpackage.json
files.- with the aggregated types from the plugins.
- with the aggregated helpers from the plugins.
- with the aggregated configurations from the plugins.
- comply with our OSS rules (this can also be run with
yarn oss
).- add a header to each file.
- update the
LICENSES-3rdparty.csv
,LICENSE
,NOTICE
andREADME.md
with the correct licenses.
- update the lock files.
- auto format the codebase.
We're using eslint and prettier to lint and format the code.
It's automatically done at save time when you're using VSCode or you can run a command to do it manually:
# With autofix
yarn format
# Without autofix
yarn lint
We're also using TypeScript.
# Typecheck everything
yarn typecheck:all
# Typecheck a specific workspace
yarn workspace <workspace> typecheck
# Build everything
yarn build:all
# Build a specific workspace
yarn workspace <workspace> build
# Watch changes on everything
yarn watch:all
# Watch a specific workspace
yarn workspace <workspace> watch
Note
Typechecking and linting are also done in the pre-commit hook, to avoid pushing CI breaking code.
We follow a few rules, so we made a simple command to keep it compliant.
# Make the code compliant with our Open Source rules.
yarn oss
It will:
- update headers of each files.
- update
LICENSES-3rdparty.csv
,LICENSE
,NOTICE
andREADME.md
with the correct licenses.
It is also run part of the yarn cli integrity
CLI.
We try to keep the documentation as up to date as possible.
Important
If you're modifying a behavior or adding a new feature, update/add the required documentation to your PR.
An automatic GitHub Action will take care of publishing new releases in the latest
channel.
You can also publish a version in the alpha
channel so you can easily test your changes:
- First you need to bump the version with a marker for the channel, ex:
0.4.2-alpha
so we don't occupy a version of thelatest
channel.
# Set your alpha version locally (you may need to run it twice to circonvent a yarn bug)
yarn version:all 0.4.2-alpha
- Then publish the packages:
# First add your write token
yarn config set npmAuthToken $NPM_WRITE_TOKEN
# Publish everything to the alpha channel
yarn publish:all --tag=alpha
We have a CLI to help with some tasks.