This repository provides end-to-end examples and a suite of Terraform modules for Google Cloud, which support different use cases:
- starter kits used to bootstrap real-world cloud foundations, and reference examples used to deep dive on network patterns or product features
- composable modules that support quick prototyping and testing
- a comprehensive source of lean modules that lend themselves well to changes
The whole repository is meant to be cloned as a single unit, and then forked into separate owned repositories to seed production usage, or used as-is and periodically updated as a complete toolkit for prototyping. You can read more on this approach in our manifesto.
Both the examples and modules require some measure of Terraform skills to be used effectively. If you are looking for a feature-rich black box to manage project or product creation with minimal specific skills, you might be better served by the Cloud Foundation Toolkit suite of modules.
The examples in this repository are split in several main sections: foundational examples that bootstrap the organizational hierarchy and automation prerequisites, networking examples that implement core patterns or features, data solutions examples that demonstrate how to integrate data services in complete scenarios, and cloud operations examples that leverage specific products to meet specific operational needs.
Currently available examples:
- foundations - single level hierarchy (environments), multiple level hierarchy (business units + environments)
- networking - hub and spoke via peering, hub and spoke via VPN, DNS and Google Private Access for on-premises, Shared VPC with GKE support, ILB as next hop, PSC for on-premises Cloud Function invocation, decentralized firewall
- data solutions - GCE/GCS CMEK via centralized Cloud KMS, Cloud Storage to Bigquery with Cloud Dataflow
- cloud operations - Resource tracking and remediation via Cloud Asset feeds, Granular Cloud DNS IAM via Service Directory, Granular Cloud DNS IAM for Shared VPC, Compute Engine quota monitoring, Scheduled Cloud Asset Inventory Export to Bigquery
- third party solutions - OpenShift cluster on Shared VPC
For more information see the README files in the foundations, networking, data solutions and cloud operations folders.
The suite of modules in this repository are designed for rapid composition and reuse, and to be reasonably simple and readable so that they can be forked and changed where use of third party code and sources is not allowed.
All modules share a similar interface where each module tries to stay close to the underlying provider resources, support IAM together with resource creation and modification, offer the option of creating multiple resources where it makes sense (eg not for projects), and be completely free of side-effects (eg no external commands).
The current list of modules supports most of the core foundational and networking components used to design end-to-end infrastructure, with more modules in active development for specialized compute, security, and data scenarios.
Currently available modules:
- foundational - folder, organization, project, service accounts
- networking - VPC, VPC firewall, VPC peering, VPN static, VPN dynamic, VPN HA, NAT, address reservation, DNS, L4 ILB, Service Directory, Cloud Endpoints
- compute - VM/VM group, MIG, GKE cluster, GKE nodepool, COS container (coredns, mysql, onprem, squid)
- data - GCS, BigQuery dataset, Pub/Sub, Datafusion, Bigtable instance
- development - Cloud Source Repository, Container Registry, Artifact Registry
- security - KMS, SecretManager, VPC Service Control
- serverless - Cloud Functions
For more information and usage examples see each module's README file.