-
Notifications
You must be signed in to change notification settings - Fork 59
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* Create amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Update amazon-redshift.md * Create google-drive.md * Update google-drive.md * Update google-drive.md
- Loading branch information
1 parent
fb0e33d
commit 7513a2f
Showing
2 changed files
with
112 additions
and
0 deletions.
There are no files selected for viewing
61 changes: 61 additions & 0 deletions
61
site/docs/reference/Connectors/capture-connectors/amazon-redshift.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,61 @@ | ||
# Amazon Redshift | ||
|
||
This connector captures data from your Amazon Redshift cluster into Flow collections. | ||
|
||
[`ghcr.io/estuary/source-redshift:dev`](https://ghcr.io/estuary/source-redshift:dev) provides the latest connector image. You can access past image versions by following the link in your browser. | ||
|
||
## Prerequisites | ||
|
||
To use this connector, you'll need: | ||
|
||
- Access credentials for connecting to your Amazon Redshift cluster. | ||
- Properly configured IAM roles for the necessary permissions. | ||
|
||
## Configuration | ||
|
||
You can configure the Redshift source connector either through the Flow web app or by directly editing the Flow specification file. For more information on using this connector, see our guide on [connectors](https://docs.estuary.dev/concepts/connectors/#using-connectors). The values and specification sample below provide configuration details that are specific to the Amazon Redshift source connector. | ||
|
||
### Properties | ||
|
||
#### Endpoint | ||
|
||
| Property | Title | Description | Type | Required/Default | | ||
|-----------------|---------------|--------------------------------------------------------------|---------|------------------------| | ||
| **`/host`** | Host | Hostname or IP address of your Redshift cluster. | string | Required | | ||
| **`/port`** | Port | Port number for the cluster. | integer | Default | | ||
| **`/database`** | Database Name | Name of the database to capture data from. | string | Required | | ||
| **`/user`** | User | Database user with necessary permissions. | string | Required | | ||
| **`/password`** | Password | Password for the specified database user. | string | Required | | ||
| **`/schemas`** | Schemas | List of schemas to include. | string | | | ||
| **`/jdbc_params`** | JDBC URL Params | Additional properties to pass to the JDBC URL string when connecting to the database formatted as 'key=value' pairs. | string | | | ||
|
||
|
||
#### Bindings | ||
|
||
| Property | Title | Description | Type | Required/Default | | ||
| ----------------- | ---------- | ------------------------------ | ------- | ---------------------- | | ||
| **`/table`** | Table Name | Name of the table to capture. | string | Required | | ||
| **`/cursor_field`** | User-defined Cursor | Field for incremental syncs. Uses ascending values to ensure queries are sequential. | string or integer | Required | | ||
|
||
### Sample | ||
|
||
```yaml | ||
captures: | ||
${PREFIX}/${CAPTURE_NAME}: | ||
endpoint: | ||
connector: | ||
image: ghcr.io/estuary/source-redshift:dev | ||
config: | ||
host: "example-redshift-cluster.us-east-2.redshift.amazonaws.com" | ||
port: 5439 | ||
database: "sample_db" | ||
user: "sample_user" | ||
password: "sample_password" | ||
schemas: "public" | ||
jdbc_params: "key1=value1&key2=value2&key3=value3" | ||
bindings: | ||
- resource: | ||
table: users | ||
cursor_field: cursor | ||
target: ${PREFIX}/users | ||
``` |
51 changes: 51 additions & 0 deletions
51
site/docs/reference/Connectors/capture-connectors/google-drive.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,51 @@ | ||
# Google Drive | ||
|
||
This connector lets you capture data from your Google Drive account into Flow collections. | ||
|
||
[ghcr.io/estuary/source-google-drive:dev](https://ghcr.io/estuary/source-google-drive:dev) provides the latest connector image. For access to previous image versions, follow the link in your browser. | ||
|
||
## Prerequisites | ||
|
||
To use this connector, make sure you have the following: | ||
|
||
- An active Google Drive account with access credentials. | ||
- Properly configured permissions for your Google Drive resources. | ||
|
||
**Note:** This connector is designed specifically for .csv files located in a specified Google Drive folder. | ||
|
||
## Configuration | ||
|
||
You can set up the Google Drive source connector either through the Flow web app or by editing the Flow specification file directly. For more information on setting up this connector, refer to our guide on using [connectors](https://docs.estuary.dev/concepts/connectors/#using-connectors). | ||
|
||
The values and specification sample below provide configuration details specific to the Google Drive connector. | ||
|
||
### Properties | ||
|
||
#### Endpoint | ||
|
||
| Property | Title | Description | Type | Required/Default | | ||
|--------------------|----------------|--------------------------------------------------------------------|--------|-------------------| | ||
| **`/credentials`** | Credentials | JSON file containing authentication credentials for Google Drive. | file | Required | | ||
|
||
### Bindings | ||
|
||
| Property | Title | Description | Type | Required/Default | | ||
|----------------|-------------|--------------------------------------|---------|-------------------| | ||
| **`/file_id`** | File ID | Unique identifier of the Google Drive file. | string | Required | | ||
| **`/path`** | Path | Path to the file or directory in Google Drive. | string | Required | | ||
|
||
### Sample | ||
|
||
```yaml | ||
captures: | ||
${PREFIX}/${CAPTURE_NAME}: | ||
endpoint: | ||
connector: | ||
image: ghcr.io/estuary/source-google-drive:dev | ||
config: | ||
credentials: /path/to/your/credentials.json | ||
bindings: | ||
- resource: | ||
file_id: "your_google_drive_file_id" | ||
path: "/path/in/google/drive" | ||
target: ${PREFIX}/target_name |