Skip to content

Commit

Permalink
Create Redshift (#1194)
Browse files Browse the repository at this point in the history
* Create amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Update amazon-redshift.md

* Create google-drive.md

* Update google-drive.md

* Update google-drive.md
  • Loading branch information
Luke-Potgieter authored Sep 22, 2023
1 parent fb0e33d commit 7513a2f
Show file tree
Hide file tree
Showing 2 changed files with 112 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
# Amazon Redshift

This connector captures data from your Amazon Redshift cluster into Flow collections.

[`ghcr.io/estuary/source-redshift:dev`](https://ghcr.io/estuary/source-redshift:dev) provides the latest connector image. You can access past image versions by following the link in your browser.

## Prerequisites

To use this connector, you'll need:

- Access credentials for connecting to your Amazon Redshift cluster.
- Properly configured IAM roles for the necessary permissions.

## Configuration

You can configure the Redshift source connector either through the Flow web app or by directly editing the Flow specification file. For more information on using this connector, see our guide on [connectors](https://docs.estuary.dev/concepts/connectors/#using-connectors). The values and specification sample below provide configuration details that are specific to the Amazon Redshift source connector.

### Properties

#### Endpoint

| Property | Title | Description | Type | Required/Default |
|-----------------|---------------|--------------------------------------------------------------|---------|------------------------|
| **`/host`** | Host | Hostname or IP address of your Redshift cluster. | string | Required |
| **`/port`** | Port | Port number for the cluster. | integer | Default |
| **`/database`** | Database Name | Name of the database to capture data from. | string | Required |
| **`/user`** | User | Database user with necessary permissions. | string | Required |
| **`/password`** | Password | Password for the specified database user. | string | Required |
| **`/schemas`** | Schemas | List of schemas to include. | string | |
| **`/jdbc_params`** | JDBC URL Params | Additional properties to pass to the JDBC URL string when connecting to the database formatted as 'key=value' pairs. | string | |


#### Bindings

| Property | Title | Description | Type | Required/Default |
| ----------------- | ---------- | ------------------------------ | ------- | ---------------------- |
| **`/table`** | Table Name | Name of the table to capture. | string | Required |
| **`/cursor_field`** | User-defined Cursor | Field for incremental syncs. Uses ascending values to ensure queries are sequential. | string or integer | Required |

### Sample

```yaml
captures:
${PREFIX}/${CAPTURE_NAME}:
endpoint:
connector:
image: ghcr.io/estuary/source-redshift:dev
config:
host: "example-redshift-cluster.us-east-2.redshift.amazonaws.com"
port: 5439
database: "sample_db"
user: "sample_user"
password: "sample_password"
schemas: "public"
jdbc_params: "key1=value1&key2=value2&key3=value3"
bindings:
- resource:
table: users
cursor_field: cursor
target: ${PREFIX}/users
```
51 changes: 51 additions & 0 deletions site/docs/reference/Connectors/capture-connectors/google-drive.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
# Google Drive

This connector lets you capture data from your Google Drive account into Flow collections.

[ghcr.io/estuary/source-google-drive:dev](https://ghcr.io/estuary/source-google-drive:dev) provides the latest connector image. For access to previous image versions, follow the link in your browser.

## Prerequisites

To use this connector, make sure you have the following:

- An active Google Drive account with access credentials.
- Properly configured permissions for your Google Drive resources.

**Note:** This connector is designed specifically for .csv files located in a specified Google Drive folder.

## Configuration

You can set up the Google Drive source connector either through the Flow web app or by editing the Flow specification file directly. For more information on setting up this connector, refer to our guide on using [connectors](https://docs.estuary.dev/concepts/connectors/#using-connectors).

The values and specification sample below provide configuration details specific to the Google Drive connector.

### Properties

#### Endpoint

| Property | Title | Description | Type | Required/Default |
|--------------------|----------------|--------------------------------------------------------------------|--------|-------------------|
| **`/credentials`** | Credentials | JSON file containing authentication credentials for Google Drive. | file | Required |

### Bindings

| Property | Title | Description | Type | Required/Default |
|----------------|-------------|--------------------------------------|---------|-------------------|
| **`/file_id`** | File ID | Unique identifier of the Google Drive file. | string | Required |
| **`/path`** | Path | Path to the file or directory in Google Drive. | string | Required |

### Sample

```yaml
captures:
${PREFIX}/${CAPTURE_NAME}:
endpoint:
connector:
image: ghcr.io/estuary/source-google-drive:dev
config:
credentials: /path/to/your/credentials.json
bindings:
- resource:
file_id: "your_google_drive_file_id"
path: "/path/in/google/drive"
target: ${PREFIX}/target_name

0 comments on commit 7513a2f

Please sign in to comment.