Skip to content

Commit

Permalink
"Created by snbot"
Browse files Browse the repository at this point in the history
  • Loading branch information
streamnativebot committed Jun 10, 2022
1 parent 7f7e8f1 commit c75380c
Show file tree
Hide file tree
Showing 3 changed files with 16 additions and 16 deletions.
18 changes: 9 additions & 9 deletions docs/lakehouse-sink.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ To build the Lakehouse sink connector from the source code, follow these steps.

```bash
ls target
pulsar-io-lakehouse-{{connector:version}}.nar
pulsar-io-lakehouse-2.9.2.20.nar
```

# How to configure
Expand Down Expand Up @@ -133,7 +133,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-hudi-pulsar"
],
"archive": "connectors/pulsar-io-hudi-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-hudi-2.9.2.20.nar",
"parallelism": 1,
"configs": {
"type": "hudi",
Expand All @@ -156,7 +156,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-hudi-pulsar"
],
"archive": "connectors/pulsar-io-hudi-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-hudi-2.9.2.20.nar",
"parallelism": 1,
"configs": {
"type": "hudi",
Expand Down Expand Up @@ -185,7 +185,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-iceberg-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"iceberg",
Expand Down Expand Up @@ -213,7 +213,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-iceberg-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"iceberg",
Expand Down Expand Up @@ -246,7 +246,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-delta-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"delta",
Expand All @@ -268,7 +268,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-delta-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"delta",
Expand Down Expand Up @@ -339,7 +339,7 @@ This example describes how to use the Lakehouse sink connector to fetch data fro
1. Copy the NAR package to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-2.9.2.20.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-2.9.2.20.nar
```
2. Start Pulsar in standalone mode.
Expand Down Expand Up @@ -372,7 +372,7 @@ This example explains how to create a Lakehouse sink connector in an on-premises
1. Copy the NAR package of the Lakehouse sink connector to the Pulsar connectors directory.
```bash
cp pulsar-io-lakehouse-{{connector:version}}.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-2.9.2.20.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-2.9.2.20.nar
```
2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/).
Expand Down
10 changes: 5 additions & 5 deletions docs/lakehouse-source.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ To build the Lakehouse source connector from the source code, follow these steps

```bash
ls target
pulsar-io-lakehouse-{{connector:version}}.nar
pulsar-io-lakehouse-2.9.2.20.nar
```

# How to configure
Expand Down Expand Up @@ -92,7 +92,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"parallelism":1,
"topicName": "delta_source",
"processingGuarantees":"ATLEAST_ONCE",
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"configs":{
"type":"delta",
"checkpointInterval": 180,
Expand All @@ -117,7 +117,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"parallelism":1,
"topicName": "delta_source",
"processingGuarantees":"ATLEAST_ONCE",
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-2.9.2.20.nar",
"configs":{
"type":"delta",
"checkpointInterval": 180,
Expand Down Expand Up @@ -178,7 +178,7 @@ This example describes how to use the Lakehouse source connector to fetch data f
1. Copy the NAR package to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-2.9.2.20.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-2.9.2.20.nar
```
2. Start Pulsar in standalone mode.
Expand Down Expand Up @@ -209,7 +209,7 @@ This example explains how to create a Lakehouse source connector in an on-premis
1. Copy the NAR package of the Lakehouse source connector to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-2.9.2.20.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-2.9.2.20.nar
```
2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/).
Expand Down
4 changes: 2 additions & 2 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@

<groupId>org.apache.pulsar.ecosystem</groupId>
<artifactId>pulsar-io-lakehouse</artifactId>
<version>2.9.2</version>
<version>2.9.2.20</version>
<name>Pulsar Ecosystem :: IO Connector :: Lake House</name>
<description>It is a lakehouse connector streaming convert data between lakehouse and Apache Pulsar.</description>

Expand All @@ -49,7 +49,7 @@
<!-- connector dependencies -->
<jackson.version>2.13.2.1</jackson.version>
<lombok.version>1.18.22</lombok.version>
<pulsar.version>2.9.2.17</pulsar.version>
<pulsar.version>2.9.2.20</pulsar.version>
<log4j2.version>2.17.2</log4j2.version>
<slf4j.version>1.7.25</slf4j.version>
<hadoop.version>3.2.2</hadoop.version>
Expand Down

0 comments on commit c75380c

Please sign in to comment.