Skip to content

Commit

Permalink
datacontract#213 Add delta-lake as another extra to reduce deps by 20…
Browse files Browse the repository at this point in the history
…0Mb (datacontract#242)

Co-authored-by: Robert DeRienzo <[email protected]>
  • Loading branch information
RobertLD and Robert DeRienzo authored Jun 5, 2024
1 parent 290abc4 commit 7385d8b
Show file tree
Hide file tree
Showing 3 changed files with 9 additions and 3 deletions.
2 changes: 1 addition & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

### Changed
- Introduced optional dependencies/extras for significantly faster installation times. (#213)

- Added delta-lake as an additional optional dependency

## [0.10.7] - 2024-05-31

Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -190,6 +190,7 @@ A list of available extras:
| Avro Support | `pip install datacontract-cli[avro]` |
| Google BigQuery | `pip install datacontract-cli[bigquery]` |
| Databricks Integration | `pip install datacontract-cli[databricks]` |
| Deltalake Integration | `pip install datacontract-cli[deltalake]` |
| Kafka Integration | `pip install datacontract-cli[kafka]` |
| PostgreSQL Integration | `pip install datacontract-cli[postgres]` |
| S3 Integration | `pip install datacontract-cli[s3]` |
Expand Down
9 changes: 7 additions & 2 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,6 @@ dependencies = [
"rdflib==7.0.0",
"opentelemetry-exporter-otlp-proto-grpc~=1.16",
"opentelemetry-exporter-otlp-proto-http~=1.16",
"deltalake~=0.17.0",
"boto3>=1.34.41,<1.34.114",
"botocore>=1.34.41,<1.34.114",
"jinja_partials >= 0.2.1"
Expand All @@ -48,12 +47,18 @@ bigquery = [
"soda-core-bigquery>=3.3.1,<3.4.0"
]



databricks = [
"soda-core-spark-df>=3.3.1,<3.4.0",
"databricks-sql-connector>=3.1.2,<3.2.0",
"soda-core-spark[databricks]>=3.3.1,<3.4.0"
]

deltalake = [
"deltalake~=0.17.0"
]

kafka = [
"datacontract-cli[avro]",
"soda-core-spark-df>=3.3.1,<3.4.0"
Expand All @@ -77,7 +82,7 @@ sqlserver = [
]

all = [
"datacontract-cli[kafka,bigquery,snowflake,postgres,databricks,sqlserver,s3]"
"datacontract-cli[kafka,bigquery,snowflake,postgres,databricks,sqlserver,s3,deltalake]"
]

dev = [
Expand Down

0 comments on commit 7385d8b

Please sign in to comment.