Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Upgrade ParadeDB to 0.13.1 #63

Merged
merged 32 commits into from
Dec 7, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
7dc8b30
Upgrade to 0.13.0
philippemnoel Nov 22, 2024
364c51a
Fix create index
philippemnoel Nov 25, 2024
50fd6e6
Missing versions
philippemnoel Dec 1, 2024
854e70d
Add debug logs
philippemnoel Dec 1, 2024
80b7993
Add --verbose
philippemnoel Dec 1, 2024
640c1ec
try this
philippemnoel Dec 1, 2024
da00331
print logs better
philippemnoel Dec 1, 2024
44dc0ed
Try this for deeper logs
philippemnoel Dec 2, 2024
85bf506
Fix syntax
philippemnoel Dec 2, 2024
afe9873
kind: Job
philippemnoel Dec 2, 2024
a3793ac
Proper indent
philippemnoel Dec 2, 2024
e07eaeb
Proper backup pod logs
philippemnoel Dec 2, 2024
3d695ed
Deeper logs
philippemnoel Dec 2, 2024
c51c01e
log the database pod
philippemnoel Dec 2, 2024
b0e5bf4
log podlogs of backup-checkpoint
philippemnoel Dec 2, 2024
529caae
Try using bash instead of sh
philippemnoel Dec 2, 2024
795d636
log psql erros
philippemnoel Dec 2, 2024
33275b4
Try this
philippemnoel Dec 2, 2024
16a892c
Try this
philippemnoel Dec 2, 2024
f21e15e
pod log the db itself
philippemnoel Dec 2, 2024
6a13bc8
Swap back to sh
philippemnoel Dec 2, 2024
fcb4927
Try to name them differently
philippemnoel Dec 2, 2024
3d42e31
Diff name
philippemnoel Dec 2, 2024
a4741a8
this
philippemnoel Dec 2, 2024
b25a9bc
Undo testing, name tables and indexes differently
philippemnoel Dec 2, 2024
f9f7a93
Remove excess logs
philippemnoel Dec 2, 2024
e5dd83e
Log database
philippemnoel Dec 2, 2024
5e2745d
Add more logs
philippemnoel Dec 2, 2024
004cbd6
17
philippemnoel Dec 2, 2024
5dd820a
Add missing try:
philippemnoel Dec 2, 2024
87dbbb3
Lin
philippemnoel Dec 2, 2024
35baf31
Upgrade to 0.13.1 for version without broken barman
philippemnoel Dec 7, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions charts/paradedb/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,8 @@ icon: https://raw.githubusercontent.com/paradedb/paradedb/main/docs/logo/light.s
type: application

# The Chart version, set in the publish CI workflow from GitHub Actions Variables
# We default to v0.12.2 for testing and local development
version: 0.12.2
# We default to v0.13.1 for testing and local development
version: 0.13.1

sources:
- https://github.com/paradedb/charts
Expand Down
2 changes: 1 addition & 1 deletion charts/paradedb/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -306,7 +306,7 @@ refer to the [CloudNativePG Documentation](https://cloudnative-pg.io/documentat
| recovery.secret.create | bool | `true` | Whether to create a secret for the backup credentials |
| recovery.secret.name | string | `""` | Name of the backup credentials secret |
| type | string | `"paradedb"` | Type of the CNPG database. Available types: * `paradedb` * `paradedb-enterprise` |
| version.paradedb | string | `"0.12.2"` | We default to v0.12.2 for testing and local development |
| version.paradedb | string | `"0.13.1"` | We default to v0.13.1 for testing and local development |
| version.postgresql | string | `"17"` | PostgreSQL major version to use |
| poolers[].name | string | `` | Name of the pooler resource |
| poolers[].instances | number | `1` | The number of replicas we want |
Expand Down
2 changes: 1 addition & 1 deletion charts/paradedb/examples/image-catalog-ref.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ type: postgresql
mode: standalone
version:
major: "17"
paradedb: "0.12.2"
paradedb: "0.13.1"
cluster:
instances: 1
imageCatalogRef:
Expand Down
2 changes: 1 addition & 1 deletion charts/paradedb/examples/image-catalog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ type: postgresql
mode: standalone
version:
major: "17"
paradedb: "0.12.2"
paradedb: "0.13.1"
cluster:
instances: 1
backups:
Expand Down
4 changes: 2 additions & 2 deletions charts/paradedb/examples/paradedb.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
type: paradedb
mode: standalone
version:
postgresql: "17.0"
paradedb: "0.12.2"
postgresql: "17"
paradedb: "0.13.1"
cluster:
instances: 1
backups:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ type: paradedb-enterprise
mode: standalone
version:
major: "17"
paradedb: "0.12.2"
paradedb: "0.13.1"
cluster:
instances: 1
storage:
Expand Down
18 changes: 5 additions & 13 deletions charts/paradedb/test/paradedb-enterprise/02-paradedb_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,23 +22,15 @@ spec:
psql "$DB_URI" <<-EOSQL
CALL paradedb.create_bm25_test_table(
schema_name => 'public',
table_name => 'mock_items'
);
CALL paradedb.create_bm25(
index_name => 'search_idx',
table_name => 'mock_items',
key_field => 'id',
text_fields => paradedb.field('description') || paradedb.field('category'),
numeric_fields => paradedb.field('rating'),
boolean_fields => paradedb.field('in_stock'),
datetime_fields => paradedb.field('created_at'),
json_fields => paradedb.field('metadata'),
range_fields => paradedb.field('weight_range')
table_name => 'mock_items_paradedb_enterprise'
);
CREATE INDEX search_idx_paradedb_enterprise_ ON mock_items_paradedb_enterprise
USING bm25 (id, description, category, rating, in_stock, created_at, metadata, weight_range)
WITH (key_field='id');
EOSQL
RESULT=$(psql "$DB_URI" -t) <<-EOSQL
SELECT description
FROM mock_items
FROM mock_items_paradedb_enterprise
WHERE description @@@ '"bluetooth speaker"~1'
LIMIT 1;
EOSQL
Expand Down
11 changes: 10 additions & 1 deletion charts/paradedb/test/paradedb-enterprise/chainsaw-test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -42,13 +42,22 @@ spec:
- assert:
file: 02-paradedb_test-assert.yaml
catch:
- describe:
apiVersion: v1
kind: Pod
- describe:
apiVersion: batch/v1
kind: Job
- podLogs:
selector: batch.kubernetes.io/job-name=data-test
selector: cnpg.io/cluster=paradedb-ncc-1701-d
- name: Cleanup
try:
- script:
content: |
helm uninstall --namespace $NAMESPACE paradedb-ncc-1701-d
catch:
- describe:
apiVersion: v1
kind: Pod
- podLogs:
selector: cnpg.io/cluster=paradedb-ncc-1701-d
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ type: paradedb
mode: standalone
version:
major: "17"
paradedb: "0.12.2"
paradedb: "0.13.1"
cluster:
instances: 2
storage:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,17 +22,9 @@ spec:
psql "$DB_URI" <<-EOSQL
CALL paradedb.create_bm25_test_table(
schema_name => 'public',
table_name => 'mock_items'
);
CALL paradedb.create_bm25(
index_name => 'search_idx',
table_name => 'mock_items',
key_field => 'id',
text_fields => paradedb.field('description') || paradedb.field('category'),
numeric_fields => paradedb.field('rating'),
boolean_fields => paradedb.field('in_stock'),
datetime_fields => paradedb.field('created_at'),
json_fields => paradedb.field('metadata'),
range_fields => paradedb.field('weight_range')
table_name => 'mock_items_paradedb_minio_backup_restore'
);
CREATE INDEX search_idx_paradedb_minio_backup_restore ON mock_items_paradedb_minio_backup_restore
USING bm25 (id, description, category, rating, in_stock, created_at, metadata, weight_range)
WITH (key_field='id');
EOSQL
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ spec:
apk --no-cache add postgresql-client
RESULT=$(psql "$DB_URI" -t) <<-EOSQL
SELECT description
FROM mock_items
FROM mock_items_paradedb_minio_backup_restore
WHERE description @@@ '"bluetooth speaker"~1'
LIMIT 1;
EOSQL
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -81,16 +81,40 @@ spec:
kind: Job
- podLogs:
selector: batch.kubernetes.io/job-name=data-test
- name: Create a backup
- name: Start a backup
try:
- apply:
file: ./05-backup.yaml
- assert:
file: ./05-backup_running-assert.yaml
catch:
- describe:
apiVersion: postgresql.cnpg.io/v1
kind: Backup
- podLogs:
selector: cnpg.io/cluster=paradedb
- describe:
apiVersion: postgresql.cnpg.io/v1
kind: Cluster
- podLogs:
selector: cnpg.io/cluster=paradedb-paradedb
- name: Complete a backup
try:
- apply:
file: ./05-checkpoint.yaml
- assert:
file: ./05-backup_completed-assert.yaml
catch:
- describe:
apiVersion: postgresql.cnpg.io/v1
kind: Backup
- podLogs:
selector: cnpg.io/cluster=paradedb
- describe:
apiVersion: postgresql.cnpg.io/v1
kind: Cluster
- podLogs:
selector: cnpg.io/cluster=paradedb-paradedb
- name: Write more data to the database after the backup
try:
- apply:
Expand Down
4 changes: 2 additions & 2 deletions charts/paradedb/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,8 +13,8 @@ version:
# -- PostgreSQL major version to use
postgresql: "17"
# -- The ParadeDB version, set in the publish CI workflow from the latest paradedb/paradedb GitHub tag
# -- We default to v0.12.2 for testing and local development
paradedb: "0.12.2"
# -- We default to v0.13.1 for testing and local development
paradedb: "0.13.1"

###
# -- Cluster mode of operation. Available modes:
Expand Down
Loading