Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

simd-doc, gazette, avro, and dekaf crates #1448

Merged
merged 10 commits into from
May 3, 2024
+139,304 −535
Merged

simd-doc, gazette, avro, and dekaf crates #1448

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
9d124f3
proto-gazette: switch content from Vec<u8> => bytes::Bytes
jgraettinger Jan 19, 2024
846581e
simd-doc: very fast JSON parsing
jgraettinger Mar 9, 2024
53115cc
gazette: new Stream-oriented client
jgraettinger Mar 9, 2024
605f5bf
crates/parser: switch from avro_rs => apache_avro
jgraettinger Apr 12, 2024
ac851cb
avro: crate for JSON schema mapping and encoding into Avro
jgraettinger Apr 12, 2024
959b4fa
dekaf: crate and binary for Kafka-compatible read gateway
jgraettinger Apr 12, 2024
ce92ec5
switch runtime over to simd-doc for faster JSON parsing
jgraettinger Apr 19, 2024
0c5de81
Cargo.toml: various updates for `dekaf` and `simd-doc` work
jgraettinger Apr 12, 2024
c7c2dea
insta::assert_display_snapshot() => insta::assert_snapshot()
jgraettinger Apr 12, 2024
305d8e0
.github/workflows: use macos-14 (latest appears to resolve to 12)
jgraettinger Apr 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 3 additions & 7 deletions .github/workflows/flowctl-release.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,16 +23,12 @@ jobs:
assetName: flowctl-x86_64-linux
# On mac, it's the opposite. Programs built on the latest macos can run on older versions,
# but not the other way around.
- os: macos-latest
- os: macos-14
assetName: flowctl-multiarch-macos
steps:
- name: Checkout code
uses: actions/checkout@v2
- uses: dtolnay/rust-toolchain@stable
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}

# Linux build steps:
- name: Build Linux
Expand All @@ -42,7 +38,7 @@ jobs:

# Mac build steps:
- name: Setup mac signing certificate
if: matrix.config.os == 'macos-latest'
if: matrix.config.os == 'macos-14'
env:
MAC_SIGNING_CERTIFICATE_BASE64: ${{ secrets.MAC_SIGNING_CERTIFICATE_BASE64 }}
MAC_CERTIFICATE_PASSWORD: ${{ secrets.MAC_CERTIFICATE_PASSWORD }}
Expand Down Expand Up @@ -72,7 +68,7 @@ jobs:

# This one mac build runs on both intel and m1 macs
- name: Build Mac
if: matrix.config.os == 'macos-latest'
if: matrix.config.os == 'macos-14'
env:
MAC_CERTIFICATE_IDENTITY: ${{ secrets.MAC_CERTIFICATE_IDENTITY }}
# The toolchain action always gives you the default target, but we always need both
Expand Down
9 changes: 3 additions & 6 deletions .github/workflows/flowctl-test.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,9 @@ name: Flowctl Tests on macos
on:
push:
paths:
- "crates/flowctl/**"
- ".github/workflows/flowctl-test.yaml"
- "Cargo.lock"
- "crates/flowctl/**"

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
Expand All @@ -15,14 +16,10 @@ concurrency:
jobs:
test:
name: Test flowctl on macos
runs-on: macos-latest
runs-on: macos-14
steps:
- name: Checkout code
uses: actions/checkout@v2
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
- uses: dtolnay/rust-toolchain@stable
- name: Run tests
run: cargo test -p flowctl
Loading
Loading