Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source reading all lines on each change #27

Open
hariso opened this issue Dec 2, 2022 · 1 comment
Open

Source reading all lines on each change #27

hariso opened this issue Dec 2, 2022 · 1 comment
Labels
bug Something isn't working

Comments

@hariso
Copy link
Contributor

hariso commented Dec 2, 2022

Bug description

The source connector is reading all lines on each change.

Steps to reproduce

  1. Run a pipeline with the following config:
---
version: 1.0
pipelines:
  pipeline1:
    status: running
    name: pipeline1
    description: 'file source, file destination'
    connectors:
      file-source:
        type: source
        plugin: "builtin:file"
        name: file-source
        settings:
          path: /home/haris/projects/other/conduit-utils/file-source.txt
      file-destination:
        type: destination
        plugin: "builtin:file"
        name: file-destination
        settings:
          path: /home/haris/projects/other/conduit-utils/file-destination.txt
  1. Write a new line to the source file.
  2. Check the destination file

Expected behavior: Only the new line appears in the destination file.

Actual behavior: All the lines in the source file are added to the destination file.

Version

{ "version": "v0.4.0-nightly.20221201", "os": "linux", "arch": "amd64" }

@hariso hariso added the bug Something isn't working label Dec 2, 2022
@meroxa-machine meroxa-machine moved this to Triage in Conduit Main Dec 2, 2022
@hariso
Copy link
Contributor Author

hariso commented Dec 2, 2022

I was using the Sublime text editor to edit the source file. When using echo, this issue is not reproduced. It looks like Sublime is always overwriting a file when saving it.

@hariso hariso closed this as completed Dec 2, 2022
Repository owner moved this from Triage to Done in Conduit Main Dec 2, 2022
@hariso hariso reopened this Dec 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Archived in project
Development

No branches or pull requests

1 participant