Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blank prompt hallucinates code #50

Open
leah-gall opened this issue Apr 9, 2024 · 1 comment
Open

Blank prompt hallucinates code #50

leah-gall opened this issue Apr 9, 2024 · 1 comment
Labels
bug Something isn't working ui

Comments

@leah-gall
Copy link

Describe the bug
If only whitespace is selected the "Add comments" and "Explain" options appear, and clicking them returns a hallucination.

To Reproduce
Steps to reproduce the behavior:

  1. Select some whitespace
  2. Click on "Explain"
  3. See the explanation which describes nonexistent SAS code
  4. Click on "Add comments"
  5. See generated SAS code and comments

Expected behavior
This should return an error or at least not return completely fabricated code or explanations.

Screenshots
image

Desktop (please complete the following information):

  • OS: PC
  • Version: 0.0.3

Reporter's Organization
HLS R&D

Additional context
This seems to happen regardless of whether include context is on. Each generation seems to have nothing to do with previous output, and the code generated by "Add comments" usually has syntax errors

@leah-gall leah-gall added the bug Something isn't working label Apr 9, 2024
@ouhanyou ouhanyou added the ui label Apr 10, 2024
@ouhanyou ouhanyou assigned ouhanyou and unassigned 2TomLi Apr 10, 2024
@ouhanyou
Copy link
Collaborator

To partially "fix" it from the frontend, I will hide the Code Lens if only blank text is highlighted so that the issue is less exposed.
Code Lens: image

Users are still able to execute these commands via the context menu and command palette, so I think this issue still needs to be addressed on the backend. I'm keeping this issue open and removing the ui label.

@ouhanyou ouhanyou removed the ui label Apr 11, 2024
@ouhanyou ouhanyou removed their assignment Apr 11, 2024
@dahils dahils added the ui label May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working ui
Projects
None yet
Development

No branches or pull requests

4 participants