Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: Code completions #1476

Open
wants to merge 63 commits into
base: main
Choose a base branch
from
Open

FEAT: Code completions #1476

wants to merge 63 commits into from

Commits on May 9, 2024

  1. add the types for code completions

    @mikeshi80
    mikeshi80 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    4dd5159 View commit details
    Browse the repository at this point in the history

  2. add prompt style definition for code completions.

    @mikeshi80
    mikeshi80 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    2d893b3 View commit details
    Browse the repository at this point in the history

  3. add code completion mixin.

    @mikeshi80
    mikeshi80 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    81a77cb View commit details
    Browse the repository at this point in the history

  4. refactor the code prompt style and add the unit test for code prompt … 

    …style check.
    @mikeshi80
    mikeshi80 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    b3c0e3a View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 10, 2024
    Configuration menu
    Copy the full SHA
    30676f0 View commit details
    Browse the repository at this point in the history

  2. correct path to name function to work on windows file system. Add som… 

    …e unit test cases.
    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    ec8c815 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 10, 2024
    Configuration menu
    Copy the full SHA
    985a4d7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'code_completions' of github.com:mikeshi80/xinference in… 

    …to code_completions

merge with main
    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    fa81cf8 View commit details
    Browse the repository at this point in the history

  5. make the code completion process works

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    38200a3 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/model/llm/__init__.py
    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    3f1a160 View commit details
    Browse the repository at this point in the history

  7. add vllm inference engine support for deepseek-coder-base code model.

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    e352804 View commit details
    Browse the repository at this point in the history

  8. Show code icon for code models in model cards.

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    2093b65 View commit details
    Browse the repository at this point in the history

  9. add client test for code completions.

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f353d35 View commit details
    Browse the repository at this point in the history

  10. check whether the code_prompt_style is None.

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    0e449e0 View commit details
    Browse the repository at this point in the history

  11. format the code by prettier.

    @mikeshi80
    mikeshi80 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    4bbbb15 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2024

  1. add the function to generate prompt for code completion.

    @mikeshi80
    mikeshi80 committed May 11, 2024
    Configuration menu
    Copy the full SHA
    62c8dd9 View commit details
    Browse the repository at this point in the history

  2. fix the bug that cannot get generated prompt correctly.

    @mikeshi80
    mikeshi80 committed May 11, 2024
    Configuration menu
    Copy the full SHA
    d388303 View commit details
    Browse the repository at this point in the history

  3. fix the bug that cannot get generated prompt correctly.

    @mikeshi80
    mikeshi80 committed May 11, 2024
    Configuration menu
    Copy the full SHA
    51390bd View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. adjust the test result to make unit test pass.

    @mikeshi80
    mikeshi80 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    ec28dec View commit details
    Browse the repository at this point in the history

  2. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 13, 2024
    Configuration menu
    Copy the full SHA
    16db4a7 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/code_completions' into code_comp… 

    …letions
    @mikeshi80
    mikeshi80 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    3a0840c View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. basically finished code generating web client. 

    Need to add repo_name support.
    @mikeshi80
    mikeshi80 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    10d90b0 View commit details
    Browse the repository at this point in the history

  2. added the repo_name and file_path for prompt file support, and add th… 

    …e definition for codeqwen1.5 and make it supported by vllm engine.
    @mikeshi80
    mikeshi80 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    6215454 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 14, 2024
    Configuration menu
    Copy the full SHA
    5819674 View commit details
    Browse the repository at this point in the history

  4. ignore the codespell since there are a lot of file extensions that ar… 

    …e misspelled.
    @mikeshi80
    mikeshi80 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    514e862 View commit details
    Browse the repository at this point in the history

  5. format ui code by prettier.

    @mikeshi80
    mikeshi80 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    2a091aa View commit details
    Browse the repository at this point in the history

  6. fix the get_code_prompt missing parameter.

    @mikeshi80
    mikeshi80 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    c0925e5 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 16, 2024
    Configuration menu
    Copy the full SHA
    e518e74 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/core/model.py
#	xinference/model/llm/ggml/llamacpp.py
    @mikeshi80
    mikeshi80 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    be8a862 View commit details
    Browse the repository at this point in the history

  2. adapt to langchain 0.2.x, which has breaking changes 

    langchain-community need to be installed separately.
    @mikeshi80
    mikeshi80 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    f7d02fb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'refs/heads/adapt-to-langchain-0.2.x' into code_completions

    @mikeshi80
    mikeshi80 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    85f52d7 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 23, 2024
    Configuration menu
    Copy the full SHA
    6c42c71 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. add base suffix for codeqwen1.5 to diff with the official generate model

    @mikeshi80
    mikeshi80 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    12dc09a View commit details
    Browse the repository at this point in the history

  2. add vllm support for codeqwen1.5-base

    @mikeshi80
    mikeshi80 committed May 24, 2024
    Configuration menu
    Copy the full SHA
    4dbd3bb View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. merge llm_family definition.

    @mikeshi80
    mikeshi80 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    02f7536 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored May 28, 2024
    Configuration menu
    Copy the full SHA
    5e3e749 View commit details
    Browse the repository at this point in the history

  3. modified the model names to use latest model name in definition.

    @mikeshi80
    mikeshi80 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    ecbf893 View commit details
    Browse the repository at this point in the history

  4. modified the model names to use latest model name in definition.

    @mikeshi80
    mikeshi80 committed May 28, 2024
    Configuration menu
    Copy the full SHA
    71843c1 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2024

  1. merge with main

    @mikeshi80
    mikeshi80 committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    aa9d4bd View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored Jun 13, 2024
    Configuration menu
    Copy the full SHA
    72fd615 View commit details
    Browse the repository at this point in the history

  2. add model_hub for model definition in llm_family_modelscope.json.

    @mikeshi80
    mikeshi80 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    d8e0259 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. merge with main

    @mikeshi80
    mikeshi80 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e731632 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8b4abab View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/model/llm/ggml/llamacpp.py
#	xinference/model/llm/pytorch/core.py
#	xinference/model/llm/vllm/core.py
    @mikeshi80
    mikeshi80 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    b931d9d View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    4f2f8c0 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/client/restful/restful_client.py
#	xinference/core/tests/test_restful_api.py
    @mikeshi80
    mikeshi80 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    df53445 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/model/llm/__init__.py
#	xinference/model/llm/pytorch/core.py
#	xinference/web/ui/src/scenes/running_models/index.js
    @mikeshi80
    mikeshi80 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    bff135b View commit details
    Browse the repository at this point in the history

  2. add the missing import module

    @mikeshi80
    mikeshi80 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    06ead5b View commit details
    Browse the repository at this point in the history

  3. format the frontend code.

    @mikeshi80
    mikeshi80 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    1901603 View commit details
    Browse the repository at this point in the history

  4. fix the wrong usage of fetchWrapper

    @mikeshi80
    mikeshi80 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    b71e3b6 View commit details
    Browse the repository at this point in the history

  5. fix wrong code_prompts get logic

    @mikeshi80
    mikeshi80 committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3869b30 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Merge branch 'refs/heads/main' into code_completions 

    # Conflicts:
#	xinference/core/model.py
#	xinference/model/llm/__init__.py
#	xinference/web/ui/src/scenes/running_models/index.js
    @mikeshi80
    mikeshi80 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    810eff3 View commit details
    Browse the repository at this point in the history

  2. format the frontend code

    @mikeshi80
    mikeshi80 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    efa6c47 View commit details
    Browse the repository at this point in the history

  3. to use the right call wrapper method.

    @mikeshi80
    mikeshi80 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    7ae7c77 View commit details
    Browse the repository at this point in the history

  4. to use the right call wrapper method, again

    @mikeshi80
    mikeshi80 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    533fcfc View commit details
    Browse the repository at this point in the history

  5. reversed code to use parse_obj

    @mikeshi80
    mikeshi80 committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    aa724ac View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored Jul 31, 2024
    Configuration menu
    Copy the full SHA
    569aa23 View commit details
    Browse the repository at this point in the history

  2. remove vllm disable setting check.

    @mikeshi80
    mikeshi80 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    5a31312 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Merge branch 'xorbitsai:main' into code_completions

    @mikeshi80
    mikeshi80 authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    28e7e3f View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. merge with main branch

    @mikeshi80
    mikeshi80 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    9d5930a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/code_completions' into code_comp… 

    …letions
    @mikeshi80
    mikeshi80 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    0ad126a View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2024

  1. change the format of starcoder from gglmv3 to ggufv2

    @mikeshi80
    mikeshi80 committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    c6948ca View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into code_completions 

    # Conflicts:
#	xinference/model/llm/__init__.py
    @mikeshi80
    mikeshi80 committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    80a9d99 View commit details
    Browse the repository at this point in the history