Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Spark] Support external DSV2 catalog in RESTORE & Vacuum command #2036

Closed
wants to merge 19 commits into from
Closed

[Spark] Support external DSV2 catalog in RESTORE & Vacuum command #2036

wants to merge 19 commits into from

Commits on Sep 7, 2023

  1. workable version

    @gengliangwang
    gengliangwang committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    d1c8379 View commit details
    Browse the repository at this point in the history

  2. fix temp view

    @gengliangwang
    gengliangwang committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    013f964 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. add CustomCatalogSuite.scala

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    90b616b View commit details
    Browse the repository at this point in the history

  2. move resolveCatalogAndIdentifier to DeltaTableUtils

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    be93ff5 View commit details
    Browse the repository at this point in the history

  3. fix style

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    32e66aa View commit details
    Browse the repository at this point in the history

  4. fix style in DeltaTable.scala

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    01e7d79 View commit details
    Browse the repository at this point in the history

  5. remove unnecessary changes; add one comment

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    c0baf09 View commit details
    Browse the repository at this point in the history

  6. save for now

    @gengliangwang
    gengliangwang committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    4a24cdf View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. workable version

    @gengliangwang
    gengliangwang committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    7e2c602 View commit details
    Browse the repository at this point in the history

  2. add end-to-end test case

    @gengliangwang
    gengliangwang committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    75d9198 View commit details
    Browse the repository at this point in the history

  3. add new parser test case

    @gengliangwang
    gengliangwang committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    6cb5c24 View commit details
    Browse the repository at this point in the history

  4. remove unnecessary code

    @gengliangwang
    gengliangwang committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    aa886d4 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. fix test failures

    @gengliangwang
    gengliangwang committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    76791c5 View commit details
    Browse the repository at this point in the history

  2. move resolution to a new rule

    @gengliangwang
    gengliangwang committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    1f62cac View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. avoid calling loadTable twice

    @gengliangwang
    gengliangwang committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    16688f8 View commit details
    Browse the repository at this point in the history

  2. use Spark analyzer rule to resolve relation

    @gengliangwang
    gengliangwang committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    2134121 View commit details
    Browse the repository at this point in the history

  3. error message for restoring a view

    @gengliangwang
    gengliangwang committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    e513a4f View commit details
    Browse the repository at this point in the history

  4. fix test failure

    @gengliangwang
    gengliangwang committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    f81cfd6 View commit details
    Browse the repository at this point in the history

  5. Update spark/src/main/scala/org/apache/spark/sql/delta/ResolveDeltaId… 

    …entifier.scala

Co-authored-by: Ryan Johnson <[email protected]>
    @gengliangwang @ryan-johnson-databricks
    gengliangwang and ryan-johnson-databricks authored Sep 11, 2023
    Configuration menu
    Copy the full SHA
    240cb1b View commit details
    Browse the repository at this point in the history