Tsurugi 1.0.0-BETA5 - Release Notes (en)

[akirakw]

1.0.0-BETA5 Release Notes

Overview

New SQL Compiler (Mizugaki Compiler)

In this version, we have introduced a new SQL compiler called Mizugaki Compiler, which will serve as the foundation for future SQL feature enhancements in Tsurugi. The introduction of Mizugaki Compiler has resulted in numerous bug fixes, constraint resolutions, and improvements in stability and performance related to SQL processing. Additionally, it supports several SQL feature extensions. Although this version primarily focuses on the transition to the new compiler, we have plans to further expand the SQL capabilities based on Mizugaki Compiler in the future.

Due to some incompatible changes made to the previous SQL compiler (Shakujo Compiler), there is a possibility of impact on existing SQL queries. For detailed information regarding compatibility, please refer to the following document:

• Breaking Changes in BETA5 (en)

For the SQL specifications based on Mizugaki Compiler in Tsurugi, please refer to the following document:

• Available SQL features in Tsurugi

Other Highlights

In this version, we have made the following feature additions to various CLI tools provided by Tsurugi:

• Added session management functionality (tgctl session) to the server management command tgctl. With session management, you can now view a list of sessions, check detailed statuses, and forcefully terminate sessions.
• Added a compaction tool (tglogutil-compaction) for transaction logs, allowing compression of transaction logs during server shutdown. We plan to provide transaction log compression functionality while the server is running in future versions.
• Added functionality to customize prompts and output content in the SQL console (tgsql).

Furthermore, starting from this version, Tsurugi provides experimental support for execution on Ubuntu 24.04 and building with GCC 13. We are also offering a Docker image based on Ubuntu 24.04 for experimental purposes.

Feature Additions and Improvements

• SQL
  • Overall stability improvement and performance enhancement due to the introduction of Mizugaki Compiler, along with added support for SQL syntax.
    • https://github.com/project-tsurugi/tsurugidb/blob/master/docs/sql-features.md
  • Added support for HAVING clause.
  • Added support for combining GROUP BY and ORDER BY clauses.
    • Added support for combining DISTINCT and ORDER BY clauses.
  • Limited support for LIMIT clause (experimental).
    • In this version, only LIMIT clause combined with ORDER BY is supported.
    • There are some unresolved issues regarding other behaviors that differ from the specifications.
  • Added support for multi-row INSERT.
  • Supported table_name.* syntax.
  • Supported decimal literals.
  • Supported delimited identifiers with double quotes.
• Tools
  • tgctl session: Added session management functionality to the tgctl command.
    • https://github.com/project-tsurugi/tateyama/blob/master/docs/session-control-cli.md
  • tglogutil-compaction: Added a transaction log compaction tool.
    • https://github.com/project-tsurugi/limestone/blob/master/docs/tglogutil-compaction-man.md
  • tgsql: Added functionality to customize prompts.
    • https://github.com/project-tsurugi/tanzawa/blob/master/modules/tgsql/docs/prompt.md
  • tgsql: Added functionality to customize output content.
    • https://github.com/project-tsurugi/tanzawa/blob/master/modules/tgsql/docs/client-variable.md
• Server Configurations (New options available in the configuration file tsurugi.ini)
  • https://github.com/project-tsurugi/tateyama/blob/master/docs/config-parameters-en.md
  • stream_endpoint.enabled
    • Enable or disable the stream endpoint when starting TsurugiDB. The default is true (enabled).
  • ipc.admin_sessions
    • Number of sessions for management commands (tgctl). The default value is 1. This provides a separate set of sessions for management commands, in addition to the maximum number of sessions specified by threads. The maximum value that can be specified is 255.
  • sql.lowercase_regular_identifiers
    • Determines whether the SQL compiler treats symbols such as table names as lowercase. Only applicable to the Mizugaki compiler. The default is false.
    • https://github.com/project-tsurugi/tsurugidb/blob/1.0.0-BETA5/docs/sql-features.md#regular-identifiers
  • sql.dev_compiler_support (Available only in 1.0.0-BETA5, deprecated in the next release version)
    • 0: Use the old compiler (Shakujo Compiler), 1: Use the new compiler (Mizugaki Compiler). The default is 1.
• Client APIs
  • Added a shutdown method to the Session interface in Tsubakuro, which waits for a safe session termination.
• Platform Support
  • Experimental support for Ubuntu 24.04.
  • Experimental Support for building with GCC 13.
  • Experimental support for Docker image based on Ubuntu 24.04.
    • https://github.com/project-tsurugi/tsurugidb/pkgs/container/tsurugidb

Bug Fixes

• SQL
  • Abnormal termination occurs when specifying the same column multiple times in the GROUP BY clause.
  • It is possible to create a table with duplicate column names.
  • Rare cases of abnormal termination during SQL compiler's PREPARE process.
  • Overall correction of inappropriate error messages output by the SQL compiler.
  • Queries containing invalid tokens in the WHERE clause do not result in an error.
  • Negative numbers cannot be specified as default values for columns in CREATE TABLE.
  • Abnormal termination occurs when combining CROSS JOIN and SELECT COUNT(*) clauses.
  • Queries fail to execute correctly when the configuration parameter sql.default_partitions is set to a value greater than 32.
• Transaction
  • Two OCC Serializable violations involving SELECT with Full-Scan and INSERT OR REPLACE are not detected.
  • Fixed the possibility of counter information related to internal transactions in the transaction engine overflowing.
• Endpoint
  • Rare cases of incorrect results in SQL queries involving grouping and aggregation when using IPC connections.
  • Abnormal termination occurs around 65200 when creating sessions continuously from the same process using IPC connections.
  • Unstable behavior occurs when encountering out-of-memory errors related to shared memory during IPC connections.
  • Shutdown does not complete when using TCP connections.
• Client APIs
  • ForegroundFutureResponse.close() does not time out.
  • min function does not return correct results for columns of type timestamp with time zone.
  • Errors occur when searching for data in columns of type timestamp with time zone.
  • Closing a transaction while a query is being executed sometimes results in an invalid exception.

---

Various other stability improvements and operational enhancements have been made.
For more details, please refer to the following changelog:

• Tsurugi 1.0.0-BETA5 - Changelog

For upgrade instructions from previous versions, please refer to the following document:

• Tsurugi Upgrade Guide

---

This discussion was created from the release 1.0.0-BETA5.