Weekly update in TiDB

Last week, we landed 63 PRs in the TiDB repository.

Added

• Support the NTILE window function
• Support the LEAD and LAG window functions
• Support the PERCENT_RANK window functions
• Support the CUME_DIST window function
• Support the NTH_VALUE window function
• Support the log_bin variable
• Support the JSON_ARRAY_APPEND built-in JSON function

Improved

• Set the correlation when loading the needed column histogram
• Stabilize the sort order when computing the correlation
• Set the new child after injecting the Project operator
• Generate digest and log it in slow logs
• Skip loading the privilege when skip-grant-table is enabled
• Replace some maps with the switch table to save memory
• Unify the log format in the planner package
• Update the SELECT denied message for the compatibility with MySQL
• Update the binlog enabling configuration and add the tidb_log_bin system variable
• Support DROP ROLE
• Support ROLL BACK for renaming the table, modifying the table charset, and truncating the table partition
• Only consider prefix columns in indexes for choosing Index Join
• Unify the log format in the executor package
• Unify the log format in the expression package
• Refactor the slow log format for the compatibility with the MySQL slow log
• Create a SQL bind table during bootstrap

Fixed

• Fix the issue that last_day is not compatible with MySQL
• Fix the issue that Point Get might miss the unique key if the primary key is also in the condition
• Fix the panic when wrapping the cast for the window function
• Fix the issue that str_to_date is not compatible with MySQL
• Fix the issue that default_week_format does not work
• Fix the Create Table ... Like bug when the refer table has non-public column or index
• Fix an unexpected error caused by Over
• Correct ExpectedCnt for children plans of Join

Weekly update in TiSpark

Last week, we landed 6 PRs in the TiSpark repository.

Fixed

• Fix the incorrect default value of the Timestamp type due to TiDB upgrade
• Fix possible IndexOutOfBoundException in KeyUtils

Weekly update in TiKV and PD

Last week, we landed 28 PRs in the TiKV and PD repositories.

Added

• Add an option to decide whether to panic or not when the key exceeds the bound or in the MVCC corruption

• Implement replace

• Implement builtin_string and instr_binary

• BatchExecutor

  • Add the context for AsMySQLBool and remove BatchExecutorContext
  • Implement AsMySQLBool

Improved

• Remove the unnecessary Copy trait of Tz and EvalConfig

• Avoid some copies in the MVCC reader

• Refactor ScannerBuilder

• Export jemalloc statistics to Prometheus

• Use the address instead of the store ID for metrics

• Make the heartbeat more reasonable in the simulator

• Importer

  • Wait after split before scatter
  • Restrict the memory usage by RocksDB
  • Do not read the entire SST file into memory
  • Store the intermediate SST files on the disk instead of memory
  • Increase the default region-split-size to 512 MB

Fixed

• Fix the issue about instr_binary
• Allow restart with a StoreIdent when the cluster is not bootstrapped

New contributors (Thanks!)

tidb:

• jarvys
• liufuyang
• wjhuang2016
• zyycj

tikv:

• iosmanthus