Weekly update in TiDB

Last week, we landed 28 PRs in the TiDB repository.

Added

• Support show global bind
• Support drop global binding
• Support create global binding
• Support show open tables with empty results
• Add the role support for SHOW GRANT
• Support SET DEFAULT ROLE
• Support the JSON_SEARCH built-in function

Improved

• Speed up decoding the column ID
• Adapt the utf8mb4_0900_ai_ci collation
• Show more information about Coprocessor tasks in slow query logs
• Show memory consumption in slow query logs
• Add a memory table to store hot Region information
• Show StatsVersion of the table in slow query logs
• Support ConstItem() for expressions to test if it is a constant

Fixed

• Fix wrong results caused by splitting ranges inappropriately in some cases
• Fix the stack overflow issue caused by folding constants in some cases
• Fix the issue that the bad null error is ignored when disabling the strict SQL mode
• Fix a race when recreating the batch-commands client when TiKV crashes
• Fix wrong results caused by pruning unfoldable expressions in order by

Weekly update in TiSpark

Last week, we landed 11 PRs in the TiSpark repository.

Added

• Add a tidb-adapter plugin to use TiDB as a metastore
• Support Spark 2.3.x by reflection rather than profile

Fixed

• Fix a partition parser bug when encountering ZERO_DECIMAL
• Fix a bug in unsupported partition expressions
• Fix the issue that the prefix length is larger than the value used in reality

Improved

• Add the Spark version in TiSpark version description

Weekly update in TiKV and PD

Last week, we landed 27 PRs in the TiKV and PD repositories.

Added

• Add the batch aggregation framework
• Add rocksdb.num-immutable-mem-table
• Support scattering Regions and get the operator status
• Make properties index distance configurable
• Add ret_field_type

Improvement

• Move kvGet to the util package
• Use builder to build the field type
• Add comments for several modules
• Clean up util and engine components
• Use KeyBuilder to reduce memory allocation and copy bound keys
• Use bitflag to replace bool
• Adapt the BatchLimitExecutor style to other batch executors
• Move build related functions to DAGBuilder
• Make executor summary collector work easier
• Move the logic of checking the availability of batch execution to the executor

Fixed

• Make tidy check only module files
• Add the default HTTP prefix for the detaching mode
• Make LoadRange return both keys and values
• Retry updating the leader when initializing the PD client
• Update the copyright
• Remove repeated content
• Make TestBalance of the hot-write-region scheduler stable
• Accept multiple PK handles in the request
• Check the iterator status when the iterator is invalid
• Import data after all Regions are scattered

New contributors (Thanks!)

tikv:

• b41sh

tidb-operator:

• cofyc

parser:

• Ryan-Git
• pingyu

docs:

• philip