TiDB Weekly

News & blog posts

The TiDB user community has played an important role in product polishing and upgrading. However, it was obscured in the old community structure. In addition, the responsibilities for the roles in the developer community and the relationship between roles are relatively simple. Therefore, we decided to include the TiDB user community in the new community structure while providing the TiDB developer community with clearly defined roles, rights, and responsibilities. At the same time, some new roles and new organizations have been introduced.

Let's take a closer look:

New Structure, New Roles - TiDB Community Upgrade!

NetEase Games, affiliated with NetEase, Inc., is a leading provider of self‐developed PC‐client and mobile games to worldwide users. As their business boomed, the soaring data size became a nightmare. Last week, we published a post written by Wenjie Li, the senior database administrator at NetEase Games Billing Team and the TiDB User Group Ambassador, that dives deep into why NetEase Games chose TiDB, an open-source MySQL-compatible distributed Hybrid Transactional/Analytical Processing (HTAP) database, over some other MySQL-based and NewSQL storage solutions. Li describes how they tested TiDB against its competitors, why TiDB won, and how they are using it now.

The full article is here:

NetEase Games: Why We Chose a Distributed SQL Database Alongside MySQL to Break down Data Silos

Community

New contributors

tidb:

• ylht
• eggeek
• t0350
• tongxing2019

pd:

• ekalinin

dm:

• SE-Bin

Call for participation

• Vectorized Expression Working Group

  • Date or Time built-in functions (35/38)
  • Decimal built-in functions (26/31)
  • Int built-in functions (174/187)
  • JSON built-in functions (24/27)
  • Real built-in functions (47/49)
  • String built-in functions (100/108)
  • Duration built-in functions (26/34)
  • Last week, 19 PRs were landed in the expression component.

• Coprocessor SIG:

  • Improve the performance of Chunk Encoder
  • Implement more UDFs
  • Implement the new row format
  • Port BinaryJSON
  • Tracing
  • The maximum execution time of Per-request

• Planner SIG:

  • Add rules for the cascades planner

• More issues to solve for TiDB

• More issues to solve for TiKV

Updates of the week

Progress

Last week, we landed 100 PRs in the TiDB repository, 19 PRs in the TiSpark repository, and 49 PRs in the TiKV and PD repositories.

Critical PRs

TiDB:

• Change waitStart of the pessimistic lock for one statement
• Add the tidb_enable_parallel_commit global variable
• Add the ProjectionElimination transformation rule for the cascades planner
• Fix the SQL bind when SQL has a symbol list
• Apply vecGroupChecker in the window executor
• Show operators’ disk consumption in the results of EXPLAIN ANALYZE
• Support the framework of the reverse evaluation for the expression
• Support reading the memory table of the TiDB cluster

TiSpark:

• Support getting JSON when using the TypeChunk coedc format
• Fix the issue that TiSpark distributes TiFlash tasks in the way of TiKV
• Add the timezone check

TiKV and PD:

• Update gRPC to fix a potential memory leak issue
• Fix a bug that causes the deadlock detector leader to step down
• Optimize the scheduler latches to avoid latch-wait
• Fix the non-pessimistic lock conflict
• Add the pending influence to the scheduler
• Improve the performance of the HTTP API for getting all Regions
• Introduce the operator builder

Upcoming TiDB event

Paper reading (in Chinese) on Dec 9