├── .editorconfig ├── .gitignore ├── 2016-07-23-tidb-weekly.md ├── 2016-07-29-tidb-weekly.md ├── 2016-08-05-tidb-weekly.md ├── 2016-08-12-tidb-weekly.md ├── 2016-08-22-tidb-weekly.md ├── 2016-08-29-tidb-weekly.md ├── 2016-09-05-tidb-weekly.md ├── 2016-09-12-tidb-weekly.md ├── 2016-09-19-tidb-weekly.md ├── 2016-09-26-tidb-weekly.md ├── 2016-09-30-tidb-weekly.md ├── 2016-10-17-tidb-weekly.md ├── 2016-10-24-tidb-weekly.md ├── 2016-10-31-tidb-weekly.md ├── 2016-11-07-tidb-weekly.md ├── 2016-11-14-tidb-weekly.md ├── 2016-11-21-tidb-weekly.md ├── 2016-11-28-tidb-weekly.md ├── 2016-12-05-tidb-weekly.md ├── 2016-12-12-tidb-weekly.md ├── 2016-12-19-tidb-weekly.md ├── 2016-12-26-tidb-weekly.md ├── 2017-01-01-tidb-weekly.md ├── 2017-01-08-tidb-weekly.md ├── 2017-01-24-tidb-weekly.md ├── 2017-02-05-tidb-weekly.md ├── 2017-02-13-tidb-weekly.md ├── 2017-02-27-tidb-weekly.md ├── 2017-03-06-tidb-weekly.md ├── 2017-03-13-tidb-weekly.md ├── 2017-03-20-tidb-weekly.md ├── 2017-03-27-tidb-weekly.md ├── 2017-04-10-tidb-weekly.md ├── 2017-04-17-tidb-weekly.md ├── 2017-05-02-tidb-weekly.md ├── 2017-05-08-tidb-weekly.md ├── 2017-05-15-tidb-weekly.md ├── 2017-05-22-tidb-weekly.md ├── 2017-06-05-tidb-weekly.md ├── 2017-06-12-tidb-weekly.md ├── 2017-06-20-tidb-weekly.md ├── 2017-06-26-tidb-weekly.md ├── 2017-07-04-tidb-weekly.md ├── 2017-07-17-tidb-weekly.md ├── 2017-07-24-tidb-weekly.md ├── 2017-07-31-tidb-weekly.md ├── 2017-08-07-tidb-weekly.md ├── 2017-08-14-tidb-weekly.md ├── 2017-08-21-tidb-weekly.md ├── 2017-08-28-tidb-weekly.md ├── 2017-09-04-tidb-weekly.md ├── 2017-09-11-tidb-weekly.md ├── 2017-09-18-tidb-weekly.md ├── 2017-09-25-tidb-weekly.md ├── 2017-10-09-tidb-weekly.md ├── 2017-10-23-tidb-weekly.md ├── 2017-10-30-tidb-weekly.md ├── 2017-11-06-tidb-weekly.md ├── 2017-11-13-tidb-weekly.md ├── 2017-11-20-tidb-weekly.md ├── 2017-11-27-tidb-weekly.md ├── 2017-12-04-tidb-weekly.md ├── 2017-12-11-tidb-weekly.md ├── 2017-12-18-tidb-weekly.md ├── 2017-12-25-tidb-weekly.md ├── 2018-01-02-tidb-weekly.md ├── 2018-01-08-tidb-weekly.md ├── 2018-01-15-tidb-weekly.md ├── 2018-01-22-tidb-weekly.md ├── 2018-01-29-tidb-weekly.md ├── 2018-02-05-tidb-weekly.md ├── 2018-02-12-tidb-weekly.md ├── 2018-02-26-tidb-weekly.md ├── 2018-03-05-tidb-weekly.md ├── 2018-03-12-tidb-weekly.md ├── 2018-03-19-tidb-weekly.md ├── 2018-03-26-tidb-weekly.md ├── 2018-04-02-tidb-weekly.md ├── 2018-04-09-tidb-weekly.md ├── 2018-04-16-tidb-weekly.md ├── 2018-04-23-tidb-weekly.md ├── 2018-05-02-tidb-weekly.md ├── 2018-05-07-tidb-weekly.md ├── 2018-05-14-tidb-weekly.md ├── 2018-05-21-tidb-weekly.md ├── 2018-05-28-tidb-weekly.md ├── 2018-06-04-tidb-weekly.md ├── 2018-06-11-tidb-weekly.md ├── 2018-06-19-tidb-weekly.md ├── 2018-06-25-tidb-weekly.md ├── 2018-07-02-tidb-weekly.md ├── 2018-07-09-tidb-weekly.md ├── 2018-07-16-tidb-weekly.md ├── 2018-07-23-tidb-weekly.md ├── 2018-07-30-tidb-weekly.md ├── 2018-08-06-tidb-weekly.md ├── 2018-08-13-tidb-weekly.md ├── 2018-08-20-tidb-weekly.md ├── 2018-08-27-tidb-weekly.md ├── 2018-09-03-tidb-weekly.md ├── 2018-09-10-tidb-weekly.md ├── 2018-09-17-tidb-weekly.md ├── 2018-09-25-tidb-weekly.md ├── 2018-10-15-tidb-weekly.md ├── 2018-10-22-tidb-weekly.md ├── 2018-10-29-tidb-weekly.md ├── 2018-11-05-tidb-weekly.md ├── 2018-11-12-tidb-weekly.md ├── 2018-11-19-tidb-weekly.md ├── 2018-11-26-tidb-weekly.md ├── 2018-12-03-tidb-weekly.md ├── 2018-12-10-tidb-weekly.md ├── 2018-12-17-tidb-weekly.md ├── 2018-12-24-tidb-weekly.md ├── 2019-01-02-tidb-weekly.md ├── 2019-01-07-tidb-weekly.md ├── 2019-01-14-tidb-weekly.md ├── 2019-01-21-tidb-weekly.md ├── 2019-01-28-tidb-weekly.md ├── 2019-02-11-tidb-weekly.md ├── 2019-02-18-tidb-weekly.md ├── 2019-02-25-tidb-weekly.md ├── 2019-03-04-tidb-weekly.md ├── 2019-03-11-tidb-weekly.md ├── 2019-03-18-tidb-weekly.md ├── 2019-03-25-tidb-weekly.md ├── 2019-04-01-tidb-weekly.md ├── 2019-04-08-tidb-weekly.md ├── 2019-04-15-tidb-weekly.md ├── 2019-04-22-tidb-weekly.md ├── 2019-04-29-tidb-weekly.md ├── 2019-05-06-tidb-weekly.md ├── 2019-05-13-tidb-weekly.md ├── 2019-05-20-tidb-weekly.md ├── 2019-05-27-tidb-weekly.md ├── 2019-06-03-tidb-weekly.md ├── 2019-06-10-tidb-weekly.md ├── 2019-06-17-tidb-weekly.md ├── 2019-06-24-tidb-weekly.md ├── 2019-07-01-tidb-weekly.md ├── 2019-07-08-tidb-weekly.md ├── 2019-07-15-tidb-weekly.md ├── 2019-07-22-tidb-weekly.md ├── 2019-07-29-tidb-weekly.md ├── 2019-08-05-tidb-weekly.md ├── 2019-08-12-tidb-weekly.md ├── 2019-08-19-tidb-weekly.md ├── 2019-08-26-tidb-weekly.md ├── 2019-09-02-tidb-weekly.md ├── 2019-09-09-tidb-weekly.md ├── 2019-09-16-tidb-weekly.md ├── 2019-09-23-tidb-weekly.md ├── 2019-09-30-tidb-weekly.md ├── 2019-10-14-tidb-weekly.md ├── 2019-10-21-tidb-weekly.md ├── 2019-10-28-tidb-weekly.md ├── 2019-11-04-tidb-weekly.md ├── 2019-11-11-tidb-weekly.md ├── 2019-11-18-tidb-weekly.md ├── 2019-11-25-tidb-weekly.md ├── 2019-12-02-tidb-weekly.md ├── 2019-12-09-tidb-weekly.md ├── 2019-12-16-tidb-weekly.md ├── 2019-12-23-tidb-weekly.md ├── 2019-12-30-tidb-weekly.md ├── 2020-01-06-tidb-weekly.md ├── 2020-01-14-tidb-weekly.md ├── 2020-01-20-tidb-weekly.md ├── 2020-02-03-tidb-weekly.md ├── 2020-02-10-tidb-weekly.md ├── 2020-02-17-tidb-weekly.md ├── 2020-02-24-tidb-weekly.md ├── 2020-03-02-tidb-weekly.md ├── 2020-03-09-tidb-weekly.md ├── 2020-03-16-tidb-weekly.md ├── 2020-03-23-tidb-weekly.md ├── 2020-03-30-tidb-weekly.md ├── 2020-04-07-tidb-weekly.md ├── 2020-04-13-tidb-weekly.md ├── 2020-04-20-tidb-weekly.md ├── 2020-04-27-tidb-weekly.md ├── 2020-05-06-tidb-weekly.md ├── 2020-05-11-tidb-weekly.md ├── 2020-06-01-tidb-monthly.md ├── 2020-07-01-tidb-monthly.md ├── 2020-08-03-tidb-monthly.md ├── 2020-09-01-tidb-monthly.md ├── 2020-09-30-tidb-monthly.md ├── 2020-11-02-tidb-monthly.md ├── 2020-12-01-tidb-monthly.md ├── 2021-01-04-tidb-monthly.md ├── 2021-02-01-tidb-monthly.md ├── 2021-03-01-tidb-monthly.md ├── 2021-04-01-tidb-monthly.md └── media └── .gitkeep /.editorconfig: -------------------------------------------------------------------------------- 1 | root = true 2 | 3 | [*] 4 | charset = utf-8 5 | end_of_line = lf 6 | insert_final_newline = true 7 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | .DS_Store 2 | -------------------------------------------------------------------------------- /2016-07-23-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 17 ~ July 22, 2016) 3 | date: 2016-07-23 4 | summary: Last week, we landed 22 PRs in the TiDB repositories and 15 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (July 17 ~ July 22, 2016) 9 | 10 | Last week, we landed [22 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-07-17..2016-07-22%20) in the TiDB repositories and [15 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-07-16..2016-07-22+&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | + Refactor the query optimizer to imporve the query efficiency for Join and SubQuery 14 | + Add distributed SQL support for aggregate functions 15 | + Improve the stability of the TiDB service 16 | + Refactor the Decimal codes to improve the compatibility with MySQL 17 | + Optimize the TiDB compatibility and performance for Zabbix 18 | + Enhance the performance and the Sysbench result is improved significantly 19 | 20 | ## Notable changes to `TiKV` 21 | 22 | + Add asynchronous scheduler support for higher throughput and better performance, see [Benchmark](#Benchmark). 23 | + Use PipeBuf to speed up socket read/write. 24 | + Add pushing down `max/min` support for the coprocessor. 25 | + Re-use RocksDB write ahead log (WAL) to guarantee consistency when writing data in different column families. 26 | + Support using `make install` on the CentOS platform to install TiKV. 27 | 28 | ## Notable changes to `Placement Driver` 29 | 30 | + Refactor the balance framework to make a cluster more balanced and stable. 31 | + Support web UI in Docker. 32 | 33 | ## Benchmark 34 | 35 | Use [sysbench](https://github.com/pingcap/tidb-bench/tree/master/sysbench) to benchmark asynchronous scheduler and previous 8 threadpools in 3-node TiKV. 36 | 37 | ```bash 38 | # Prepare data 39 | sysbench --test=./lua-tests/db/oltp.lua --mysql-host=${host} --mysql-port=${port} \ 40 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=$1 \ 41 | --oltp-table-size=1000 --rand-init=on prepare 42 | 43 | # Run benchmark 44 | sysbench --test=./lua-tests/db/insert.lua --mysql-host=${host} --mysql-port=${port} \ 45 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \ 46 | --oltp-table-size=1000 --num-threads=${threads} --report-interval=60 \ 47 | --max-requests=1280000 --percentile=99 run 48 | ``` 49 | 50 | |Threads|Async scheduler qps|Async scheduler avg/.99 latency|8 threadpools qps|Thread pool avg/.99 latency| 51 | |---|---|---|---|---|---| 52 | |32|2049|15.6/29.1|1652|19.4/36.3| 53 | |64|2042|31.3/85.5|1693|37.8/83| 54 | |128|2125|60.2/147|1649|77/175| 55 | 56 | As we can see, the qps is increased by about 25%, and the latency is decreased by about 15%. 57 | -------------------------------------------------------------------------------- /2016-07-29-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 23 ~ July 29, 2016) 3 | date: 2016-07-29 4 | summary: Last week, we landed 27 PRs in the TiDB repositories and 34 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (July 23 ~ July 29, 2016) 9 | 10 | Last week, we landed [27 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-07-23..2016-07-29%20) in the TiDB repositories and [34 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-07-23..2016-07-29+&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | + Support cost based query optimization. 14 | + Set the new query optimizer as default to improve the speed of complex queries. Meanwhile, a start-up parameter is provided to switch to the old query optimizer. 15 | + Use Varint to encode the Column Value with integer type and Column ID, which saves storage space significantly. 16 | + Add a [Documents](https://github.com/pingcap/docs) repository. 17 | + Supprt the [Hex Function](http://dev.mysql.com/doc/refman/5.7/en/string-functions.html#function_hex). 18 | + Simplify the compling and deployment for better usability. 19 | + Fix several bugs. 20 | 21 | ## New Contributor 22 | [Huaiyu Xu](https://github.com/XuHuaiyu) 23 | 24 | ## Notable changes to `TiKV` 25 | 26 | + Support building TiKV by linking static RocksDB automatically. You can build TiKV in one machine and copy the binary to other machines to use directly as long as the machines have the same architecture and operation system. 27 | + Supprt getting snapshot asynchronously for higher throughput and better performance, see [benchmark](#Benchmark). 28 | + Use PipeBuf to receive data to reduce system call and memory allocation. 29 | + Use Varint to encode un-comparable integers to save disk space. 30 | + Use one `SendCh` to clean up duplicated code. 31 | + Add [user documents](https://github.com/pingcap/docs/) on how to build and use TiKV. 32 | 33 | ## Notable changes to `Placement Driver` 34 | 35 | + Embed etcd to for easier deployment. 36 | + Add a health check for Store. 37 | + Add [user documents](https://github.com/pingcap/docs/) on how to build and use PD. 38 | + Clean up the command flags. 39 | 40 | ## Benchmark 41 | 42 | Use [sysbench](https://github.com/pingcap/tidb-bench/tree/903ec2044b00d10e449433ee794ebffebd5a6fd0/sysbench) to benchmark getting snapshot asynchronously and synchronously in 3-node TiKV. 43 | 44 | ```bash 45 | # Prepare data 46 | sysbench --test=./lua-tests/db/oltp.lua --mysql-host=${host} --mysql-port=${port} \ 47 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \ 48 | --oltp-table-size=5120000 --rand-init=on prepare 49 | 50 | # Run benchmark 51 | sysbench --test=./lua-tests/db/select.lua --mysql-host=${host} --mysql-port=${port} \ 52 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \ 53 | --oltp-table-size=5120000 --num-threads=${threads} --report-interval=60 \ 54 | --max-requests=5120000 --percentile=99 run 55 | ``` 56 | 57 | |Threads|Async qps|Async avg/.99 latency|Sync qps|Sync avg/.99 latency| 58 | |---|---|---|---|---|---| 59 | |32|13347|2.4/4.61|12345|2.59/4.78| 60 | |64|14210|4.50/7.78|11868|5.39/8.50| 61 | 128|14075|9.09/15.22|12324|10.38/16.68| 62 | 63 | As we can see, the qps is increased by about 15%, and the latency is decreased by about 10%. 64 | 65 | 66 | -------------------------------------------------------------------------------- /2016-08-05-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 30 ~ August 05, 2016) 3 | date: 2016-08-05 4 | summary: Last week, we landed 28 PRs in the TiDB repositories and 32 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (July 30 ~ August 05, 2016) 9 | 10 | Last week, we landed [28 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-07-30..2016-08-05%20) in the TiDB repositories and [32 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-07-30..2016-08-05+&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Add support for constant folding in the SQL optimizer. 15 | + Optimize the query speed of the secondary index. In certain scenarios, only the data in the index needs to be read. 16 | + Use dynamic programing to decide the join path for multiple tables. 17 | + Adjust the command line to support setting the listening address. 18 | + Prometheus metrics and golang pprof share the same port. 19 | + Update the [Documents](https://github.com/pingcap/docs) repository. 20 | + Fix several bugs. 21 | ## Notable changes to `TiKV` 22 | 23 | + Split the operations on RocksDB from scheduler thread to a worker pool. 24 | + Support leader lease mechanism when the quorum check is enabled. 25 | + Use `pending snapshot regions check` to avoid receiving multiple overlapping snapshots at the same time. 26 | + Check down peers and report to Placement Driver(PD). 27 | + Support time monitor to check whether time jumps back or not. 28 | 29 | ## Notable changes to `Placement Driver` 30 | 31 | + Reduce the "1234" and "9090" ports in PD. Now PD has only "2379" and "2380" ports for external use. 32 | + Support the `join` flag to let PD join an existing cluster dynamically. 33 | + Support the `remove PD member` API to remove a PD from a cluster dynamically. 34 | + Support the `list PD members` API. 35 | -------------------------------------------------------------------------------- /2016-08-12-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 05 ~ August 12, 2016) 3 | date: 2016-08-12 4 | summary: Last week, we landed 20 PRs in the TiDB repositories and 11 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (August 05 ~ August 12, 2016) 9 | 10 | Last week, we landed [20 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-08-05..2016-08-12%20) in the TiDB repositories and [11 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-08-06..2016-08-12&ref=searchresults&type=Issues&utf8=%E2%9C%93) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Rewrite Lexer and improve the speed of parsing SQL texts by 40%. 15 | + Add a command line flag for log output file and rotate log files regularly. 16 | + Optimize the 2 phase commit process and adopt faster methods to clear locks. 17 | + Optimize the execution speed of the `Insert On Duplicate Update` statement. 18 | + Update the [Documents](https://github.com/pingcap/docs) repository. 19 | + Fix several bugs. 20 | 21 | ## Notable changes to `TiKV` 22 | 23 | + Support the `Scan` and `Resolve` transaction lock. 24 | + Support garbage collection(GC) stale peer. 25 | + Use a `Write` column family to store transaction commit logs. 26 | + Remove the unnecessary `Seek` operation. 27 | + Fix random quorum test. 28 | 29 | ## Notable changes to `Placement Driver` 30 | 31 | + Support the `get PD leader` API. 32 | -------------------------------------------------------------------------------- /2016-08-29-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 22 ~ August 28, 2016) 3 | date: 2016-08-29 4 | summary: Last week, we landed 26 PRs in the TiDB repositories and 26 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (August 22 ~ August 28, 2016) 9 | 10 | Last week, we landed [26 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-08-22..2016-08-28%20) in the TiDB repositories and [26 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-08-22..2016-08-28&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | + Support [the MySQL SetOption Command and Multiple Statements](https://github.com/pingcap/tidb/pull/1628). 14 | + Support filter push-down for the [Time](https://github.com/pingcap/tidb/pull/1629)/[Decimal](https://github.com/pingcap/tidb/pull/1651) type. 15 | + Support converting OuterJoin to InnerJoin by using [Null Reject](https://github.com/pingcap/tidb/pull/1630). 16 | + Support [multiple-thread Hash Join](https://github.com/pingcap/tidb/pull/1591). 17 | + Support [Garbage Collector](https://github.com/pingcap/tidb/pull/1577). 18 | + Optimize the code to improve the [Performance](https://github.com/pingcap/tidb/pull/1641). 19 | + Fix several bugs. 20 | 21 | ## Notable changes to `TiKV` 22 | 23 | + Coprocessor supports the [time type](https://github.com/pingcap/tikv/pull/949). 24 | + Output the [version information](https://github.com/pingcap/tikv/pull/952) when TiKV starts. 25 | + Append the [write column family](https://github.com/pingcap/tikv/pull/954) when committing lock-only keys to fix bug [#921](https://github.com/pingcap/tikv/issues/921). 26 | + Use randomized Placement Driver (PD) server and [remove getting PD leader](https://github.com/pingcap/tikv/pull/976) to solve issues [#942](https://github.com/pingcap/tikv/issues/942) and [#956](https://github.com/pingcap/tikv/issues/956). 27 | + Support the [Debug traits](https://github.com/pingcap/tikv/pull/986) for messages in the sending channel. 28 | + Coprocessor uses [configuration](https://github.com/pingcap/tikv/pull/985) to make the endpoint threadpool size configurable. 29 | 30 | ## Notable changes to `Placement Driver` 31 | 32 | + Output the [version information](https://github.com/pingcap/pd/pull/279) when PD starts. 33 | + Save the [next timestamp oracle(TSO)](https://github.com/pingcap/pd/pull/290) to solve issue [#191](https://github.com/pingcap/pd/issues/191). 34 | -------------------------------------------------------------------------------- /2016-09-05-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 29 ~ September 04, 2016) 3 | date: 2016-09-05 4 | summary: Last week, we landed 29 PRs in the TiDB repositories and 24 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (August 29 ~ September 04, 2016) 9 | 10 | Last week, we landed [29 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-08-29..2016-09-04%20) in the TiDB repositories and [24 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-08-29..2016-09-04&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Support the [unhex](https://github.com/pingcap/tidb/pull/1675) and the [ceiling/ceil](https://github.com/pingcap/tidb/pull/1666) functions 15 | + Improve the Parser to handle `\r\n`. 16 | + Solve the potential [concurrency issues](https://github.com/pingcap/tidb/pull/1669) 17 | + Support [Load Data](https://github.com/pingcap/tidb/pull/1634) 18 | + Use the [Pipeline model](https://github.com/pingcap/tidb/pull/1622) to filter data through indexes to improve the performance 19 | + Improve the code to [reduce memory allocation](https://github.com/pingcap/tidb/pull/1663) and improve the performance 20 | + Fix several bugs. 21 | 22 | ## Notable changes to `TiKV` 23 | 24 | + Coprocessor supports the [new decimal](https://github.com/pingcap/tikv/pull/977) type. 25 | + Use the [Raft column family](https://github.com/pingcap/tikv/pull/990) to save Raft meta and logs. See [Benchmark](#Benchmark). 26 | + [Tune the write column family](https://github.com/pingcap/tikv/pull/998) to reduce memory usage. 27 | 28 | ## Notable changes to `Placement Driver` 29 | 30 | + [Check duplicated](https://github.com/pingcap/pd/pull/297) store addresses to prevent user from bootstrapping cluster in the wrong way, see issues [287](https://github.com/pingcap/pd/issues/287), [288](https://github.com/pingcap/pd/issues/288). 31 | + Support the [remove store](https://github.com/pingcap/pd/pull/298) API to remove a dead TiKV store. 32 | + Use [glide](https://github.com/Masterminds/glide) instead of the original [godep](https://github.com/tools/godep) to manage [vendor](https://github.com/pingcap/pd/pull/299). 33 | + Remove [`join itself`](https://github.com/pingcap/pd/pull/307) to prevent user from starting a removed PD server again. 34 | 35 | ## Benchmark 36 | 37 | Use [sysbench](https://github.com/pingcap/tidb-bench/tree/903ec2044b00d10e449433ee794ebffebd5a6fd0/sysbench) to benchmark using the (CF\_RAFT) column family to save the Raft log and previously the default (CF\_DEFAULT) column family in 3-node TiKV. 38 | 39 | ```bash 40 | # Prepare data 41 | sysbench --test=./lua-tests/db/oltp.lua --mysql-host=${host} --mysql-port=${port} \ 42 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \ 43 | --oltp-table-size=${table_size} --rand-init=on prepare 44 | 45 | # Run benchmark 46 | sysbench --test=./lua-tests/db/insert.lua --mysql-host=${host} --mysql-port=${port} \ 47 | --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \ 48 | --oltp-table-size=${table_size} --num-threads=${threads} --report-interval=60 \ 49 | --max-requests=1280000 --percentile=99 run 50 | ``` 51 | 52 | |Threads|Table Size|CF_DEFAULT qps|CF_DEFAULT avg/.99 latency|CF_RAFT qps|CF_RAFT avg/.99 latency| 53 | |---|---|---|---|---|---| 54 | |32|6400000|3885|8.24/13.48|3979|8.04/13.70| 55 | |64|7680000|3653|17.52/34.10|4477|14.29/24.49| 56 | 128|8960000|3422|37.39/70.10|4642|27.57/57.45| 57 | 58 | As we can see, the qps is increased by about 22%, and the latency is decreased by about 18%. 59 | 60 | ## New contributors 61 | 62 | + [Dagang Wei](https://github.com/weidagang) 63 | -------------------------------------------------------------------------------- /2016-09-12-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 05 ~ September 11, 2016) 3 | date: 2016-09-12 4 | summary: Last week, we landed 20 PRs in the TiDB repositories and 32 PRs in the TiKV repositories.. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (September 05 ~ September 11, 2016) 9 | 10 | Last week, we landed [20 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-09-05..2016-09-11%20) in the TiDB repositories and [32 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-09-05..2016-09-11&type=Issues&ref=searchresults) in the TiKV repositories.. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Support [mydumper](https://launchpad.net/mydumper) 15 | + Use MySQL standard [error code](https://github.com/pingcap/tidb/pull/1700) in the DDL execution results 16 | + Use [heap sort](https://github.com/pingcap/tidb/pull/1697) operator to handle the statements with Limit and Orderby 17 | + Add support for the [CLIENT\_CONNECT\_ATTRS](https://github.com/pingcap/tidb/pull/1684) 18 | + Add the [constant propagation](https://github.com/pingcap/tidb/pull/1652) support to the SQL optimizer 19 | + Optimize the [index scan executor] (https://github.com/pingcap/tidb/pull/1696) to improve the performance 20 | + Optimize the distributed SQL API protocol to improve the performance 21 | + Fix several bugs. 22 | 23 | ## Notable changes to `TiKV` 24 | 25 | + Add the [divide operation](https://github.com/pingcap/tikv/pull/1009) support to Coprocessor. 26 | + Switch to the [prometheus metrics](https://github.com/pingcap/tikv/pull/1017) from the statsd metrics. 27 | + [Abort](https://github.com/pingcap/tikv/pull/1020) applying the snapshot if it conflicts with a new one to fix [1014](https://github.com/pingcap/tikv/issues/1014). 28 | + Ensure that the data from the last `write` before the GC Safe-Point time [can't be removed](https://github.com/pingcap/tikv/pull/1022) to fix [1021](https://github.com/pingcap/tikv/issues/1021). 29 | + Add the [document](https://github.com/pingcap/tikv/pull/1023) for `Scheduler`. 30 | + Calculate the [used space](https://github.com/pingcap/tikv/pull/1026) correctly. 31 | + [Stop GC scan](https://github.com/pingcap/tikv/pull/1036) if there are no keys left to fix the endless-loop problem. 32 | 33 | ## Notable changes to `Placement Driver` 34 | 35 | + Support [store removing](https://github.com/pingcap/pd/pull/306) gracefully. 36 | + Add the [Admin API](https://github.com/pingcap/pd/pull/308). 37 | + [Reduce the default `min-capacity-used-ratio`](https://github.com/pingcap/pd/pull/314) value for an earlier auto-balance. 38 | -------------------------------------------------------------------------------- /2016-09-19-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 12 ~ September 18, 2016) 3 | date: 2016-09-19 4 | summary: Last week, we landed 18 PRs in the TiDB repositories and 26 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (September 12 ~ September 18, 2016) 9 | 10 | Last week, we landed [18 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-09-12..2016-09-18%20) in the TiDB repositories and [26 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-09-12..2016-09-18&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | + Add the [Prometheus](https://prometheus.io/) [metrics](https://github.com/pingcap/tidb/pull/1729) and support [push](https://github.com/pingcap/tidb/pull/1733). 14 | + Support the [streaming aggregation operator](https://github.com/pingcap/tidb/pull/1730). 15 | + [Rename xapi to distsql](https://github.com/pingcap/tidb/pull/1725) to improve readability. 16 | + Add [git hash](https://github.com/pingcap/tidb/pull/1724) to the TiDB server status API. 17 | + [Improve test coverage](https://github.com/pingcap/tidb/pull/1723) in the abstract syntax tree (AST). 18 | + Enable the [division operator](https://github.com/pingcap/tidb/pull/1727) for the distributed SQL statements. 19 | + Fix several bugs. 20 | 21 | ## Notable changes to `TiKV` 22 | 23 | + Remove [the stale peers](https://github.com/pingcap/tikv/pull/1003) that are out of region to fix [804](https://github.com/pingcap/tikv/issues/804). 24 | + [Ignore the tombstone](https://github.com/pingcap/tikv/pull/1045) stores when resolving the store address. 25 | + [Discard the droppable messages](https://github.com/pingcap/tikv/pull/1054) when channel is full to fix [1028](https://github.com/pingcap/tikv/issues/1028). 26 | + [Capture the signal TERM/INT](https://github.com/pingcap/tikv/pull/1058) to close server gracefully. 27 | + [Capture the signal USR1](https://github.com/pingcap/tikv/pull/1071) to log metrics. 28 | + Support [destroying regions asynchronously](https://github.com/pingcap/tikv/pull/1064). 29 | + Support the [pushing metrics](https://github.com/pingcap/tikv/pull/1065) to Prometheus Push Gateway. 30 | 31 | ## Notable changes to `Placement Driver` 32 | 33 | + Add the [API document](https://github.com/pingcap/pd/pull/324). 34 | + Support the [pushing metrics](https://github.com/pingcap/pd/pull/325) to Prometheus Push Gateway. 35 | -------------------------------------------------------------------------------- /2016-09-26-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 19 ~ September 25, 2016) 3 | date: 2016-09-26 4 | summary: Last week, we landed 20 PRs in the TiDB repositories and 24 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (September 19 ~ September 25, 2016) 9 | 10 | Last week, we landed [20 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-09-19..2016-09-25%20) in the TiDB repositories and [24 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-09-19..2016-09-25&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Support [DML binlog](https://github.com/pingcap/tidb/pull/1660). 15 | + Support [reading the history data](https://github.com/pingcap/tidb/pull/1734). 16 | + Add more metrics to [distsql](https://github.com/pingcap/tidb/pull/1737), [DDL](https://github.com/pingcap/tidb/pull/1738), and [store](https://github.com/pingcap/tidb/pull/1741). 17 | + [Replace the vendor tool with glide](https://github.com/pingcap/tidb/pull/1743). 18 | + [Improve test coverage](https://github.com/pingcap/tidb/pull/1723). 19 | + [Code cleanup](https://github.com/pingcap/tidb/pull/1745). 20 | + Improve the test code by [splitting a big test file into smaller files](https://github.com/pingcap/tidb/pull/1757). 21 | 22 | ## Notable changes to `TiKV` 23 | 24 | + Port the [`read index`](https://github.com/pingcap/tikv/pull/1032) feature from etcd. 25 | + Add the [upper bound mod](https://github.com/pingcap/tikv/pull/1060) support to the iterator to improve the `seek` performance. 26 | + Support the [recovery mode](https://github.com/pingcap/tikv/pull/1069) for RocksDB. 27 | + Support [adding/removing column families](https://github.com/pingcap/tikv/pull/1098) dynamically. 28 | 29 | 30 | ## Notable changes to `Placement Driver (PD)` 31 | 32 | + Remove the [`watch` leader](https://github.com/pingcap/pd/pull/327) mechanism for the clients becausse the PD server can proxy requests to the leader. 33 | + Add the [`GetRegionByID`](https://github.com/pingcap/pd/pull/329) command. 34 | -------------------------------------------------------------------------------- /2016-09-30-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 26 ~ September 30, 2016) 3 | date: 2016-09-30 4 | summary: Last week, we landed 17 PRs in the TiDB repositories and 13 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (September 26 ~ September 30, 2016) 9 | 10 | Last week, we landed [17 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-09-26..2016-09-30%20) in the TiDB repositories and [13 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-09-26..2016-09-30&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + [Make the GC alive time configurable](https://github.com/pingcap/tidb/pull/1754) so that users can keep the deleted data as long as they want. 15 | + [Add the metrics for all kinds of statements](https://github.com/pingcap/tidb/pull/1755) to provide more information for insights. 16 | + [Improve the kv package test coverage.](https://github.com/pingcap/tidb/pull/1758) 17 | + [Record the processed row count during DDL](https://github.com/pingcap/tidb/pull/1759) so that users can track the progress of DDL. 18 | + [Consider the limit clause in the cost based optimizer (CBO) framework.](https://github.com/pingcap/tidb/pull/1760) 19 | + [Add metrics for kv errors.](https://github.com/pingcap/tidb/pull/1765) 20 | + [Make truncate statement a DDL](https://github.com/pingcap/tidb/pull/1766) to convert the truncate operation into a `drop table` process followed by a `create table` process. Then TiDB can delete the truncated data with a background worker. 21 | 22 | ## Notable changes to `TiKV` 23 | 24 | + Add a metric for [Raft vote](https://github.com/pingcap/tikv/pull/1111) to monitor server's stability. 25 | + Improve the test coverage for [scheduler](https://github.com/pingcap/tikv/pull/1113), [Raft](https://github.com/pingcap/tikv/pull/1117). 26 | + Check the [stale snapshot](https://github.com/pingcap/tikv/pull/1115) to fix [1084](https://github.com/pingcap/tikv/issues/1084). 27 | + [Reuse iterator](https://github.com/pingcap/tikv/pull/1116) to speed up `scan`. 28 | + [Remove `delete_file_in_range`](https://github.com/pingcap/tikv/pull/1124) to fix [1121](https://github.com/pingcap/tikv/issues/1121). 29 | 30 | ## Notable changes to `Placement Driver (PD)` 31 | 32 | + Add [more metrics](https://github.com/pingcap/pd/pull/330) to monitor the server. 33 | 34 | -------------------------------------------------------------------------------- /2016-10-17-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 01 ~ October 16, 2016) 3 | date: 2016-10-17 4 | summary: Last week, we landed 27 PRs in the TiDB repositories and 32 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (October 01 ~ October 16, 2016) 9 | 10 | Last week, we landed [27 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-10-01..2016-10-16) in the TiDB repositories and [32 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-10-02..2016-10-16&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + Support [projection elimination](https://github.com/pingcap/tidb/pull/1740) so that the executor can run faster when it is not necessary to have a projection layer. 15 | 16 | + [Write DDL binlog](https://github.com/pingcap/tidb/pull/1752) to file. 17 | 18 | + [Convert sort and limit to top-n in the query planning phrase.](https://github.com/pingcap/tidb/pull/1769) 19 | 20 | + [Support reading history data even if the schema changes. ](https://github.com/pingcap/tidb/pull/1790) 21 | 22 | + Add comments for the [server package](https://github.com/pingcap/tidb/pull/1798) and the [plan package](https://github.com/pingcap/tidb/pull/1804). 23 | 24 | + [Add metrics for GC configuration.](https://github.com/pingcap/tidb/pull/1814) 25 | 26 | + [Verify the data for utf-8 columns.](https://github.com/pingcap/tidb/pull/1818) 27 | 28 | + Fix bugs. 29 | 30 | ## Notable changes to `TiKV` 31 | 32 | + [Compact the `lock` column family](https://github.com/pingcap/tikv/pull/1125) periodically. 33 | + Add [random latency filter](https://github.com/pingcap/tikv/pull/1120) to simulate the transport test. 34 | + Improve the [datum test](https://github.com/pingcap/tikv/pull/1152) coverage. 35 | + [Cache the Raft log term](https://github.com/pingcap/tikv/pull/1154) to avoid calling `rocksdb::get` every time. 36 | + [Check the store ID](https://github.com/pingcap/tikv/pull/1155) before sending to raftstore and [refresh expired store address](https://github.com/pingcap/tikv/pull/1156) for the resolve process to fix [issue 1153](https://github.com/pingcap/tikv/issues/1153). 37 | + [Add new regions' meta in StaleEpoch error](https://github.com/pingcap/tikv/pull/1160) to fix [issue 974](https://github.com/pingcap/tikv/issues/974). 38 | + Coprocessor supports [timezone](https://github.com/pingcap/tikv/pull/1166) for timestamp comparison. 39 | 40 | ## Notable changes to `Placement Driver` 41 | 42 | + Ignore balancing the [peer with on-going operation](https://github.com/pingcap/pd/pull/331) to fix [TiKV issue 1084](https://github.com/pingcap/tikv/issues/1084). 43 | -------------------------------------------------------------------------------- /2016-10-24-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 17 ~ October 23, 2016) 3 | date: 2016-10-24 4 | summary: Last week, we landed 30 PRs in the TiDB repositories and 26 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (October 17 ~ October 23, 2016) 9 | 10 | Last week, we landed [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-10-17..2016-10-24%20) in the TiDB repositories and [26 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-10-17..2016-10-23&ref=searchresults&type=Issues&utf8=%E2%9C%93) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + [Set the concurrency for the SQL executor using the Set statement](https://github.com/pingcap/tidb/pull/1795) 15 | 16 | + [Convert the `Limit+Sort` operator to the `TopN` operator on local storage](https://github.com/pingcap/tidb/pull/1819) 17 | 18 | + [Fix the gotouinue leak problem](https://github.com/pingcap/tidb/pull/1834) 19 | 20 | + [Support the logic/bitwise operator on local storage](https://github.com/pingcap/tidb/pull/1838) 21 | 22 | + [Support creating user without password](https://github.com/pingcap/tidb/pull/1841) 23 | 24 | + [Eliminate common aggregation function](https://github.com/pingcap/tidb/pull/1843) 25 | 26 | + [Support the Drop User statement](https://github.com/pingcap/tidb/pull/1854) 27 | 28 | + Fix bugs 29 | 30 | ## Notable changes to `TiKV` 31 | 32 | + Provide a tool [`tikv-ctl`](https://github.com/pingcap/tikv/pull/1163) to browse the internal data in RocksDB. 33 | + Make [the Raft column family](https://github.com/pingcap/tikv/pull/1171) configurable. 34 | + Avoid [deleting other regions' data](https://github.com/pingcap/tikv/pull/1174) accidentally. 35 | + Coprocessor supports [`minus`, `intdiv` and `mod`](https://github.com/pingcap/tikv/pull/1180) operations. 36 | + Support canceling a [applying snapshot job](https://github.com/pingcap/tikv/pull/1182) which is in queue directly. 37 | + Use [`get_region_by_id`](https://github.com/pingcap/tikv/pull/1184) to check the stale region. 38 | + [Skip fetching unnecessary values](https://github.com/pingcap/tikv/pull/1192) to speed up the scan performance. 39 | + Add [flow control](https://github.com/pingcap/tikv/pull/1195) to fix [issue 1190](https://github.com/pingcap/tikv/issues/1190) 40 | + [Clean up temporary snapshot](https://github.com/pingcap/tikv/pull/1197) file when startup. 41 | + [Shrink the send buffer](https://github.com/pingcap/tikv/pull/1205) after sending a big query to avoid occupying too much memory. 42 | 43 | ## Notable changes to `Placement Driver` 44 | 45 | + Add [`uptime`](https://github.com/pingcap/pd/pull/341) to show the online time for a store. 46 | + [Embed `metapb.Store`](https://github.com/pingcap/pd/pull/352) into `storeInfo` to make the code cleaner. 47 | -------------------------------------------------------------------------------- /2016-10-31-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 24 ~ October 30, 2016) 3 | date: 2016-10-31 4 | summary: Last week, we landed 24 PRs in the TiDB repositories and 28 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV', 'Placement Driver'] 6 | --- 7 | 8 | # Weekly update (October 24 ~ October 30, 2016) 9 | 10 | Last week, we landed [24 PRs](https://github.com/pingcap/tidb/pulls?utf8=✓&q=is%3Apr%20is%3Amerged%20merged%3A2016-10-25..2016-10-31%20) in the TiDB repositories and [28 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-10-24..2016-10-30&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | ## Notable changes to `TiDB` 13 | 14 | + [Support coalesce/case when pushing down on local storage](https://github.com/pingcap/tidb/pull/1856)。 15 | 16 | + [Support showing indexes in the table syntax.](https://github.com/pingcap/tidb/pull/1873) 17 | 18 | + [Split eval.go into some smaller files](https://github.com/pingcap/tidb/pull/1865) to make code cleaner. 19 | 20 | + [Fix a bug about truncating data.](https://github.com/pingcap/tidb/pull/1877) 21 | 22 | + [Fix the mysql version number format.](https://github.com/pingcap/tidb/pull/1879) 23 | 24 | + [Fix a bug about dropping the nonexist foreign key.](https://github.com/pingcap/tidb/pull/1874) 25 | 26 | + [Fix a bug in the parser where hexadecimal was parsed as string.](https://github.com/pingcap/tidb/pull/1871) 27 | 28 | + [Add comments for executor package](https://github.com/pingcap/tidb/pull/1876) to improve code readability. 29 | 30 | + [Add a command line flag to print binary version.](https://github.com/pingcap/tidb/pull/1896) 31 | 32 | + [Add a command line flag to prevent cartesian product.](https://github.com/pingcap/tidb/pull/1894) 33 | 34 | ## Notable changes to `TiKV` 35 | 36 | + [Compact region](https://github.com/pingcap/tikv/pull/1204) automatically after deleting lots of keys. 37 | + Remove the [`rocksdb` DSN](https://github.com/pingcap/tikv/pull/1209) for the `tikv-server` command flag. 38 | + Use an [atomic value](https://github.com/pingcap/tikv/pull/1210) to control the snapshot progress. 39 | + Add [timer](https://github.com/pingcap/tikv/pull/1211) for latch waiting. 40 | + [Check the region range](https://github.com/pingcap/tikv/pull/1219) before replicating a peer. 41 | + Make sure the [callback](https://github.com/pingcap/tikv/pull/1224) command is called. 42 | + Coprocessor supports the [`multiply` operator](https://github.com/pingcap/tikv/pull/1216). 43 | + Coprocessor supports the [`case when`operator](https://github.com/pingcap/tikv/pull/1227). 44 | + [Record the last compacted index](https://github.com/pingcap/tikv/pull/1230) to speed up compacting the Raft log. 45 | 46 | ## Notable changes to `Placement Driver` 47 | 48 | + Refactor store/region cache to make code clearer, including PR [353](https://github.com/pingcap/pd/pull/353), [365](https://github.com/pingcap/pd/pull/365), [366](https://github.com/pingcap/pd/pull/366). 49 | + Support the [`GetPDMembers`](https://github.com/pingcap/pd/pull/357) API. 50 | 51 | ## New contributors 52 | 53 | + [Librazy](https://github.com/Librazy) 54 | -------------------------------------------------------------------------------- /2016-11-07-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 31 ~ November 06, 2016) 3 | date: 2016-11-07 4 | summary: Last week, we landed 42 PRs in the TiDB repositories and 29 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update (October 31 ~ November 06, 2016) 9 | 10 | Last week, we landed [42 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-10-31..2016-11-06%20) in the TiDB repositories and [29 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-10-30..2016-11-05&type=Issues&ref=searchresults) in the TiKV repositories. 11 | 12 | # New release 13 | 14 | ## [TiDB Beta 4](https://github.com/pingcap/tidb/releases/tag/beta4) 15 | 16 | # Weekly update in TiDB 17 | 18 | ## Added 19 | 20 | + [The aggregation info to the explain statement.](https://github.com/pingcap/tidb/pull/1901) 21 | 22 | + [Support the show processlist syntax](https://github.com/pingcap/tidb/pull/1907). TiDB supports mydumper now. 23 | 24 | + [Support the show create database statement.](https://github.com/pingcap/tidb/pull/1911) 25 | 26 | + [Support the buildin function from_unixtime.](https://github.com/pingcap/tidb/pull/1929) 27 | 28 | + [Push down the aggregation operator to the position before join.](https://github.com/pingcap/tidb/pull/1899) 29 | 30 | + [Get cluster ID from Placement Driver.](https://github.com/pingcap/tidb/pull/1931) 31 | 32 | ## Fixed 33 | 34 | + [A bug in parser that misses the recognize identifier with leading digits.](https://github.com/pingcap/tidb/pull/1887) 35 | 36 | + [A bug in the `load data` command. ](https://github.com/pingcap/tidb/pull/1953) 37 | 38 | ## Improved 39 | 40 | + [The performance of the DropTable statement.](https://github.com/pingcap/tidb/pull/1888) 41 | 42 | + [The performance of the AddIndex statement.](https://github.com/pingcap/tidb/pull/1916) 43 | 44 | + [The query metrics.](https://github.com/pingcap/tidb/pull/1957) 45 | 46 | # Weekly update in TiKV 47 | 48 | ## Added 49 | 50 | + [Multiversion concurrency control (MVCC)](https://github.com/pingcap/tikv/pull/1196) support for `tikv-ctl`. 51 | + Support `-v`/`--version` to print the [version information](https://github.com/pingcap/pd/pull/369). 52 | + Metrics for MVCC [key versions and deleted key versions](https://github.com/pingcap/tikv/pull/1248). 53 | + Use random cluster ID to bootstrap clusters to avoid wrong joining cluster by the users, with PR [370](https://github.com/pingcap/pd/pull/370), [1257](https://github.com/pingcap/tikv/pull/1257) 54 | 55 | ## Fixed 56 | 57 | + [Panic directly](https://github.com/pingcap/tikv/pull/1266) if the RocksDB writes fail to fix [1262](https://github.com/pingcap/tikv/issues/1262). 58 | + Add the [`start`](https://github.com/pingcap/pd/pull/375) time for store monitor to fix [1207](https://github.com/pingcap/tikv/issues/1207). 59 | + [Return the 'no leader' error](https://github.com/pingcap/pd/pull/376/files) to avoid panic when calling the GetLeader API with no leader. 60 | 61 | ## Improved 62 | 63 | + [Skip values](https://github.com/pingcap/tikv/pull/1218) for scan. 64 | + Make cache code cleaner, with PR [365](https://github.com/pingcap/pd/pull/365), [366](https://github.com/pingcap/pd/pull/366), [367](https://github.com/pingcap/pd/pull/367). 65 | + Allow [liner reverse seek](https://github.com/pingcap/tikv/pull/1233) in the `lock` column family. 66 | + [Separate compaction](https://github.com/pingcap/tikv/pull/1242) to a different thread worker. 67 | + Avoid filling block cache when [scanning](https://github.com/pingcap/tikv/pull/1251). 68 | + Include [the snapshot size](https://github.com/pingcap/tikv/pull/1252) in the `used_size` store. 69 | + [Dump the RocksDB statistics](https://github.com/pingcap/tikv/pull/1254) with the SIGUSR1 signal. 70 | -------------------------------------------------------------------------------- /2016-11-14-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (November 07 ~ November 13, 2016) 3 | date: 2016-11-14 4 | summary: Last week, we landed 25 PRs in the TiDB repositories, 5 PRs in the TiDB docs repositories，and 23 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | Last week, we landed [25 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-11-07..2016-11-13) in the TiDB repositories and [5 PRs](https://github.com/pingcap/docs/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-11-07..2016-11-13) in the TiDB docs repositories. 9 | 10 | # Weekly update in TiDB 11 | 12 | ## Added 13 | 14 | + [Support the `Alter table modify column` statement.](https://github.com/pingcap/tidb/pull/1930) 15 | 16 | + [Support the `Drop view` statement](https://github.com/pingcap/tidb/pull/1969): parsed but ignored. 17 | 18 | + Add [metrics for the transaction size](https://github.com/pingcap/tidb/pull/1982). 19 | 20 | + [A tool for testing the SQL performance.](https://github.com/pingcap/tidb/pull/1920) 21 | 22 | ## Fixed 23 | 24 | + [A bug in the `show create table` statement.](https://github.com/pingcap/tidb/pull/1968) 25 | 26 | + A few bugs in optimizer: [#1962](https://github.com/pingcap/tidb/pull/1962), [#1963](https://github.com/pingcap/tidb/pull/1963), [#1966](https://github.com/pingcap/tidb/pull/1966), [#1975](https://github.com/pingcap/tidb/pull/1975), [#1977](https://github.com/pingcap/tidb/pull/1977). 27 | 28 | ## Improved 29 | 30 | + [Improve the cost-based optimizer.](https://github.com/pingcap/tidb/pull/1961) 31 | 32 | ## Document change 33 | 34 | + Adjust the [README](https://github.com/pingcap/docs) structure to include the document list 35 | 36 | + Add the following new guides: 37 | 38 | * [Data migration from MySQL to TiDB](https://pingcap.com/docs/dev/how-to/migrate/from-mysql/) 39 | 40 | * [Overview of the monitoring framework](https://pingcap.com/docs/dev/how-to/monitor/overview/) 41 | 42 | * Monitoring a TiDB cluster 43 | 44 | * [Compatibility with MySQL](https://pingcap.com/docs/dev/reference/mysql-compatibility/) 45 | 46 | 47 | # Weekly update in TiKV 48 | 49 | Last week, we landed [23 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-11-06..2016-11-12&type=Issues&ref=searchresults) in the TiKV repositories. 50 | 51 | ## Added 52 | 53 | + [Resolve locks](https://github.com/pingcap/tikv/pull/1271) in batches to avoid generating a huge Raft log when a transaction rolls back. 54 | 55 | + Add applying snapshot count to enhance the Placement Driver (PD) balance, with PR [1278](https://github.com/pingcap/tikv/pull/1278), [381](https://github.com/pingcap/pd/pull/381). 56 | 57 | + Check [the system configuration](https://github.com/pingcap/tikv/pull/1289) before startup. 58 | 59 | ## Fixed 60 | 61 | + Add a [start flag](https://github.com/pingcap/pd/pull/374) to check whether a balance starts or not to fix issue [343](https://github.com/pingcap/pd/issues/343). 62 | 63 | + Fix [the data inconsistency](https://github.com/pingcap/tikv/pull/1287) bug when applying snapshot and committed logs at same time. 64 | 65 | ## Improved 66 | 67 | + Refactor cache to access easily, with PR [359](https://github.com/pingcap/pd/pull/359), [379](https://github.com/pingcap/pd/pull/379). 68 | 69 | + Update [RocksDB config](https://github.com/pingcap/tikv/pull/1270) to let user configure it more easily. 70 | 71 | + Slow down Raft [heartbeat and election interval](https://github.com/pingcap/tikv/pull/1275) to reduce the system pressure. 72 | 73 | + Check [the PD list](https://github.com/pingcap/tikv/pull/1282) to ensure the address has a valid format. 74 | 75 | + Improve `tikv-ctl`, with PR [1273](https://github.com/pingcap/tikv/pull/1273), [1281](https://github.com/pingcap/tikv/pull/1281), [1295](https://github.com/pingcap/tikv/pull/1295). 76 | -------------------------------------------------------------------------------- /2016-11-21-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (November 14 ~ November 20, 2016) 3 | date: 2016-11-21 4 | summary: Last week, we landed 30 PRs in the TiDB repositories, 3 PRs in the TiDB docs repositories, and 19 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-11-14..2016-11-20) in the TiDB repositories, [3 PRs](https://github.com/pingcap/docs/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-11-14..2016-11-20%20) in the TiDB docs repositories. 11 | 12 | ## Added 13 | 14 | + Add [a session variable to skip unique constraint check](https://github.com/pingcap/tidb/pull/2031): This could be used when migrating data. 15 | 16 | + [More metrics for statement counter](https://github.com/pingcap/tidb/pull/1967). 17 | 18 | ## Fixed 19 | 20 | + [Use reserved keywords as the table/column name](https://github.com/pingcap/tidb/pull/2039). 21 | 22 | + [Add missing comments in the `show table status` result](https://github.com/pingcap/tidb/pull/2032). 23 | 24 | + [Fix a bug that gets duplicate `auto_inc` ID after truncating table.](https://github.com/pingcap/tidb/pull/2000). 25 | 26 | ## Improved 27 | 28 | + [Make the Explain result more explicit](https://github.com/pingcap/tidb/pull/2022). 29 | 30 | + [Tune the package size](https://github.com/pingcap/tidb/pull/2021) to be friendly for rocksdb. 31 | 32 | + [Use a better way to reload schema](https://github.com/pingcap/tidb/pull/2006) and reduce memory usage. 33 | 34 | + [Fetch schemas in a parallel way](https://github.com/pingcap/tidb/pull/1996) to make it faster when there are a huge number of schemas and tables. 35 | 36 | ## Document change 37 | 38 | Add the following new guides: 39 | 40 | * [Compatibility with MySQL](https://github.com/pingcap/docs/blob/df199ea8d08089c4459ec6e69df7332a80b612d7/sql/mysql-compatibility.md). 41 | 42 | * [Reading data from history versions](https://pingcap.com/docs/dev/how-to/get-started/read-historical-data/). 43 | 44 | # Weekly update in TiKV 45 | 46 | Last week, we landed [19 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-11-13..2016-11-19&type=Issues&ref=searchresults) in the TiKV repositories. 47 | 48 | ## Fixed 49 | 50 | + Check whether the [message is discarded](https://github.com/pingcap/tikv/pull/1316) after proposing. 51 | 52 | ## Improved 53 | 54 | + Still refactor cache to make it more easily to use, with PR [360](https://github.com/pingcap/pd/pull/360), [382](https://github.com/pingcap/pd/pull/382). 55 | 56 | + Add [lock Time To Live (TTL)](https://github.com/pingcap/tikv/pull/1302) for large transactions. 57 | 58 | + Try [updating the soft limit](https://github.com/pingcap/tikv/pull/1308) when requirement check fails. 59 | 60 | + Support configuring [fill cache](https://github.com/pingcap/tikv/pull/1309). 61 | 62 | + [Limit the WriteBatch size](https://github.com/pingcap/tikv/pull/1312) for the ResolveLock and Garbage Collection commands. 63 | 64 | + Clean up unnecessary [filter args](https://github.com/pingcap/pd/pull/387). 65 | 66 | + [Abstract a Selector](https://github.com/pingcap/pd/pull/388) to handle different strategies to select stores. 67 | 68 | + Enlarge the [latches size](https://github.com/pingcap/tikv/pull/1321) of the scheduler to reduce lock conflicts. 69 | -------------------------------------------------------------------------------- /2016-12-12-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (December 05 ~ December 11, 2016) 3 | date: 2016-12-12 4 | summary: Last week, we landed 41 PRs in the TiDB repositories and 34 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [41 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-12-05..2016-12-11%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | + [Support the built-in function: `str_to_date`. ](https://github.com/pingcap/tidb/pull/2078) 15 | 16 | + [Support built-in function schema().](https://github.com/pingcap/tidb/pull/2173) 17 | 18 | + [Support pushing the `case-when` expression to TiKV.](https://github.com/pingcap/tidb/pull/2171) 19 | 20 | + [Support changing the type and name of a column.](https://github.com/pingcap/tidb/pull/2174) 21 | 22 | + [Add the `](https://github.com/pingcap/tidb/pull/2194)[session_variables` and `plugins` of memory table to infoschema.](https://github.com/pingcap/tidb/pull/2194) 23 | 24 | + [Make the `union all` operator run parallelly.](https://github.com/pingcap/tidb/pull/2195) 25 | 26 | + [Support explaining the `union` statement.](https://github.com/pingcap/tidb/pull/2216) 27 | 28 | ## Fixed 29 | 30 | + [A bug that causes infinite loop.](https://github.com/pingcap/tidb/pull/2163) 31 | 32 | + [A bug in the `on duplicate…` statement when updating the primary key (PK)](https://github.com/pingcap/tidb/pull/2179) 33 | 34 | + [Make the charset name case-insensitive.](https://github.com/pingcap/tidb/pull/2184) 35 | 36 | + [Forbid dropping columns with the `auto_inc` and `PK` attribute.](https://github.com/pingcap/tidb/pull/2203) 37 | 38 | + [Fix bugs in the parser.](https://github.com/pingcap/tidb/pull/2210) 39 | 40 | ## Improved 41 | 42 | + [Pass the filter to TiKV when scanning indexes.](https://github.com/pingcap/tidb/pull/2166) 43 | 44 | + [Allocate column/index IDs in the table space](https://github.com/pingcap/tidb/pull/2205) to make the IDs shorter. 45 | 46 | # Weekly update in TiKV 47 | 48 | Last week, we landed [34 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-12-04..2016-12-10&type=Issues&ref=searchresults) in the TiKV repositories. 49 | 50 | ## Added 51 | 52 | + Support [online backup](https://github.com/pingcap/tikv/pull/1355) of the RocksDB data for `tikv-ctl` debugging. 53 | 54 | + Add [replication constraints](https://github.com/pingcap/pd/pull/402) to schedule replicas. 55 | 56 | + Support [`GrantLeaderScheduler`](https://github.com/pingcap/pd/pull/406) to transfer all leaders to one store. 57 | 58 | + Support [`ShuffleLeaderScheduler`](https://github.com/pingcap/pd/pull/409) to shuffle leaders in different stores. 59 | 60 | + Support Circle CI for [TiKV](https://github.com/pingcap/tikv/pull/1384) and [Placement Driver (PD)](https://github.com/pingcap/pd/pull/412). 61 | 62 | + Add the [state filter argument](https://github.com/pingcap/pd/pull/425) to get the stores API. 63 | 64 | ## Fixed 65 | 66 | + [Use `channel`](https://github.com/pingcap/tikv/pull/1375) to fix the possible stale snapshot state, issue [#1373](https://github.com/pingcap/tikv/issues/1373). 67 | 68 | + Report [`ServerIsBusy`](https://github.com/pingcap/tikv/pull/1390) and let [PD ignore the busy store](https://github.com/pingcap/pd/issues/420) when scheduling to fix [#414](https://github.com/pingcap/pd/issues/414). 69 | 70 | ## Improved 71 | 72 | + [Speed up the shutdown duration](https://github.com/pingcap/tikv/pull/1385) to reduce the close waiting time. 73 | 74 | + [Add retry](https://github.com/pingcap/pd/pull/417) when initializing the cluster ID. 75 | 76 | + Support [safe ConfChange](https://github.com/pingcap/tikv/pull/1398) to fix [#1366](https://github.com/pingcap/tikv/issues/1366). 77 | 78 | + [Report pending peers](https://github.com/pingcap/tikv/pull/1395) to PD to improve its scheduler. 79 | 80 | + [Bind ports lazily](https://github.com/pingcap/tikv/pull/1400) to avoid the message channel full error when starting up. 81 | 82 | -------------------------------------------------------------------------------- /2016-12-19-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (December 12 ~ December 18, 2016) 3 | date: 2016-12-19 4 | summary: Last week, we landed 32 PRs in the TiDB repositories and 11 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [32 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-12-12..2016-12-18) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | + [Add the `FlagIgnoreTruncate/FlagTruncateAsWarning` flag to control the behavior of truncated errors.](https://github.com/pingcap/tidb/pull/2212) 15 | 16 | + [Add the `prompt` text flag.](https://github.com/pingcap/tidb/pull/2227) 17 | 18 | + [Add the rawkv metrics](https://github.com/pingcap/tidb/pull/2228) to profile the rawkv API performance. 19 | 20 | + [Add a comparable varint encoding/decoding method](https://github.com/pingcap/tidb/pull/2236) to make encoded data smaller. 21 | 22 | + [Support the `timediff` built-in function.](https://github.com/pingcap/tidb/pull/2249) 23 | 24 | + [Support the following built-in functions](https://github.com/pingcap/tidb/pull/2258): ln(), log(), log2(), log10(). 25 | 26 | ## Fixed 27 | 28 | + [A bug that ignores primary key’s unsigned attribute.](https://github.com/pingcap/tidb/pull/2222) 29 | 30 | + [A bug that ignores error in the `distsql` layer.](https://github.com/pingcap/tidb/pull/2226) 31 | 32 | + [Allow default value to be Null when the column has the `auto_increament` attribute](https://github.com/pingcap/tidb/pull/2230) to be compatible with MySQL 5.6. 33 | 34 | + [A bug in the `insert` statement that ignores error.](https://github.com/pingcap/tidb/pull/2241) 35 | 36 | + Fix bugs in the cost-based optimization framework: [#2243](https://github.com/pingcap/tidb/pull/2243) 37 | 38 | ## Improved 39 | 40 | + Refactor the time type related code: [#2185](https://github.com/pingcap/tidb/pull/2185), [#2190](https://github.com/pingcap/tidb/pull/2190), [#2206](https://github.com/pingcap/tidb/pull/2206), [#2233](https://github.com/pingcap/tidb/pull/2233), [#2261](https://github.com/pingcap/tidb/pull/2261) 41 | 42 | + [Remove the util/bytes package](https://github.com/pingcap/tidb/pull/2221) to clean up the code. 43 | 44 | + Refactor the code to remove the `evaluator.Eval()` method: [#2222](https://github.com/pingcap/tidb/pull/2222), 45 | 46 | + [Improve test coverage for the `util/segmentmap` package.](https://github.com/pingcap/tidb/pull/2235) 47 | 48 | + [Recover from panics caused by malformated mysql packet](https://github.com/pingcap/tidb/pull/2267) to make tidb-server more robust. 49 | 50 | ## New contributor 51 | 52 | + [Bai Yang](https://github.com/hamo) 53 | 54 | # Weekly update in TiKV 55 | 56 | Last week, we landed [11 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-12-11..2016-12-17&type=Issues&ref=searchresults) in the TiKV repositories. 57 | 58 | ## Added 59 | 60 | + Add a configuration to [disable data sync](https://github.com/pingcap/tikv/pull/1369) to speed up loading data. 61 | 62 | + Filter [the pending peers](https://github.com/pingcap/pd/pull/421) for Placement Driver (PD) scheduler. 63 | 64 | + Add [`pd-ctl`](https://github.com/pingcap/pd/pull/431) to operate PD more easily. 65 | 66 | ## Fixed 67 | 68 | + Update [the advertise peer urls](https://github.com/pingcap/pd/pull/438) from etcd to fix [#435](https://github.com/pingcap/pd/issues/435). 69 | 70 | ## Improved 71 | 72 | + [Read and verify snapshot](https://github.com/pingcap/tikv/pull/1381) file in one step. 73 | 74 | + Use a [smaller interval](https://github.com/pingcap/tikv/pull/1401) to make Raft tick more accurate. 75 | 76 | + Clean up [the tombstone store](https://github.com/pingcap/pd/issues/428) to fix [#401](https://github.com/pingcap/pd/issues/401). 77 | 78 | + Use [`delete_file_in_range`](https://github.com/pingcap/tikv/pull/1409) when clean up the tombstone regions. 79 | 80 | -------------------------------------------------------------------------------- /2016-12-26-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (December 19 ~ December 25, 2016) 3 | date: 2016-12-26 4 | summary: TiDB RC1 is released! Last week, we landed 34 PRs in the TiDB repositories and 14 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # New Release 9 | 10 | [TiDB RC1](https://github.com/pingcap/tidb/releases/tag/rc1) is released! 11 | 12 | # Weekly update in TiDB 13 | 14 | Last week, we landed [34 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-12-19..2016-12-25%20) in the TiDB repositories. 15 | 16 | ## Added 17 | 18 | * [Support the `RPAD` built-in function.](https://github.com/pingcap/tidb/pull/2270). 19 | 20 | * [Support the `show keys from table from database` statement.](https://github.com/pingcap/tidb/pull/2308) 21 | 22 | ## Fixed 23 | 24 | * [Retry infinite times if the commit primary key times out.](https://github.com/pingcap/tidb/pull/2276) 25 | 26 | * [Do not push aggregation down to the memory tables.](https://github.com/pingcap/tidb/pull/2296) 27 | 28 | * [Fix a bug about the `alter table` statement](https://github.com/pingcap/tidb/pull/2297). 29 | 30 | ## Improved 31 | 32 | * Refactor the time type related code: [#2259](https://github.com/pingcap/tidb/pull/2259), [#2280](https://github.com/pingcap/tidb/pull/2280), [#2284](https://github.com/pingcap/tidb/pull/2284), #2289, [#2292](https://github.com/pingcap/tidb/pull/2292) 33 | 34 | * Refactor optimizer: [extract initialization related code into physical Initialization.](https://github.com/pingcap/tidb/pull/2263) 35 | 36 | * [Speed up the DDL statement.](https://github.com/pingcap/tidb/pull/2268) 37 | 38 | * [Avoid generating `parser.go` every time.](https://github.com/pingcap/tidb/pull/2281) 39 | 40 | * [Skip the constraint check ](https://github.com/pingcap/tidb/pull/2288)for prewrite to improve the loading data speed. 41 | 42 | * [Speed up the `add index` statement.](https://github.com/pingcap/tidb/pull/2309) 43 | 44 | ## New contributor 45 | 46 | * [silentred](https://github.com/silentred) 47 | 48 | # Weekly update in TiKV 49 | 50 | Last week, We landed [14 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-12-18..2016-12-25&type=Issues&ref=searchresults) in the TiKV repositories. 51 | 52 | ## Added 53 | 54 | * Add configuration to control the [replica scheduling speed](https://github.com/pingcap/pd/pull/426). 55 | 56 | * [Skip constraint check](https://github.com/pingcap/tikv/pull/1411) for prewrite to improve the loading data speed. 57 | 58 | * Add [region and store commands](https://github.com/pingcap/pd/pull/439) to pd-ctl. 59 | 60 | * Add [configuration](https://github.com/pingcap/tikv/pull/1422) to cache index and filter blocks in the block cache. 61 | 62 | ## Fixed 63 | 64 | * [Report snapshot](https://github.com/pingcap/tikv/pull/1394) sending status reliably to fix [#1377](https://github.com/pingcap/tikv/issues/1377). 65 | 66 | * Store [short value](https://github.com/pingcap/tikv/pull/1407) in write cf directly to save space and improve performance. 67 | 68 | ## Improved 69 | 70 | * Remove unnecessary [admin operators](https://github.com/pingcap/pd/pull/427). 71 | 72 | * Handle Raft ready [append log](https://github.com/pingcap/tikv/pull/1420)[ in one WriteBatch](https://github.com/pingcap/tikv/pull/1420) to reduce the CPU usage and improve performance. 73 | 74 | * [Remove the down peer first](https://github.com/pingcap/pd/pull/446) when scheduling replicas. 75 | 76 | -------------------------------------------------------------------------------- /2017-01-01-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (December 26 ~ January 01, 2017) 3 | date: 2017-01-01 4 | summary: Last week, we landed 28 PRs in the TiDB repositories and 19 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [28 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2016-12-26..2017-01-01%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Support the `CHAR_LENGTH` built-in function.](https://github.com/pingcap/tidb/pull/2323) 15 | 16 | * [Support the `CRC32` built-in function.](https://github.com/pingcap/tidb/pull/2347) 17 | 18 | * [Support the `LEAST` built-in function.](https://github.com/pingcap/tidb/pull/2360) 19 | 20 | ## Fixed 21 | 22 | * [Fix a bug in Add Column with invalid default value.](https://github.com/pingcap/tidb/pull/2316) 23 | 24 | * [Fix a bug about parsing string to float.](https://github.com/pingcap/tidb/pull/2337) 25 | 26 | * [Fix a bug when using int and uint as join key.](https://github.com/pingcap/tidb/pull/2355) 27 | 28 | * [Fix a bug in MySQL Protocol layer about prepared statement.](https://github.com/pingcap/tidb/pull/2351) 29 | 30 | ## Improved 31 | 32 | * [Improve string to date parser.](https://github.com/pingcap/tidb/pull/2310) 33 | 34 | * [Improve TiDB schema lease checker.](https://github.com/pingcap/tidb/pull/2137) 35 | 36 | * Refactor optimizer: [#2321](https://github.com/pingcap/tidb/pull/2321), [#2322](https://github.com/pingcap/tidb/pull/2322) 37 | 38 | * [Set a limitation on the quantity of the data in a single transaction.](https://github.com/pingcap/tidb/pull/2325) 39 | 40 | * [Improve mocked tikv](https://github.com/pingcap/tidb/pull/2331): Split data in a table into multiple mocked regions. This will used in unit tests. 41 | 42 | * [Speed up creating table](https://github.com/pingcap/tidb/pull/2332): In some cases, it is not necessary to wait a long time to create table. 43 | 44 | * [Use MySQL standard error code when meeting incorrect function argument count error.](https://github.com/pingcap/tidb/pull/2335) 45 | 46 | * [Find a better way to handle StoreNotMatch error.](https://github.com/pingcap/tidb/pull/2339) 47 | 48 | * Refactor built-in function: [#2343](https://github.com/pingcap/tidb/pull/2343), [#2344](https://github.com/pingcap/tidb/pull/2344), [#2362](https://github.com/pingcap/tidb/pull/2362), [#2367](https://github.com/pingcap/tidb/pull/2367) 49 | 50 | * Clean up tidb-server codes: [#2356](https://github.com/pingcap/tidb/pull/2356), [#2358](https://github.com/pingcap/tidb/pull/2358) 51 | 52 | ## New contributor 53 | 54 | * [Zyguan](https://github.com/zyguan) 55 | 56 | * [AndreMouche](https://github.com/AndreMouche) 57 | 58 | # Weekly update in TiKV 59 | 60 | Last week, We landed [19 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2016-12-26..2017-01-01&type=Issues&ref=searchresults) in the TiKV repositories. 61 | 62 | ## Added 63 | 64 | * Move `raw_get` to [thread pool](https://github.com/pingcap/tikv/pull/1434). 65 | 66 | * Add `ResourceKind` for operator and don't resend duplicated `AddPeer` response when the peer is still pending, see [#449](https://github.com/pingcap/pd/pull/449). 67 | 68 | * Add [member command](https://github.com/pingcap/pd/pull/455) for `pd-ctl`. 69 | 70 | ## Fixed 71 | 72 | * Fix getting [valid float](https://github.com/pingcap/tikv/pull/1454). 73 | 74 | ## Improved 75 | 76 | * Update default configuration to [speed up scheduler](https://github.com/pingcap/pd/pull/452). 77 | 78 | * [Don't panic](https://github.com/pingcap/tikv/pull/1443) when receiving stale snapshot. 79 | 80 | * Remove unnecessary [region cache](https://github.com/pingcap/pd/pull/457). 81 | 82 | * Remove no used [constraint feature](https://github.com/pingcap/pd/pull/458). 83 | 84 | * [Exit](https://github.com/pingcap/tikv/pull/1451) with error message if clusert ID mismatches directly. 85 | 86 | * Add [replication section](https://github.com/pingcap/pd/pull/460) in configuration. 87 | -------------------------------------------------------------------------------- /2017-02-05-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 23 ~ February 05, 2017) 3 | date: 2017-02-05 4 | summary: Last two weeks, we landed 43 PRs in the TiDB repositories and 20 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last two weeks, we landed [43 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-01-23..2017-02-05%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Support information_schema.table_constraints.](https://github.com/pingcap/tidb/pull/2586) 15 | 16 | * [Support the `UTC_TIMESTAMP` builtin function](https://github.com/pingcap/tidb/pull/2592) 17 | 18 | * [Increase transaction entry count limit.](https://github.com/pingcap/tidb/pull/2537) 19 | 20 | * Add logs for expensive query and big transaction: [2536](https://github.com/pingcap/tidb/pull/2536), [2545](https://github.com/pingcap/tidb/pull/2545), [2546](https://github.com/pingcap/tidb/pull/2546) 21 | 22 | ## Fixed 23 | 24 | * [Fix GC lifetime metrics.](https://github.com/pingcap/tidb/pull/2587) 25 | 26 | * [Fix primary key name parsing.](https://github.com/pingcap/tidb/pull/2582) 27 | 28 | * [Fix a bug of left outer semi join.](https://github.com/pingcap/tidb/pull/2573) 29 | 30 | * [Fix a bug of exists sub query.](https://github.com/pingcap/tidb/pull/2549) 31 | 32 | * [Fix a bug abaout prefix index.](https://github.com/pingcap/tidb/pull/2445) 33 | 34 | ## Improved 35 | 36 | * [Only plans that have apply will add cache.](https://github.com/pingcap/tidb/pull/2564) 37 | 38 | * [Use a short-cut way to way And/Or/Xor expresson.](https://github.com/pingcap/tidb/pull/2561) 39 | 40 | * [Refine the range calculating.](https://github.com/pingcap/tidb/pull/2534) 41 | 42 | # Weekly update in TiKV 43 | 44 | Last two weeks, we landed [20 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-01-22..2017-02-04&type=Issues&ref=searchresults) in the TiKV repositories. 45 | 46 | ## Added 47 | 48 | + Add [`start_ts`](https://github.com/pingcap/tikv/pull/1511) for scan in `tikv-ctl`. 49 | 50 | + Support [HTTP scheme](https://github.com/pingcap/tikv/pull/1543) parsing. 51 | 52 | ## Fixed 53 | 54 | + Fix [too long](https://github.com/pingcap/tikv/pull/1566) scan slow log. 55 | 56 | ## Improved 57 | 58 | + Use [`reverse_seek_le`](https://github.com/pingcap/tikv/pull/1498) for the reverse seek write. 59 | 60 | + [Ignore overwriting data](https://github.com/pingcap/tikv/pull/1500) in `prewrite`. 61 | 62 | + [Update raft in raftstore](https://github.com/pingcap/tikv/pull/1540) after handling ConfChange. 63 | 64 | + Make [coprocessor task](https://github.com/pingcap/tikv/pull/1551) run more concurrently. 65 | 66 | + [Ignore deleting the value](https://github.com/pingcap/tikv/pull/1553) when roll back `lock`. 67 | 68 | + [Update leader lease](https://github.com/pingcap/tikv/pull/1560) before applying raft log. 69 | -------------------------------------------------------------------------------- /2017-02-13-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (February 06 ~ February 12, 2017) 3 | date: 2017-02-13 4 | summary: Last two weeks, we landed 25 PRs in the TiDB repositories and 14 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last two weeks, we landed [25 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-02-06..2017-02-12%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * Support basic privilege framework: [#2423](https://github.com/pingcap/tidb/pull/2423), [#2557](https://github.com/pingcap/tidb/pull/2557), [#2603](https://github.com/pingcap/tidb/pull/2603), [#2607](https://github.com/pingcap/tidb/pull/2607), 15 | 16 | * [Support `ALTER [COLUMN] col_name SET DEFAULT` statement.](https://github.com/pingcap/tidb/pull/2608) 17 | 18 | * [Validate column default value when creating table.](https://github.com/pingcap/tidb/pull/2614) 19 | 20 | * [Support `ALTER TABLE ... DROP DEFAULT` statement.](https://github.com/pingcap/tidb/pull/2616) 21 | 22 | * [Support changing default value and comment in alter table statement.](https://github.com/pingcap/tidb/pull/2621) 23 | 24 | ## Fixed 25 | 26 | * [Fix build on i386.](https://github.com/pingcap/tidb/pull/2591) 27 | 28 | * [Fix output format of prometheus interval log.](https://github.com/pingcap/tidb/pull/2594) 29 | 30 | * Clean up log: [#2599](https://github.com/pingcap/tidb/pull/2599), [#2601](https://github.com/pingcap/tidb/pull/2601) 31 | 32 | * [Fix a bug in HashJoin executor](https://github.com/pingcap/tidb/pull/2605): some errors are ignored. 33 | 34 | * [Fix a bug in arithmetic expression type inference.](https://github.com/pingcap/tidb/pull/2610) 35 | 36 | * [Fix a bug in builtin function timediff.](https://github.com/pingcap/tidb/pull/2611) 37 | 38 | 39 | ## Improved 40 | 41 | * [Speed up unit tests.](https://github.com/pingcap/tidb/pull/2590) 42 | 43 | * Make test cases more stable: [#2595](https://github.com/pingcap/tidb/pull/2595), [#2596](https://github.com/pingcap/tidb/pull/2596) 44 | 45 | * [Remove useless code in parser package.](https://github.com/pingcap/tidb/pull/2604) 46 | 47 | * [Change string default collation to utf8_bin.](https://github.com/pingcap/tidb/pull/2617) We do not support case insensitive comparation yet. 48 | 49 | # Weekly update in TiKV 50 | 51 | Last week, We landed [14 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-02-05..2017-02-11&type=Issues&ref=searchresults) in the TiKV repositories. 52 | 53 | ## Added 54 | 55 | * Use [`seek_for_prev`](https://github.com/pingcap/tikv/pull/1581) directly. 56 | 57 | * Refactor [`cut_row` and `cut_idx_key`](https://github.com/pingcap/tikv/pull/1590) for row value analysis in coprocessor. 58 | 59 | * Extract an [interface](https://github.com/pingcap/tikv/pull/1579) to support different snapshot format. 60 | 61 | ## Fixed 62 | 63 | * Fix panic when [stop scheduler](https://github.com/pingcap/tikv/pull/1580) worker. 64 | 65 | * Fix [invalid link](https://github.com/pingcap/pd/pull/500) in PD readme. 66 | 67 | ## Improved 68 | 69 | * Evaluate [logic operations](https://github.com/pingcap/tikv/pull/1565) lazily. 70 | 71 | * Use [prefix seek](https://github.com/pingcap/tikv/pull/1509) to speed up read for Write CF. 72 | 73 | * Separate [`advance` to `advance_ready` and `advance_apply`](https://github.com/pingcap/tikv/pull/1573) for async-apply later. 74 | 75 | * Use [`shutdown`](https://github.com/pingcap/tikv/pull/1586) to do cleanup when stop worker. 76 | -------------------------------------------------------------------------------- /2017-03-06-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (February 27 ~ March 05, 2017) 3 | date: 2017-03-06 4 | summary: Last week, we landed 21 PRs in the TiDB repositories and 8 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [21 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-02-27..2017-03-05%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Add metrics for related region count for a transaction.](https://github.com/pingcap/tidb/pull/2701) 15 | 16 | * [Record sql_mode in session context.](https://github.com/pingcap/tidb/pull/2739) 17 | 18 | * [Support `Show Processlist`.](https://github.com/pingcap/tidb/pull/2744) 19 | 20 | * [Add an empty `Triggers` table in information_schema database.](https://github.com/pingcap/tidb/pull/2749) 21 | 22 | * [Support `ANSI_QUOTES` sql_mode in parser.](https://github.com/pingcap/tidb/pull/2754) 23 | 24 | * [Support use wildcard as user hostname in grant statement.](https://github.com/pingcap/tidb/pull/2757) 25 | 26 | * [Support the `MD5` builtin function.](https://github.com/pingcap/tidb/pull/2780) 27 | 28 | * [Support the `SHA/SHA1` builtin function.](https://github.com/pingcap/tidb/pull/2781) 29 | 30 | 31 | ## Fixed 32 | 33 | * [Use `PI` as identifier](https://github.com/pingcap/tidb/pull/2763) 34 | 35 | * [Fix a panic in prepared statement.](https://github.com/pingcap/tidb/pull/2767) 36 | 37 | 38 | ## Improved 39 | 40 | * [Use unique key to eliminate aggregation.](https://github.com/pingcap/tidb/pull/2702) 41 | 42 | * [Tuning tikv client max timeout parameter.](https://github.com/pingcap/tidb/pull/2746) 43 | 44 | * [Adjust log level in tikv client.](https://github.com/pingcap/tidb/pull/2765) 45 | 46 | 47 | # Weekly update in TiKV 48 | 49 | Last week, We landed [8 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-02-26..2017-03-04+&type=Issues&ref=searchresults) in the TiKV repositories. 50 | 51 | ## Added 52 | 53 | * Use [ReadIndex](https://github.com/pingcap/tikv/pull/1642) to serve safe Raft read. 54 | 55 | * Add [`tso`](https://github.com/pingcap/pd/pull/550) command for `pd-ctl`. 56 | 57 | * Add [ServerIsBusy](https://github.com/pingcap/tikv/pull/1660) metric. 58 | 59 | ## Fixed 60 | 61 | * Fix a [data race](https://github.com/pingcap/pd/pull/552) when update configuration. 62 | 63 | ## Improved 64 | 65 | * [Notify PD](https://github.com/pingcap/tikv/pull/1658) immediately when leader changes. 66 | 67 | * Make scheduler [TooBusy threshold](https://github.com/pingcap/tikv/pull/1666) configurable. 68 | -------------------------------------------------------------------------------- /2017-03-13-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (March 06 ~ March 12, 2017) 3 | date: 2017-03-13 4 | summary: Last week, we landed 30 PRs in the TiDB repositories and 13 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-03-06..2017-03-12%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Add context in exector](https://github.com/pingcap/tidb/pull/2748): prepare for canceling execution. 15 | 16 | * [Support the `KILL` statement.](https://github.com/pingcap/tidb/pull/2768) 17 | 18 | * [Support string literal with in the national character set `N'literal'`.](https://github.com/pingcap/tidb/pull/2773) 19 | 20 | * [Check privilege when running create user statement.](https://github.com/pingcap/tidb/pull/2785) 21 | 22 | * [Add a session variable to prevent eager aggregation.](https://github.com/pingcap/tidb/pull/2809) 23 | 24 | ## Fixed 25 | 26 | * [Clean up pending task when close executor](https://github.com/pingcap/tidb/pull/2775): fix memory leak. 27 | 28 | * [Make the type of coalesce function the same with MySQL.](https://github.com/pingcap/tidb/pull/2788) 29 | 30 | * [Clean up process info when finish running statement.](https://github.com/pingcap/tidb/pull/2790) 31 | 32 | * [Fix a bug in optimizer about pushing down limit across filter.](https://github.com/pingcap/tidb/pull/2793) 33 | 34 | * [Fix a bug in optimizer about column prunning on union statement.](https://github.com/pingcap/tidb/pull/2796) 35 | 36 | * [Use `QUOTE` as an identifier.](https://github.com/pingcap/tidb/pull/2805) 37 | 38 | 39 | ## Improved 40 | 41 | * [Create user automatically when grant privilege for unexist user.](https://github.com/pingcap/tidb/pull/2756) 42 | 43 | * [Speed up Add Column statement.](https://github.com/pingcap/tidb/pull/2769) 44 | 45 | * [Update grpc version to v1.0.4 in vendor.](https://github.com/pingcap/tidb/pull/2784) 46 | 47 | * [Avoid useless schema version update when running DDL.](https://github.com/pingcap/tidb/pull/2786) 48 | 49 | * [Add metrics for potential time-consuming queries.](https://github.com/pingcap/tidb/pull/2795) 50 | 51 | 52 | 53 | # Weekly update in TiKV 54 | 55 | Last week, We landed [13 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-03-05..2017-03-11&type=Issues&ref=searchresults) in the TiKV repositories. 56 | 57 | ## Added 58 | 59 | * Add [metric](https://github.com/pingcap/tikv/pull/1657) for RocksDB compaction. 60 | 61 | * Collect [scanned key count](https://github.com/pingcap/tikv/pull/1661) to detect region access hotspot. 62 | 63 | * Support [`GetRegionByID`](https://github.com/pingcap/pd/pull/555) for `pd-ctl`. 64 | 65 | * Enable [AutoCompactionRetention](https://github.com/pingcap/pd/pull/562) to reduce PD space occupation. 66 | 67 | ## Fixed 68 | 69 | * [Reduce manual compaction](https://github.com/pingcap/tikv/pull/1664) for Lock CF to avoid too many WAL logs. 70 | 71 | * Only check scheduler busy error for [Write](https://github.com/pingcap/tikv/pull/1668) command. 72 | 73 | * Fix [data race](https://github.com/pingcap/pd/pull/559) for updating replication configuration. 74 | 75 | * Prohibit joining the PD cluster with [empty](https://github.com/pingcap/pd/pull/564) name. 76 | 77 | ## Improved 78 | 79 | * [Beautify](https://github.com/pingcap/pd/pull/554) region log. 80 | 81 | * [Cleanup](https://github.com/pingcap/tikv/pull/1662) iterator creation. 82 | 83 | * Adjust [default leader scheduler limit](https://github.com/pingcap/pd/pull/566) to speed up leader balance. 84 | -------------------------------------------------------------------------------- /2017-03-20-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (March 13 ~ March 19, 2017) 3 | date: 2017-03-20 4 | summary: Last week, we landed 33 PRs in the TiDB repositories and 10 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [33 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-03-13..2017-03-19%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Add system table `mysql.stats_meta`](https://github.com/pingcap/tidb/pull/2766): used for storing statistic information. 15 | 16 | * [Add a Restful API to get region info from pd.](https://github.com/pingcap/tidb/pull/2774) 17 | 18 | * [Add a system variable to control the behavior of unfolding subquery in `in` expression.](https://github.com/pingcap/tidb/pull/2816) 19 | 20 | * Add many builtin functions: [`acos, asin, atan`](https://github.com/pingcap/tidb/pull/2828), [`make_set`](https://github.com/pingcap/tidb/pull/2831), [`oct`](https://github.com/pingcap/tidb/pull/2835), [`pi`](https://github.com/pingcap/tidb/pull/2836), [`lpad`](https://github.com/pingcap/tidb/pull/2838), [`radians`](https://github.com/pingcap/tidb/pull/2841), [`exp`](https://github.com/pingcap/tidb/pull/2847), [`ip_v6`](https://github.com/pingcap/tidb/pull/2872) 21 | 22 | ## Fixed 23 | 24 | * [Check truncated UTF8 string when casting value.](https://github.com/pingcap/tidb/pull/2819) 25 | 26 | * [Fix data race.](https://github.com/pingcap/tidb/pull/2833) 27 | 28 | * [Stop the service when meet critical error.](https://github.com/pingcap/tidb/pull/2854) 29 | 30 | * [Keep the return value of builtin function `conv` consistent with MySQL when meet invalid input.](https://github.com/pingcap/tidb/pull/2842) 31 | 32 | ## Improved 33 | 34 | * [Refactor tikv coprocessor client:](https://github.com/pingcap/tidb/pull/2804) make code cleaner and fix memory leak. 35 | 36 | * [Refactor code about aggregation pushdown and aggregation prunning:](https://github.com/pingcap/tidb/pull/2820) make code cleaner. 37 | 38 | 39 | ## New Contributors 40 | 41 | **Thank you guys!** 42 | 43 | * [Huxley Hu](https://github.com/framlog) 44 | 45 | * [Zhao Yi Jun](https://github.com/ariesdevil) 46 | 47 | * [silenceper](https://github.com/silenceper) 48 | 49 | * [Rick Yu](https://github.com/cosmtrek) 50 | 51 | * [Qiannan](https://github.com/hsqlu) 52 | 53 | * [Tao Meng](https://github.com/mtunique) 54 | 55 | * [yangwenmai](https://github.com/yangwenmai) 56 | 57 | * [Hongyuan Wang](https://github.com/yuanwhy) 58 | 59 | * [8cbx](https://github.com/8cbx) 60 | 61 | * [alston111111](https://github.com/alston111111) 62 | 63 | * [Du Chuan](https://github.com/spongedu) 64 | 65 | # Weekly update in TiKV 66 | 67 | Last week, We landed [10 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-03-12..2017-03-18&type=Issues&ref=searchresults) in the TiKV repositories. 68 | 69 | ## Added 70 | 71 | * Use [`SSE`](https://github.com/pingcap/tikv/pull/1677) support by default. 72 | 73 | * Handle [`CTRL + D`] in `pd-ctl` (https://github.com/pingcap/pd/pull/570) 74 | 75 | ## Fixed 76 | 77 | * [Avoid panic](https://github.com/pingcap/pd/pull/567) when get the tombstone store information. 78 | 79 | * [Check epoch](https://github.com/pingcap/tikv/pull/1682) in ReadIndex to avoid stale read. 80 | 81 | * [Clean ReadIndex callback](https://github.com/pingcap/tikv/pull/1683) when peer is destroyed to avoid deadlock. 82 | 83 | ## Improved 84 | 85 | * [Queue vote](https://github.com/pingcap/tikv/pull/1670) to prevent followers from discarding it if region hasn’t been split. 86 | 87 | * Improve [random picking](https://github.com/pingcap/pd/pull/565) region from cache. 88 | -------------------------------------------------------------------------------- /2017-04-17-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 10 ~ April 16, 2017) 3 | date: 2017-04-17 4 | summary: Last week, we landed 26 PRs in the TiDB repositories and 18 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [26 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-04-10..2017-04-16%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Update etcd client in vendor.](https://github.com/pingcap/tidb/pull/3032) 15 | 16 | * Add builtin function [`time-to-sec`](https://github.com/pingcap/tidb/pull/2987) 17 | 18 | * Add definition for builtin functions: [`bit_count `, `to_base64 `, `right `](https://github.com/pingcap/tidb/pull/3016/files) 19 | 20 | 21 | ## Fixed 22 | 23 | * [Fix the error message for data overflow.](https://github.com/pingcap/tidb/pull/3017) 24 | 25 | * [Fix a panic.](https://github.com/pingcap/tidb/pull/3020) 26 | 27 | * [Fix a bug in top-n pushdown.](https://github.com/pingcap/tidb/pull/3021) 28 | 29 | * [Fix a data race bug in session context.](https://github.com/pingcap/tidb/pull/3049) 30 | 31 | * [Fix a bug in name resolver for GroupBy clause.](https://github.com/pingcap/tidb/pull/3050) 32 | 33 | 34 | ## Improved 35 | 36 | * Refactor optimizer: [Implement new planner interface for projection and sort.](https://github.com/pingcap/tidb/pull/3006) 37 | 38 | * Refactor statistic module.[#3014](https://github.com/pingcap/tidb/pull/3014), [#3019](https://github.com/pingcap/tidb/pull/3019), [#3029](https://github.com/pingcap/tidb/pull/3029), [#3031](https://github.com/pingcap/tidb/pull/3031), [#3044](https://github.com/pingcap/tidb/pull/3044), [#3048](https://github.com/pingcap/tidb/pull/3048), [#3053](https://github.com/pingcap/tidb/pull/3053) 39 | 40 | * Refactor coprocessor architecture: [#3009](https://github.com/pingcap/tidb/pull/3009), [#3027](https://github.com/pingcap/tidb/pull/3027) 41 | 42 | * [Use etcd for privilege update notification among tidb-servers.](https://github.com/pingcap/tidb/pull/3030) 43 | 44 | * [Enlarge the limitation of write flow to TiKV.](https://github.com/pingcap/tidb/pull/3035) 45 | 46 | * [Reduce memory usage in HashAggregate operator.](https://github.com/pingcap/tidb/pull/3028) 47 | 48 | * [Reduce memory usage in Distinct operator.](https://github.com/pingcap/tidb/pull/3033) 49 | 50 | * [Code cleanup in type infer.](https://github.com/pingcap/tidb/pull/3039) 51 | 52 | ## New Contributors 53 | 54 | **Thank you guys!** 55 | 56 | * [Xuanwo](https://github.com/Xuanwo) 57 | 58 | * [fudali113](https://github.com/fudali113) 59 | 60 | # Weekly update in TiKV 61 | 62 | Last week, We landed [18 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-04-09..2017-04-15&type=Issues) in the TiKV repositories. 63 | 64 | ## Added 65 | 66 | * Support [memory profiling](https://github.com/pingcap/tikv/pull/1723). 67 | 68 | * Add [block cache](https://github.com/pingcap/tikv/pull/1739) monitoring. 69 | 70 | * Add log for [critical](https://github.com/pingcap/pd/pull/610) operations. 71 | 72 | * Use `tokio-core` to support asynchronous PD client, see [1745](https://github.com/pingcap/tikv/pull/1745), [1752](https://github.com/pingcap/tikv/pull/1752), [1753](https://github.com/pingcap/tikv/pull/1753). 73 | 74 | ## Fixed 75 | 76 | * Always [update PD client](https://github.com/pingcap/tikv/pull/1759) to avoid the problem that PD client can not reconnect to PD server after network error. 77 | 78 | * Fix the bug when [decode empty data](https://github.com/pingcap/pd/pull/617) to a `StringSlice`. 79 | 80 | * Fix a [deadlock](https://github.com/pingcap/tikv/pull/1768) bug when PD client reconnects server. 81 | 82 | ## Improved 83 | 84 | * Add lots of test cases to improve stability, see [1737](https://github.com/pingcap/tikv/pull/1737) , [1738](https://github.com/pingcap/tikv/pull/1738), [1742](https://github.com/pingcap/tikv/pull/1742). 85 | -------------------------------------------------------------------------------- /2017-05-15-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (May 08 ~ May 14, 2017) 3 | date: 2017-05-15 4 | summary: Last week, we landed 28 PRs in the TiDB repositories and 17 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [28 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-05-08..2017-05-14%20) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * Add builtin function [`uncompress` and `uncompressdlength`](https://github.com/pingcap/tidb/pull/3136), [`convert_tz`](https://github.com/pingcap/tidb/pull/3222), [`period-diff`](https://github.com/pingcap/tidb/pull/3237) 15 | 16 | * [Fill data into `information_schema.key_column_usage`.](https://github.com/pingcap/tidb/pull/2721) 17 | 18 | * [Add `Open` interface for Executor.](https://github.com/pingcap/tidb/pull/3221) 19 | 20 | * [Show warnings for `Load Data` statement.](https://github.com/pingcap/tidb/pull/3224) 21 | 22 | * [Support `Json` type and functions in parser.](https://github.com/pingcap/tidb/pull/3228) 23 | 24 | * [Support `top-n` operator in new planner.](https://github.com/pingcap/tidb/pull/3242) 25 | 26 | ## Fixed 27 | 28 | * [Consider session variable `time_zone` for timestamp datum.](https://github.com/pingcap/tidb/pull/3167) 29 | 30 | * [Fix data race problem in IndexLookup Executor.](https://github.com/pingcap/tidb/pull/3212) 31 | 32 | * [Fix a bug in HashJoin Executor encoding/decoding.](https://github.com/pingcap/tidb/pull/3225) 33 | 34 | * [Return right value for `@@version`.](https://github.com/pingcap/tidb/pull/3238) 35 | 36 | ## Improved 37 | 38 | * [Refator range calculation related code.](https://github.com/pingcap/tidb/pull/3208) 39 | 40 | * Refactor expression evaluation framework: [Add self attribute in builtin function.](https://github.com/pingcap/tidb/pull/3218)[Return panic when calling wrong function on baseXBuiltinFunc.](https://github.com/pingcap/tidb/pull/3247) 41 | 42 | # Weekly update in TiKV 43 | 44 | Last week, We landed [17 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-05-07..2017-05-13&type=Issues) in the TiKV repositories. 45 | 46 | ## Added 47 | 48 | * Use [`clap`](https://github.com/pingcap/tikv/pull/1806) to parse command line options. 49 | 50 | * Show TiKV instance [downtime](https://github.com/pingcap/pd/pull/633) state in `pd-ctl`. 51 | 52 | * Show [scheduling operation history](https://github.com/pingcap/pd/pull/637) in `pd-ctl`. 53 | 54 | * Show [cluster ID](https://github.com/pingcap/pd/pull/640) in `pd-ctl`. 55 | 56 | * Introduce [`SmallGroupFirstQueue`](https://github.com/pingcap/tikv/pull/1822) to speedup point get later. 57 | 58 | * Use [zstd](https://github.com/pingcap/tikv/pull/1831) compression type. 59 | 60 | * Add [process metrics](https://github.com/pingcap/tikv/pull/1830) in Prometheus. 61 | 62 | ## Fixed 63 | 64 | * Fix dial wrong [listening address](https://github.com/pingcap/pd/pull/642) bug. 65 | 66 | * Remove the [offline peer](https://github.com/pingcap/pd/pull/639) directly. 67 | 68 | * Mark peer as `pending_remove` to avoid following operations. 69 | 70 | ## Improved 71 | 72 | * Add [the reason of cluster ID mismatch](https://github.com/pingcap/tikv/pull/1825) in error log. 73 | 74 | * Add [log](https://github.com/pingcap/tikv/pull/1823) to apply delegate register and deregister. 75 | -------------------------------------------------------------------------------- /2017-06-20-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 12 ~ June 18, 2017) 3 | date: 2017-06-20 4 | summary: Last week, we landed 30 PRs in the TiDB repositories and 14 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-06-12..2017-06-18%20) in the TiDB repositories. 11 | 12 | ## Added 13 | * Refactor the optimizer: 14 | - [Refactor ranger/statistic](https://github.com/pingcap/tidb/pull/3370): calculate the range and row count of non pk column. 15 | * JSON type: 16 | - Support generated column:](https://github.com/pingcap/tidb/pull/3431) 17 | - [Support the JSON type in the `cast` expression.](https://github.com/pingcap/tidb/pull/3395) 18 | * Generated column: 19 | - [Support basic generated column.](https://github.com/pingcap/tidb/pull/3431) 20 | - [Prevent modifying generated column.](https://github.com/pingcap/tidb/pull/3434) 21 | - [Add GeneratedExpr in ColumnInfo.](https://github.com/pingcap/tidb/pull/3487) 22 | * [Support `using` clause in join statement.](https://github.com/pingcap/tidb/pull/3372) 23 | * [Use GetTSAsync api from pd-client.](https://github.com/pingcap/tidb/pull/3459) 24 | * [Support SubTime.](https://github.com/pingcap/tidb/pull/3464) 25 | 26 | ## Fixed 27 | * [Fix a bug in alter table statement.](https://github.com/pingcap/tidb/pull/3456) 28 | * [Fix a bug in `cast`.](https://github.com/pingcap/tidb/pull/3462) 29 | * [Fix a bug about parsing Duration literal.](https://github.com/pingcap/tidb/pull/3468) 30 | * [Fix a divide zero bug in statistic.](https://github.com/pingcap/tidb/pull/3481) 31 | * [Fix a protobuf unmarshal related bug in coprocessor.](https://github.com/pingcap/tidb/pull/3482) 32 | * [Fix a bug about auto_increment column conflict after renaming table.](https://github.com/pingcap/tidb/pull/3493) 33 | 34 | ## Improved 35 | * [Add some columns in `mysql.user`:](https://github.com/pingcap/tidb/pull/3445) compatiable with MySQL. 36 | * [Use multiple grpc connnections for each store:](https://github.com/pingcap/tidb/pull/3453) improve performance. 37 | * Refactor expression evaluation: 38 | - [Consider unsigned flag in cast expression.](https://github.com/pingcap/tidb/pull/3457) 39 | * Speed up DDL process: 40 | - [Revoke the etcd-session when ddl worker is closed.](https://github.com/pingcap/tidb/pull/3461) 41 | 42 | # Weekly update in TiKV 43 | 44 | Last week, We landed [14 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-06-11..2017-06-17&type=Issues&utf8=%E2%9C%93) in the TiKV repositories. 45 | 46 | ## Added 47 | 48 | * Coprocessor supports [index scan](https://github.com/pingcap/tikv/pull/1817) executor. 49 | * Add MySQL [JSON](https://github.com/pingcap/tikv/pull/1874) type. 50 | * Support [comparison](https://github.com/pingcap/tikv/pull/1893) for mySQL JSON type. 51 | * 52 | 53 | ## Fixed 54 | 55 | * Fix a [bug caused by GC](https://github.com/pingcap/tikv/pull/1916) with stale command. 56 | 57 | ## Improved 58 | 59 | * Increase initialized [window size](https://github.com/pingcap/tikv/pull/1909) to 2MB for gRPC stream. 60 | * Using `prefix_same_as_start` to optimize [seek](https://github.com/pingcap/tikv/pull/1917) for Write CF. 61 | * Use [multiple connections](https://github.com/pingcap/tikv/pull/1921) to speed up Raft message sending. 62 | * Update Dockerfile, see [1915](https://github.com/pingcap/tikv/pull/1915) and [1919](https://github.com/pingcap/tikv/pull/1919). 63 | 64 | ## New contributor 65 | 66 | * [AkihiroSuda](https://github.com/AkihiroSuda) 67 | -------------------------------------------------------------------------------- /2017-07-04-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 26 ~ July 02, 2017) 3 | date: 2017-07-04 4 | summary: Last week, we landed 33 PRs in the TiDB repositories and 12 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [33 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-06-26..2017-07-02%20) in the TiDB repositories. 11 | 12 | ## Added 13 | * [Support priority options in the `select` statement.](https://github.com/pingcap/tidb/pull/3466) 14 | * [Add the `GetOwnerID` interface in `OwnerManager`.](https://github.com/pingcap/tidb/pull/3525) 15 | * [Add some columns in `mysql.db`:](https://github.com/pingcap/tidb/pull/3532) Make it compatible with MySQL. 16 | * [Add the `IsolationLevel` option in the coprocessor request to TiKV.](https://github.com/pingcap/tidb/pull/3535) 17 | * [Add the `priority` option in Key-Value request to TiKV.](https://github.com/pingcap/tidb/pull/3547) 18 | * [Support the `RenameTable` statement without the `To` keyword.](https://github.com/pingcap/tidb/pull/3552) 19 | 20 | ## Fixed 21 | * [Fix a bug in the `update` statement like `update T set a = 8, b = a`.](https://github.com/pingcap/tidb/pull/3531) 22 | * [Consider the timezone information when using `current_timestamp` as the default value.](https://github.com/pingcap/tidb/pull/3544) 23 | * [Break the campaigning owner loop when closing a DDL worker.](https://github.com/pingcap/tidb/pull/3553) 24 | * [Check the validity of table name in the `CreateTable` statement.](https://github.com/pingcap/tidb/pull/3554) 25 | * [Handle the null argument in `substr` function.](https://github.com/pingcap/tidb/pull/3555) 26 | * [Disable concurrent pre-write when meeting the `SkipConstrainCheck` option.](https://github.com/pingcap/tidb/pull/3561) 27 | * Handle binary data in the [HEX](https://github.com/pingcap/tidb/pull/3567) function and the [unhex](https://github.com/pingcap/tidb/pull/3569) function. 28 | * [Return `ErrNoDB` (No database selected) when no database is used and the table name is without database qualifier.](https://github.com/pingcap/tidb/pull/3572) 29 | 30 | ## Improved 31 | * Refactor optimiser: 32 | - [Prune ordered column paths.](https://github.com/pingcap/tidb/pull/3473) 33 | - [Prepare for using the new CBO framework.](https://github.com/pingcap/tidb/pull/3577) 34 | * [Flatten the `row` operations.](https://github.com/pingcap/tidb/pull/3528) 35 | * [Log critical statements.](https://github.com/pingcap/tidb/pull/3557) 36 | * [Code clean up.](https://github.com/pingcap/tidb/pull/3564) 37 | 38 | 39 | ## New contributor 40 | 41 | [sempr](https://github.com/sempr) 42 | [JackDrogon](https://github.com/JackDrogon) 43 | [Zhang Jian](https://github.com/zz-jason) 44 | 45 | # Weekly update in TiKV 46 | 47 | Last week, We landed [12 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-06-25..2017-07-01&type=Issues) in the TiKV repositories. 48 | 49 | ## Added 50 | 51 | * Use the [bi-directional stream](https://github.com/pingcap/tikv/pull/1888) for PD region heartbeat. 52 | * Add the [selection executor](https://github.com/pingcap/tikv/pull/1914) for coprocessor. 53 | * Support the [read committed](https://github.com/pingcap/tikv/pull/1958) isolation level for transactions. 54 | * Add the [modify](https://github.com/pingcap/tikv/pull/1964) function for JSON document. 55 | 56 | ## Fixed 57 | 58 | * Use [Equal](https://github.com/pingcap/pd/pull/666) to check parsed timestamp. 59 | * Fix the [heartbeat](https://github.com/pingcap/pd/pull/663) tests. 60 | 61 | ## Improved 62 | 63 | * [Generate snapshot](https://github.com/pingcap/tikv/pull/1963) concurrently. 64 | * [Skip handling read only](https://github.com/pingcap/tikv/pull/1966) commands in the Raft apply worker. 65 | * Upgrade Rust Protobuf to the [1.4](https://github.com/pingcap/tikv/pull/1969) version. 66 | -------------------------------------------------------------------------------- /2017-08-07-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 31 ~ August 06, 2017) 3 | date: 2017-08-07 4 | summary: Last week, we landed 54 PRs in the TiDB repositories and 21 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [54 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-07-31..2017-08-06%20) in the TiDB repositories. 11 | 12 | ## Added 13 | * [Support natural join.](https://github.com/pingcap/tidb/pull/3861) 14 | * [Add a switch for enabling cost-based optimizor.](https://github.com/pingcap/tidb/pull/3877) 15 | * [Assign low priority for SQL with full table scan and high priority for SQL with point get.](https://github.com/pingcap/tidb/pull/3881) 16 | * [Support `\N` which is the shotcut of null.](https://github.com/pingcap/tidb/pull/3943) 17 | * [Support TIMESTAMP in the `get_format` function.](https://github.com/pingcap/tidb/pull/3976) 18 | * [Add a flag to enable TCP keep-alive.](https://github.com/pingcap/tidb/pull/3995) 19 | * [Support `DISTINCTROW`.](https://github.com/pingcap/tidb/pull/4017) 20 | 21 | ## Fixed 22 | * [Truncate the trailing spaces for "CHAR[(M)]" types](https://github.com/pingcap/tidb/pull/3878) 23 | * [Fix float point parsing with leading dot.](https://github.com/pingcap/tidb/pull/3964) 24 | 25 | 26 | ## Improved 27 | * [Refactor the row structure:](https://github.com/pingcap/tidb/pull/3758) to reduce memory allocation. 28 | * Refactor the following expression/builtin-function evaluation framework: 29 | - [trim](https://github.com/pingcap/tidb/pull/3936) 30 | - [rtrim](https://github.com/pingcap/tidb/pull/3939) 31 | * [Check schema changing more precisely.](https://github.com/pingcap/tidb/pull/3999) 32 | * [Adjust the cost of index join.](https://github.com/pingcap/tidb/pull/4014) 33 | 34 | # Weekly update in TiKV 35 | 36 | Last week, We landed [21 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-07-30..2017-08-05&type=Issues) in the TiKV repositories. 37 | 38 | ## Added 39 | 40 | * Add [priority](https://github.com/pingcap/tikv/pull/2079) for coprocessor thread pool. 41 | * Add [`ceil_real`](https://github.com/pingcap/tikv/pull/2105) function for coprocessor. 42 | * Add [`remove`](https://github.com/pingcap/tikv/pull/2091) function for JSON. 43 | * Dynamically [set label](https://github.com/pingcap/pd/pull/689) by PD API. 44 | * Support [delete member](https://github.com/pingcap/pd/pull/695) by id. 45 | * Add more util [functions](https://github.com/pingcap/tikv/pull/2100). 46 | 47 | ## Fixed 48 | 49 | * Stop the [resolver thread](https://github.com/pingcap/tikv/pull/2104) explicitly. 50 | 51 | ## Improved 52 | 53 | * Refactor the storage [configuration](https://github.com/pingcap/tikv/pull/2102) field. 54 | * Deny the [`http` prefix](https://github.com/pingcap/tikv/pull/2101) for PD addresses. 55 | * Refactor the [properties collector](https://github.com/pingcap/tikv/pull/2096). 56 | * Improve the storage [test](https://github.com/pingcap/tikv/pull/2108). 57 | * Use the [`MinOverlappingRatio`](https://github.com/pingcap/tikv/pull/2117) compaction priority by default. 58 | -------------------------------------------------------------------------------- /2017-11-06-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 30 ~ November 05, 2017) 3 | date: 2017-11-06 4 | summary: Last week, we landed 51 PRs in the TiDB repositories and 16 PRs in the TiKV repositories. 5 | tags: ['TiDB', 'TiKV'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [51 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Amerged%20merged%3A2017-10-30..2017-11-05) in the TiDB repositories. 11 | 12 | ## Added 13 | * [Provide the command option and log the success/fail information for slow-query.](https://github.com/pingcap/tidb/pull/4934) 14 | 15 | ## Removed 16 | * [Remove the old planner.](https://github.com/pingcap/tidb/pull/4979) 17 | * [Remove `xeval`.](https://github.com/pingcap/tidb/pull/4978) 18 | * [Remove the `localstore` storage engine.](https://github.com/pingcap/tidb/pull/4976) 19 | 20 | ## Fixed 21 | * [Change the selection plan to dual plan directly if the condition is always false.](https://github.com/pingcap/tidb/pull/4980) 22 | * [Insert column char(4) with latin1 charset by incorrect padding.](https://github.com/pingcap/tidb/pull/4962) 23 | * [Remove the check of initialized auto ID.](https://github.com/pingcap/tidb/pull/4971) 24 | * [Support `alter table add column(...)`.](https://github.com/pingcap/tidb/pull/4963) 25 | * [Fix a bug in JSON decoding.](https://github.com/pingcap/tidb/pull/4949) 26 | * [Use `utf8_bin` for unsupported column collation.](https://github.com/pingcap/tidb/pull/4939) 27 | * [Fix the bug of `alter table table_options, other_alter_specification`.](https://github.com/pingcap/tidb/pull/4931) 28 | 29 | ## Improved 30 | * [Move the safepoint checker to `tikvStore`.](https://github.com/pingcap/tidb/pull/4998) 31 | * [Enable pushing float down to TiKV.](https://github.com/pingcap/tidb/pull/4967) 32 | * [Fix estimation in index point query.](https://github.com/pingcap/tidb/pull/4956) 33 | * [No longer add enforcer.](https://github.com/pingcap/tidb/pull/4955) 34 | * [Improve index join to support all join types.](https://github.com/pingcap/tidb/pull/4944) 35 | * [Extract the process of getting full CMP type to method.](https://github.com/pingcap/tidb/pull/4935) 36 | * [Opentracing for `Execute`, `ParseSQL`, `Compile`, and `runStmt`.](https://github.com/pingcap/tidb/pull/4929) 37 | * [Reduce `growslice` in `dumpRowValuesBinary`.](https://github.com/pingcap/tidb/pull/4916) 38 | 39 | ## New Contributor (Thanks!) 40 | * [wudi](https://github.com/foxmailed) 41 | 42 | 43 | # Weekly update in TiKV 44 | 45 | Last week, We landed [16 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2017-10-30..2017-11-05&type=Issues) in the TiKV repositories. 46 | 47 | ## Added 48 | 49 | * Add [recursion limit check](https://github.com/pingcap/tikv/pull/2432) for coprocessor. 50 | * [Reset the RocksDB statistics](https://github.com/pingcap/tikv/pull/2443) periodically. 51 | 52 | ## Fixed 53 | 54 | * [Save the region meta information to cache](https://github.com/pingcap/pd/pull/825) even if it is failed to be written to the disk. 55 | * Fix the [read statistics](https://github.com/pingcap/tikv/pull/2436). 56 | * [Clear the hot store related gauges](https://github.com/pingcap/pd/pull/833) when store is not hot any more. 57 | * Fix the [LIKE](https://github.com/pingcap/tikv/pull/2442) behavior. 58 | 59 | ## Improved 60 | 61 | * Move [operator influence into `ShouldBalance`](https://github.com/pingcap/pd/pull/822). 62 | * [Reduce allocation](https://github.com/pingcap/tikv/pull/2434). 63 | * [Remove the pending peer](https://github.com/pingcap/pd/pull/826) before adding a new peer. 64 | * Refactor the [split check](https://github.com/pingcap/tikv/pull/2440). 65 | * Add limitation for [key size](https://github.com/pingcap/tikv/pull/2445). 66 | 67 | ## New Contributor (Thanks!) 68 | * [wudi](https://github.com/foxmailed) 69 | -------------------------------------------------------------------------------- /2018-01-08-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 01 ~ January 07, 2018) 3 | date: 2018-01-08 4 | summary: Last week, we landed 37 PRs in the TiDB repositories, 4 PRs in the TiSpark repositories, and 10 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [37 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-01-01..2018-01-07) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Support the `PACK_KEYS` option in the `CreateTable` statement.](https://github.com/pingcap/tidb/pull/5554) 15 | * [Show job's start time in the result of `admin show ddl ...`.](https://github.com/pingcap/tidb/pull/5517) 16 | 17 | ## Fixed 18 | 19 | * [Fix a bug when initializing HTTP stats handler.](https://github.com/pingcap/tidb/pull/5555) 20 | * [Fix a bug when estimating row count for outdated histograms.](https://github.com/pingcap/tidb/pull/5552) 21 | * [Consider time zone for builtin functions `curtime/sysdate/curdate`.](https://github.com/pingcap/tidb/pull/5548) 22 | 23 | ## Improved 24 | 25 | * [Refactor `Chunk.AppendRow` to handle virtual.](https://github.com/pingcap/tidb/pull/5563) 26 | * [Refactor hybrid type expressions.](https://github.com/pingcap/tidb/pull/5550) 27 | * [Only do a shallow copy when evaluating a "Column" expression.](https://github.com/pingcap/tidb/pull/5542) 28 | * [Refine the design of schema.](https://github.com/pingcap/tidb/pull/5541) 29 | * [Use more compact structure for histograms.](https://github.com/pingcap/tidb/pull/5539) 30 | * [Convert the aggregation operator `max/min` to `topN`.](https://github.com/pingcap/tidb/pull/5516) 31 | * [Shard the implicit row ID to avoid hot spot.](https://github.com/pingcap/tidb/pull/5513) 32 | * [Support `Chunk` for `StreamAggExec`.](https://github.com/pingcap/tidb/pull/5490) 33 | * [Support `Chunk` for `HashAggExec`.](https://github.com/pingcap/tidb/pull/5244) 34 | 35 | # Weekly update in TiSpark 36 | 37 | Last week, we landed [4 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-01-01..2018-01-07) in the TiSpark repositories. 38 | 39 | ## Improved 40 | 41 | * [Add potential missing test cases.](https://github.com/pingcap/tispark/pull/199) 42 | * [Simplify `Aggregation` pushdown.](https://github.com/pingcap/tispark/pull/153) 43 | 44 | ## Fixed 45 | 46 | * [Fix the dependency for `jackson` and `joda-time`.](https://github.com/pingcap/tispark/pull/195) 47 | * [Fix the error handling logic.](https://github.com/pingcap/tispark/pull/191) 48 | 49 | # Weekly update in TiKV and PD 50 | 51 | Last week, we landed [10 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-01-01..2018-01-07) in the TiKV and PD repositories. 52 | 53 | ## Added 54 | 55 | * [Add timer to support worker timeout later.](https://github.com/pingcap/tikv/pull/2564) 56 | * [tikv-ctl: add `bad-regions` subcommand.](https://github.com/pingcap/tikv/pull/2624) 57 | * [coprocessor/endpoint: initialize runtime in response.](https://github.com/pingcap/tikv/pull/2638) 58 | 59 | ## Fixed 60 | 61 | * [tests: fix some failpoints name.](https://github.com/pingcap/tikv/pull/2634) 62 | * [scheduler: fix hot region scheduler select store problem.](https://github.com/pingcap/pd/pull/898) 63 | * [Fix the score when region size is zero.](https://github.com/pingcap/pd/pull/899) 64 | 65 | ## Improved 66 | 67 | * [raftstore: add `Lease`.](https://github.com/pingcap/tikv/pull/2582) 68 | * [util: remove `BatchRunnable` and use `Runnable` instead.](https://github.com/pingcap/tikv/pull/2645) 69 | * [tests: remove redundant storage tests.](https://github.com/pingcap/tikv/pull/2646) 70 | * [Change `github.com/Sirupsen/logrus` to `github.com/sirupsen/logrus`.](https://github.com/pingcap/pd/pull/902) 71 | 72 | # New contributor (Thanks!) 73 | 74 | * TiDB: [Cruth kvinc](https://github.com/oiooj) -------------------------------------------------------------------------------- /2018-01-15-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 08 ~ January 14, 2018) 3 | date: 2018-01-15 4 | summary: Last week, we landed 43 PRs in the TiDB repositories and 25 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [43 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-01-08..2018-01-14) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Support the ODBC syntax of `time/date/timestamp` literal](https://github.com/pingcap/tidb/pull/5634) 15 | * [Add `MaxProcs` and make the `runtime.GOMAXPROCS` parameter configurable](https://github.com/pingcap/tidb/pull/5612) 16 | 17 | ## Fixed 18 | 19 | * [Fix a bug about index join](https://github.com/pingcap/tidb/pull/5623) 20 | * [Close `HashJoin` goroutines as soon as possible to avoid unexpected errors](https://github.com/pingcap/tidb/pull/5620) 21 | * [`fetchShowTableStatus` should append an integer to the third column instead of a string](https://github.com/pingcap/tidb/pull/5608) 22 | * [Correct the behavior when `RunWorker` is false](https://github.com/pingcap/tidb/pull/5598) 23 | * [Refine the `typeInfer` of `group_concat`](https://github.com/pingcap/tidb/pull/5573) 24 | 25 | ## Improved 26 | 27 | * [Avoid the Children type assertion](https://github.com/pingcap/tidb/pull/5616) 28 | * [Merge `IntColumnRange` with `NewRange`](https://github.com/pingcap/tidb/pull/5591) 29 | * [Upgrade the username length limit to 32 to be compatible with MySQL 5.7](https://github.com/pingcap/tidb/pull/5588) 30 | * [Garbage collects useless stats info](https://github.com/pingcap/tidb/pull/558) 31 | * [`InsertExec` eliminates unnecessary `CastValue` operations](https://github.com/pingcap/tidb/pull/5581) 32 | * [Speed up row count estimation](https://github.com/pingcap/tidb/pull/5579) 33 | * [Support encoding a `Chunk` row](https://github.com/pingcap/tidb/pull/5578) 34 | * [Use `dep` instead of `glide`](https://github.com/pingcap/tidb/pull/5558) 35 | * [Optimize the `insert ignore` statement](https://github.com/pingcap/tidb/pull/5508) 36 | * Support `Chunk` in: 37 | - [`HashJoinExec`](https://github.com/pingcap/tidb/pull/5439) 38 | - [`ExecuteExec`](https://github.com/pingcap/tidb/pull/5410) 39 | 40 | # Weekly update in TiKV and PD 41 | 42 | Last week, we landed [25 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-01-08..2018-01-14) in the TiKV and PD repositories. 43 | 44 | ## Added 45 | 46 | * [Add the node case](https://github.com/pingcap/pd/pull/901) 47 | * [Support Region split](https://github.com/pingcap/pd/pull/905) 48 | * [Support query regions by read/write flow](https://github.com/pingcap/pd/pull/897) 49 | 50 | ## Fixed 51 | 52 | * [Change the version](https://github.com/pingcap/tikv/pull/2658) 53 | * [Fix a RocksDB task name error](https://github.com/pingcap/tikv/pull/2663) 54 | * [Cancel `call` when refreshing client](https://github.com/pingcap/tikv/pull/2669) 55 | 56 | ## Improved 57 | 58 | * [Use `dep` instead of `glide`](https://github.com/pingcap/pd/pull/904) 59 | * [Optimize write type parsing for MVCC properties collector](https://github.com/pingcap/tikv/pull/2654) 60 | * [Update README and upgrade Dockerfile golang:1.9.2](https://github.com/pingcap/pd/pull/908) 61 | * [Specify gRPC event engine](https://github.com/pingcap/tikv/pull/2656) 62 | * [Add the debug log](https://github.com/pingcap/pd/pull/907) 63 | * [Fix some `ineffassign` to improve the GoReport Result](https://github.com/pingcap/pd/pull/911) 64 | * [Rename `AggregationExecutor` to `HashAggExecutor`](https://github.com/pingcap/tikv/pull/2673) 65 | * [Improve the GoReport Result](https://github.com/pingcap/pd/pull/912) 66 | * [Dump the `ConfChange` type Raft log entry](https://github.com/pingcap/tikv/pull/2661) 67 | * [Make meta key return array](https://github.com/pingcap/tikv/pull/2677) 68 | 69 | # New contributor (Thanks!) 70 | 71 | * PD: [maiyang](https://github.com/yangwenmai) -------------------------------------------------------------------------------- /2018-01-22-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 15 ~ January 21, 2018) 3 | date: 2018-01-22 4 | summary: Last week, we landed 43 PRs in the TiDB repositories, 13 PRs in the TiSpark repositories, and 18 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [43 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-01-15..2018-01-21) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Add an interface for `Chunk` to count the memory usage](https://github.com/pingcap/tidb/pull/5645) 15 | * [Add a session variable to log the query string](https://github.com/pingcap/tidb/pull/5633) 16 | 17 | ## Removed 18 | 19 | * [Remove the old, never used `IndexLookUpJoin`](https://github.com/pingcap/tidb/pull/5649) 20 | 21 | ## Fixed 22 | 23 | * [`group_concat` should not modify the argument during execution](https://github.com/pingcap/tidb/pull/5664) 24 | * [Correct the unsigned `pk`'s behavior](https://github.com/pingcap/tidb/pull/5641) 25 | 26 | ## Improved 27 | 28 | * [Optimize the `com_field_list` command and make `Use Database` faster](https://github.com/pingcap/tidb/pull/5677) 29 | * [Improve the sort efficiency on `lookupTableTask.rows`](https://github.com/pingcap/tidb/pull/5675) 30 | * [Enlarge the default `distsql_scan_concurrency`](https://github.com/pingcap/tidb/pull/5670) 31 | * [Log a warning when the memory usage of `HashJoinExec` exceeds threshhold](https://github.com/pingcap/tidb/pull/5658) 32 | * [Refine the behavior when updating `StatsDelta`](https://github.com/pingcap/tidb/pull/5647) 33 | * [Split the presentation and evaluation layers of aggregation functions](https://github.com/pingcap/tidb/pull/5635) 34 | * [Use `BatchGet` to speed up `LOAD DATA`](https://github.com/pingcap/tidb/pull/5632) 35 | 36 | # Weekly update in TiSpark 37 | 38 | Last week, we landed [13 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-01-15..2018-01-21) in the TiSpark repositories. 39 | 40 | ## Improved 41 | 42 | * [Refactor the type and expression systems totally](https://github.com/pingcap/tispark/pull/197) 43 | * Reorganize the type and expressions 44 | * Use the visitor instead of raw expressions when processing traversal 45 | * Fixed `type infer` logics 46 | * Refactor predicates processing logic according to the visitor pattern 47 | * Fixed index encoding 48 | * [Change `CodecDataInput` to use non-synchronized `ByteArrayInputStream`](https://github.com/pingcap/tispark/pull/214) 49 | * [Add TiKV, PD, and TiDB's config files for Docker test environment](https://github.com/pingcap/tispark/pull/216) 50 | 51 | # Weekly update in TiKV and PD 52 | 53 | Last week, we landed [18 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-01-15..2018-01-21) in the TiKV and PD repositories. 54 | 55 | ## Added 56 | 57 | * [simulator: add hot region cases](https://github.com/pingcap/pd/pull/909) 58 | 59 | ## Fixed 60 | 61 | * [proto: compatible with proto3](https://github.com/pingcap/pd/pull/919) 62 | * [heartbeat: rebind the stream](https://github.com/pingcap/pd/pull/918) 63 | * [server: delete overlap from etcd](https://github.com/pingcap/pd/pull/925) 64 | 65 | ## Improved 66 | 67 | * [Refactor the raftstore Callback API](https://github.com/pingcap/tikv/pull/2625) 68 | * [Remove the unused `rocksdb.backup_dir`](https://github.com/pingcap/tikv/pull/2697) 69 | * [Adjust Scheduler metrics](https://github.com/pingcap/tikv/pull/2700) 70 | * [`impl Runnable` for Scheduler](https://github.com/pingcap/tikv/pull/2672) -------------------------------------------------------------------------------- /2018-01-29-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 22 ~ January 28, 2018) 3 | date: 2018-01-29 4 | summary: Last week, we landed 28 PRs in the TiDB repositories, 4 PRs in the TiSpark repositories, and 17 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [28 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-01-22..2018-01-28) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Add the importer tool](https://github.com/pingcap/tidb/pull/5695) 15 | * [Add metrics for GC failure count](https://github.com/pingcap/tidb/pull/5694) 16 | * [Add metrics for TiDB-server panic](https://github.com/pingcap/tidb/pull/5692) 17 | * [Add metrics for async secondary lock cleanup](https://github.com/pingcap/tidb/pull/5575) 18 | * [Support create time in `information_schema`](https://github.com/pingcap/tidb/pull/5590/files) 19 | 20 | ## Removed 21 | 22 | * [Remove `GetSessionVars()` in expression evaluation](https://github.com/pingcap/tidb/pull/5683) 23 | * [Remove `varsutil` package, and make `Systems` a private member of `SessionVars`](https://github.com/pingcap/tidb/pull/5544) 24 | 25 | ## Fixed 26 | 27 | * [Avoid the generation of mysql.TypeNewDate](https://github.com/pingcap/tidb/pull/5705) 28 | * [Push down binaryliterals as varstring](https://github.com/pingcap/tidb/pull/5665) 29 | 30 | ## Improved 31 | 32 | * [Keep slow query log entry in order](https://github.com/pingcap/tidb/pull/5732) 33 | * [Make `list.MemoryUsage()` more efficient](https://github.com/pingcap/tidb/pull/5723) 34 | * [Limit statement count in a transaction](https://github.com/pingcap/tidb/pull/5704) 35 | * [Remove `WithCancel` in `copIterator`](https://github.com/pingcap/tidb/pull/5701) 36 | * [Uniform the way of iterating rows within a `Chunk`](https://github.com/pingcap/tidb/pull/5674) 37 | 38 | # Weekly update in TiSpark 39 | 40 | Last week, we landed [4 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-01-22..2018-01-28) in the TiSpark repositories. 41 | 42 | ## Improved 43 | 44 | * [Improve index double read performance by around 30%](https://github.com/pingcap/tispark/pull/172) 45 | * [Verify and add document for Hive integration](https://github.com/pingcap/tispark/pull/225) 46 | 47 | ## Fixed 48 | 49 | * [Fix test for between expression](https://github.com/pingcap/tispark/pull/222) 50 | * [Add placeholder for unsupported type preventing schema reading crash](https://github.com/pingcap/tispark/pull/218) 51 | 52 | # Weekly update in TiKV and PD 53 | 54 | Last week, we landed [17 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-01-22..2018-01-28) in the TiKV and PD repositories. 55 | 56 | ## Added 57 | 58 | * [Add ImportSST/UploadSST API](https://github.com/pingcap/tikv/pull/2662) 59 | * [Add drop region admin command](https://github.com/pingcap/pd/pull/931) 60 | 61 | ## Fixed 62 | 63 | * [Convert int to decimal in sum](https://github.com/pingcap/tikv/pull/2694) 64 | * [Fix join failure when log dir is the same as data dir](https://github.com/pingcap/pd/pull/929) 65 | * [Disable the portable on MacOS](https://github.com/pingcap/tikv/pull/2696) 66 | 67 | ## Improved 68 | 69 | * [Limit data size for scan lock](https://github.com/pingcap/tikv/pull/2664) 70 | * [Add metrics for checkers](https://github.com/pingcap/pd/pull/928) 71 | * [Remove schedule empty apply task](https://github.com/pingcap/tikv/pull/2706) 72 | * [Ignore Prometheus encoding error](https://github.com/pingcap/tikv/pull/2707) 73 | * [Debug trait for snapshot](https://github.com/pingcap/tikv/pull/2685) 74 | * [Reduce the lock overhead](https://github.com/pingcap/pd/pull/930) 75 | * [Update the region size](https://github.com/pingcap/tikv/pull/2636) 76 | 77 | # New contributor (Thanks!) 78 | 79 | * TiDB: [yuananf](https://github.com/yuananf) -------------------------------------------------------------------------------- /2018-02-26-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (February 12 ~ February 25, 2018) 3 | date: 2018-02-26 4 | summary: Last two weeks, we landed 27 PRs in the TiDB repositories and 13 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last two weeks, we landed [27 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-02-12..2018-02-25) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | * [Support the `select 1 order by 1` syntax](https://github.com/pingcap/tidb/pull/5881) 15 | 16 | ## Fixed 17 | 18 | * [Fix the bug in `insert` statements when dropping columns](https://github.com/pingcap/tidb/pull/5883) 19 | * [Fix the bug when updating the stats table](https://github.com/pingcap/tidb/pull/5880) 20 | 21 | ## Improved 22 | 23 | * [Allow `golint` to check `context.Context` in `make check`](https://github.com/pingcap/tidb/pull/5898/files) 24 | * [Do not import `golang.org/x/net/context` as `goctx` alias](https://github.com/pingcap/tidb/pull/5895) 25 | * [Move the package context to `sessionctx`](https://github.com/pingcap/tidb/pull/5890) 26 | * [Add the recover mechanism for join workers](https://github.com/pingcap/tidb/pull/5894) 27 | * [Add `StatementsPerTransaction` and `TransactionDuration` metrics](https://github.com/pingcap/tidb/pull/5859) 28 | * [Add `keep alive` metrics to figure out whether TiDB instance is down](https://github.com/pingcap/tidb/pull/5847) 29 | 30 | # Weekly update in TiKV and PD 31 | 32 | Last two weeks, we landed [13 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-02-12..2018-02-25) in the TiKV and PD repositories. 33 | 34 | ## Added 35 | 36 | * [Add peer label level statistics](https://github.com/pingcap/pd/pull/951) 37 | * [Support stream aggregation](https://github.com/pingcap/tikv/pull/2714) 38 | * [Support multiple Regions in `tombstone`](https://github.com/pingcap/tikv/pull/2711) 39 | * [Add a handler which is invoked after the client reconnects to PD](https://github.com/pingcap/tikv/pull/2757) 40 | 41 | ## Fixed 42 | 43 | * [Fix the misspelled word to improve GoReport Card Result](https://github.com/pingcap/pd/pull/956) 44 | * [Fix the panic caused by `region not found`](https://github.com/pingcap/pd/pull/957) 45 | * [Fix the bug of the hot region scheduler adding peers to down stores](https://github.com/pingcap/pd/pull/958) 46 | 47 | ## Improved 48 | 49 | * [Add the timestamp field for the Region heartbeat](https://github.com/pingcap/tikv/pull/2728) 50 | * [Increase the priority of replica checker's operator](https://github.com/pingcap/pd/pull/954) 51 | * [Increase the default value of the replica scheduler limit](https://github.com/pingcap/pd/pull/960) 52 | -------------------------------------------------------------------------------- /2018-04-09-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 02 ~ April 08, 2018) 3 | date: 2018-04-09 4 | summary: Last week, we landed 28 PRs in the TiDB repositories, 1 PR in the TiSpark repositories, and 9 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [28 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftidb+is%3Apr+is%3Amerged+merged%3A2018-04-02..2018-04-08&type=Issues&utf8=%E2%9C%93) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support `AdminCleanupIndex` to clean up the dangling index](https://github.com/pingcap/tidb/pull/6102) 15 | - [Support `AlterTableComment`](https://github.com/pingcap/tidb/pull/6127) 16 | - [Add `RawDeleteRange` API](https://github.com/pingcap/tidb/pull/6157) 17 | - [Make `session transaction isolation level` take effect only once](https://github.com/pingcap/tidb/pull/6175) 18 | 19 | ## Fixed 20 | 21 | - [Fix row estimation for the pseudo unique key](https://github.com/pingcap/tidb/pull/6199) 22 | - [Fix row count estimation for the column with null values](https://github.com/pingcap/tidb/pull/6203) 23 | - [Fix the result of `cast (0x10 as binary(2))`](https://github.com/pingcap/tidb/pull/6211) 24 | - [Fix zero value issue for binary type](https://github.com/pingcap/tidb/pull/6213) 25 | - [Merge `BatchGet` results to fix `InsertIgnore` in a transaction block](https://github.com/pingcap/tidb/pull/6215) 26 | 27 | ## Improved 28 | 29 | - [Track memory usage for `NestedLoopApply`](https://github.com/pingcap/tidb/pull/6171) 30 | - [Delete ranges when rolling back `add index`](https://github.com/pingcap/tidb/pull/6188) 31 | - [Optimize the insert executor on duplicate key update](https://github.com/pingcap/tidb/pull/6194) 32 | - [Upgrade mysql.db user column length to 32](https://github.com/pingcap/tidb/pull/6209) 33 | 34 | # Weekly update in TiSpark 35 | 36 | Last week, we landed [1 PR](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-02..2018-04-08) in the TiSpark repositories. 37 | 38 | ## Added 39 | 40 | - [Fix single read for count(1) case](https://github.com/pingcap/tispark/pull/304) 41 | 42 | # Weekly update in TiKV and PD 43 | 44 | Last week, we landed [9 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-04-02..2018-04-08) in the TiKV and PD repositories. 45 | 46 | ## Added 47 | 48 | - [Support `compact_region` by `tikv-ctl`](https://github.com/pingcap/tikv/pull/2889) 49 | - [Add `ImportKVService`](https://github.com/pingcap/tikv/pull/2881) 50 | - [Add raw batch `put`/`get`/`delete`/`scan`](https://github.com/pingcap/tikv/pull/2854) 51 | 52 | ## Fixed 53 | 54 | - [Fix OOM when receiving too many snapshots](https://github.com/pingcap/tikv/pull/2879) 55 | 56 | ## Improved 57 | 58 | - [Update MVCC debug structure](https://github.com/pingcap/tikv/pull/2894) 59 | 60 | # New contributors (Thanks!) 61 | 62 | TiKV: 63 | 64 | - [Xiaoguang Sun](https://github.com/sunxiaoguang) 65 | - [Matt Friedman](https://github.com/friedm) 66 | 67 | Docs: 68 | 69 | - [Valerian Pereira](https://github.com/valerianpereira) 70 | -------------------------------------------------------------------------------- /2018-04-23-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 16 ~ April 22, 2018) 3 | date: 2018-04-23 4 | summary: Last week, we landed 36 PRs in the TiDB repositories, 8 PRs in the TiSpark repositories, and 29 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [36 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-16..2018-04-22) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Add TiDB HTTP API to query the DDL history information](https://github.com/pingcap/tidb/pull/6245/files) 15 | - [Add the session variable `tidb_optimizer_selectivity_level` to control the selectivity estimation level](https://github.com/pingcap/tidb/pull/6289) 16 | - [Add table partition information in `SHOW CREATE TABLE`](https://github.com/pingcap/tidb/pull/6292) 17 | - [Analyze the table automatically when the modified row count of a table is too large](https://github.com/pingcap/tidb/pull/6294) 18 | 19 | ## Fixed 20 | 21 | - [Check if the column name already exists before renaming a column](https://github.com/pingcap/tidb/pull/6284) 22 | - [Fix a problem when parallel executing `CREATE TABLE IF NOT EXISTS`](https://github.com/pingcap/tidb/pull/6286) 23 | - [Fix pseudo selectivity estimation for the primary key](https://github.com/pingcap/tidb/pull/6302) 24 | - [Eliminate `Projection` when the schema length is `0`](https://github.com/pingcap/tidb/pull/6318) 25 | - [Set the hash join concurrency in `NewSessionVars`](https://github.com/pingcap/tidb/pull/6295) 26 | 27 | ## Improved 28 | 29 | - [Refactor `scalarFuncToPBExpr`](https://github.com/pingcap/tidb/pull/6290) 30 | - [Improve the cost estimation for physical aggregate operators](https://github.com/pingcap/tidb/pull/6307) 31 | - [Improve the execution performance of the `UnionScanExec` operator](https://github.com/pingcap/tidb/pull/6312) 32 | - [Cache global variables](https://github.com/pingcap/tidb/pull/6315) 33 | 34 | # Weekly update in TiSpark 35 | 36 | Last week, we landed [8 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-16..2018-04-22) in the TiSpark repositories. 37 | 38 | ## Fixed 39 | 40 | - [Fix the binary test and delete redundant issue tests](https://github.com/pingcap/tispark/pull/317) 41 | - [Fix `Protobuf` definition according to TiKV changes](https://github.com/pingcap/tispark/pull/318) 42 | 43 | # Weekly update in TiKV and PD 44 | 45 | Last week, we landed [29 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-04-16..2018-04-22&type=) in the TiKV and PD repositories. 46 | 47 | ## Added 48 | 49 | - [Support specifying `ColumnFamily` in the `rawkv` APIs](https://github.com/pingcap/tikv/pull/2852) 50 | - [Add a new Region score function for balance that considers the free space of TiKV](https://github.com/pingcap/pd/pull/1014) 51 | - [Support `ScatterRegion`](https://github.com/pingcap/pd/pull/1028) 52 | 53 | ## Fixed 54 | 55 | - [Fix the issue of reloading without persisted schedulers](https://github.com/pingcap/pd/pull/1021) 56 | - [Fix wrongly collected Coprocessor statistics](https://github.com/pingcap/tikv/pull/2951) 57 | - [Bump the recursion limit to 200](https://github.com/pingcap/tikv/pull/2958) 58 | 59 | ## Improved 60 | 61 | - [Upgrade the Rust and Clippy versions](https://github.com/pingcap/tikv/pull/2922) 62 | - [Add metrics to `FuturePool`](https://github.com/pingcap/tikv/pull/2932) 63 | - [Reduce the lock contention in `WORKER`](https://github.com/pingcap/tikv/pull/2933) -------------------------------------------------------------------------------- /2018-05-02-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 23 ~ April 29, 2018) 3 | date: 2018-05-02 4 | summary: Last week, we landed 49 PRs in the TiDB repositories, 18 PRs in the TiSpark repositories, and 21 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [49 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-23..2018-04-29) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Add the `CHANGELOG.md` file to the TiDB repository](https://github.com/pingcap/tidb/pull/6402) 15 | - [Support more `ODBC` syntaxes](https://github.com/pingcap/tidb/pull/6399) 16 | - [Support `PARTITION BY RANGE COLUMNS` in `SHOW CREATE TABLE`](https://github.com/pingcap/tidb/pull/6332) 17 | - [Support the `ALTER CONVERT TO` syntax](https://github.com/pingcap/tidb/pull/6416) 18 | - [Support the `ALTER TABLE AUTO_INCREMENT` syntax](https://github.com/pingcap/tidb/pull/6417) 19 | - [Support the `SET NAMES COLLATE DEFAULT` syntax](https://github.com/pingcap/tidb/pull/6404) 20 | 21 | ## Fixed 22 | 23 | - [Fix `Dump`/`Load` statistics information](https://github.com/pingcap/tidb/pull/6285) 24 | - [Fix data race on the `LockKeys()` function](https://github.com/pingcap/tidb/pull/6340) 25 | - [Fix range calculating in the `TableHandlesToKVRanges()` function](https://github.com/pingcap/tidb/pull/6364) 26 | - [Fix the compatibility problem of the `UNION` statement](https://github.com/pingcap/tidb/pull/6370) 27 | - [Fix the wrong behavior of the `tryToGetMemTask()` function](https://github.com/pingcap/tidb/pull/6390) 28 | - [Refine the optimization rule of "TopN Push Down"](https://github.com/pingcap/tidb/pull/6407) 29 | 30 | ## Improved 31 | 32 | - [Add more log information about slow queries](https://github.com/pingcap/tidb/pull/6343) 33 | - [Log the slow Coprocessor task in detail](https://github.com/pingcap/tidb/pull/6344) 34 | - [Enhance the validation of column names when creating a table](https://github.com/pingcap/tidb/pull/6349) 35 | 36 | # Weekly update in TiSpark 37 | 38 | Last week, we released TiSpark 1.0 GA and landed [18 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-23..2018-04-29) in the TiSpark repositories. 39 | 40 | ## Fixed 41 | 42 | - [Fix the leaky session](https://github.com/pingcap/tispark/pull/334) 43 | - [Fix the unsigned index](https://github.com/pingcap/tispark/pull/332) 44 | - [Fix the logic of handling the stale epoch error](https://github.com/pingcap/tispark/pull/325) 45 | - [Fix the logic of handling zero store ID](https://github.com/pingcap/tispark/pull/324) 46 | - [Fix the `map single table` method](https://github.com/pingcap/tispark/pull/319) 47 | 48 | ## Improved 49 | 50 | - [Allow forcing the metadata to refresh](https://github.com/pingcap/tispark/pull/330) 51 | - [Adjust the retry policy factor and cache invalidation](https://github.com/pingcap/tispark/pull/326) 52 | 53 | # Weekly update in TiKV and PD 54 | 55 | Last week, we landed [21 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-04-23..2018-04-29) in the TiKV and PD repositories. 56 | 57 | ## Added 58 | 59 | - [Add the change log for TiKV](https://github.com/pingcap/tikv/pull/2952) 60 | - [Add the change log for 2.0 GA](https://github.com/pingcap/pd/pull/1038) 61 | - [Add metrics for hotspot cache](https://github.com/pingcap/pd/pull/1027) 62 | - [Do fuzz test](https://github.com/pingcap/tikv/pull/2942) 63 | 64 | ## Fixed 65 | 66 | - [Improve the Key Scan feature and fix a bug for MVCC](https://github.com/pingcap/tikv/pull/2964) 67 | 68 | ## Improved 69 | 70 | - [Refine the installation instructions](https://github.com/pingcap/pd/pull/1041) 71 | - [Collect Raft's log](https://github.com/pingcap/tikv/pull/2996) 72 | - [Adjust `clean_stale_peer_delay`](https://github.com/pingcap/tikv/pull/2990) 73 | - [Merge `(RAW)KV_COMMAND_COUNTER` into `COMMAND_COUNTER`](https://github.com/pingcap/tikv/pull/2973) 74 | - [Release the log cache eagerly using GC ](https://github.com/pingcap/tikv/pull/2962) -------------------------------------------------------------------------------- /2018-05-07-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 30 ~ May 06, 2018) 3 | date: 2018-05-07 4 | summary: Last week, we landed 24 PRs in the TiDB repositories, 1 PR in the TiSpark repositories, and 15 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [24 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-30..2018-05-06+) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Add `DB_NAME` and `TABLE_NAME` in the result of `ADMIN SHOW DDL JOBS`](https://github.com/pingcap/tidb/pull/6276) 15 | - [Add an HTTP API to scatter Regions of a table](https://github.com/pingcap/tidb/pull/6378) 16 | - [Add the `tidb_retry_limit` session variable to control the transaction retry limit](https://github.com/pingcap/tidb/pull/6369) 17 | - [Add the `auto_analyze_ratio` session variable to control the automatic analysis ratio](https://github.com/pingcap/tidb/pull/6455) 18 | - [Support the `ALTER TABLE FORCE` syntax](https://github.com/pingcap/tidb/pull/6476) 19 | 20 | ## Fixed 21 | 22 | - [Restrict the column type in range partition](https://github.com/pingcap/tidb/pull/6339) 23 | - [Check the privilege for `SHOW CREATE TABLE` and `information_schema.tables`](https://github.com/pingcap/tidb/pull/6426) 24 | - [Check `nil` for Coprocessor stream response](https://github.com/pingcap/tidb/pull/6467) 25 | - [Set the index name of `ADMIN CHECK INDEX` to be case insensitive](https://github.com/pingcap/tidb/pull/6477) 26 | 27 | ## Improved 28 | 29 | - [Reduce the memory usage for duplicated key update](https://github.com/pingcap/tidb/pull/6337) 30 | - [Add the reorganization log to make trouble shooting easier](https://github.com/pingcap/tidb/pull/6428) 31 | - [Add failure metrics for `checkLeader` and `prepare`](https://github.com/pingcap/tidb/pull/6452) 32 | 33 | # Weekly update in TiSpark 34 | 35 | Last week, we landed [1 PR](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-04-30..2018-05-06) in the TiSpark repositories. 36 | 37 | ## Fixed 38 | 39 | - [Fix the TopN validation issue](https://github.com/pingcap/tispark/pull/343) 40 | 41 | # Weekly update in TiKV and PD 42 | 43 | Last week, we landed [15 PRs](https://github.com/search?p=2&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-04-30..2018-05-06&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 44 | 45 | ## Added 46 | 47 | - [Support compacting the whole cluster](https://github.com/pingcap/tikv/pull/2945) 48 | - [Scatter the leader distribution in a specified range](https://github.com/pingcap/pd/pull/1037) 49 | 50 | ## Fixed 51 | 52 | - [Resign the PD leader when it is not the same as the etcd leader](https://github.com/pingcap/pd/pull/1039) 53 | - [Fix the parse error of `config.toml`](https://github.com/pingcap/pd/pull/1043) 54 | - [Fix the bug of deleting the valid scheduler when starting the coordinator](https://github.com/pingcap/pd/pull/1045) 55 | 56 | ## Improved 57 | 58 | - [Attach an interval to Region heartbeats](https://github.com/pingcap/tikv/pull/2965) 59 | - [Open the `nightly` feature gate for crossbeam-channel](https://github.com/pingcap/tikv/pull/2995) 60 | - [Upgrade etcd to v3.3.4](https://github.com/pingcap/pd/pull/1046) 61 | -------------------------------------------------------------------------------- /2018-05-14-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (May 07 ~ May 13, 2018) 3 | date: 2018-05-14 4 | summary: Last week, we landed 55 PRs in the TiDB repositories and 24 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [55 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-05-07..2018-05-13+) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support renaming a table as its original name](https://github.com/pingcap/tidb/pull/6391) 15 | - [Allow correlated columns to be pushed down to TiKV](https://github.com/pingcap/tidb/pull/6403) 16 | - [Support local latches for the transactions in TiDB](https://github.com/pingcap/tidb/pull/6418) 17 | - [Add an option to stop writing Binlog when TiDB meets some Binlog errors](https://github.com/pingcap/tidb/pull/6503) 18 | - [Add an HTTP API to enable or disable the general log of TiDB](https://github.com/pingcap/tidb/pull/6513) 19 | - [Update the `logrus` package to a new version](https://github.com/pingcap/tidb/pull/6536) 20 | 21 | ## Fixed 22 | 23 | - [Set `lastInsertID` in the duplicated update statement](https://github.com/pingcap/tidb/pull/6345) 24 | - [Fix several bugs of statistics feedback](https://github.com/pingcap/tidb/pull/6444) 25 | - [Fix a bug occurred when values are inserted into a time column](https://github.com/pingcap/tidb/pull/6451) 26 | - [Fix a bug when creating a table and renaming a table run concurrently](https://github.com/pingcap/tidb/pull/6462) 27 | - [Rollback all keys when `Prewrite` fails](https://github.com/pingcap/tidb/pull/6472) 28 | - [Fix a bug when adding index meets `handle = MaxInt64`](https://github.com/pingcap/tidb/pull/6481) 29 | - [Fix a bug when the `limit` offset is a multiple of `MaxChunkSize`](https://github.com/pingcap/tidb/pull/6498) 30 | - [Fix a bug when a complex subquery exists in the `Update` statement](https://github.com/pingcap/tidb/pull/6540) 31 | 32 | ## Improved 33 | 34 | - [Refine the error message about `Out of range value for column`](https://github.com/pingcap/tidb/pull/6334) 35 | - [Set `gc_worker` and `loadDeleteRangeSQL` to a much higher priority](https://github.com/pingcap/tidb/pull/6450) 36 | - [Make `tidb_opt_insubquery_unfold` a global variable](https://github.com/pingcap/tidb/pull/6482) 37 | - [Uniform the calculation method of pseudo statistics](https://github.com/pingcap/tidb/pull/6483) 38 | - [Improve the CPU usage when `opentracing` is not enabled](https://github.com/pingcap/tidb/pull/6494) 39 | 40 | # Weekly update in TiKV and PD 41 | 42 | Last week, we landed [24 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-05-07..2018-05-13&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 43 | 44 | ## Added 45 | 46 | - [Support `reverse_scan`](https://github.com/pingcap/tikv/pull/3033) 47 | 48 | ## Fixed 49 | 50 | - [Check learner regardless of whether learner is enabled or not](https://github.com/pingcap/pd/pull/1053) 51 | - [Use `AtomicU64` instead of `RwLock` to track the snapshot size](https://github.com/pingcap/tikv/pull/3020) 52 | 53 | ## Improved 54 | 55 | - [Migrate CircleCI 1.0 to 2.0](https://github.com/pingcap/tikv/pull/2993) 56 | - [Ignore `Lock` when lock's type is `Lock`](https://github.com/pingcap/tikv/pull/3011) 57 | - [Decode the number by accessing `slice` directly](https://github.com/pingcap/tikv/pull/3028) -------------------------------------------------------------------------------- /2018-06-04-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (May 28 ~ June 03, 2018) 3 | date: 2018-06-04 4 | summary: Last week, we landed 50 PRs in the TiDB repositories, 2 PRs in the TiSpark repositories, and 20 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [50 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-05-28..2018-06-03) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support the `Trace` syntax](https://github.com/pingcap/tidb/pull/6644) 15 | - [Support the `TIDB_IS_DDL_OWNER` builtin function ](https://github.com/pingcap/tidb/pull/6682) 16 | - [Support `ALL` for builtin aggregate function `BIT_AND`/`BIT_OR`/`BIT_XOR`](https://github.com/pingcap/tidb/pull/6685) 17 | 18 | ## Fixed 19 | 20 | - [Check the correctness of decimal's exponent part](https://github.com/pingcap/tidb/pull/6631) 21 | - [Fix the affected row count for the `UPDATE` statement](https://github.com/pingcap/tidb/pull/6656) 22 | - [Fix the range construction for the `IN` builtin function](https://github.com/pingcap/tidb/pull/6667) 23 | - [Fix the empty result of the `JOIN` statement](https://github.com/pingcap/tidb/pull/6669) 24 | - [Fix row count estimation for the `LIMIT` operator](https://github.com/pingcap/tidb/pull/6679) 25 | - [Fix the error message of the `DIV` builtin function](https://github.com/pingcap/tidb/pull/6683) 26 | - [Check the schema name of the column for the `CREATE TABLE` statement](https://github.com/pingcap/tidb/pull/6708) 27 | - [Fix the side effect of casting one decimal to another decimal](https://github.com/pingcap/tidb/pull/6723) 28 | 29 | ## Improved 30 | 31 | - [Push `ABS` to TiKV](https://github.com/pingcap/tidb/pull/6571) 32 | - [Wait for a while when some errors occurred to avoid retrying the DDL job too many times](https://github.com/pingcap/tidb/pull/6601) 33 | - [Unify the log format of the connection ID](https://github.com/pingcap/tidb/pull/6670) 34 | - [Ignore foreign keys in the `SHOW CREATE TABLE` statement](https://github.com/pingcap/tidb/pull/6693) 35 | - [Change statistics delta update duration to 1 minute](https://github.com/pingcap/tidb/pull/6700) 36 | - [Check invalid tasks after physical optimization](https://github.com/pingcap/tidb/pull/6702) 37 | - [Unify the DDL logs](https://github.com/pingcap/tidb/pull/6719) 38 | 39 | # Weekly update in TiSpark 40 | 41 | Last week, we landed [2 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-05-28..2018-06-03) in the TiSpark repositories. 42 | 43 | ## Fixed 44 | 45 | - [Fix the `ScanIterator` logic where the index may be out of bound](https://github.com/pingcap/tispark/pull/357) 46 | 47 | ## Improved 48 | 49 | - [Update gRPC version to 1.12.0](https://github.com/pingcap/tispark/pull/359) 50 | 51 | # Weekly update in TiKV and PD 52 | 53 | Last week, we landed [20 PRs](https://github.com/search?p=1&q=repo:pingcap/tikv+repo:pingcap/pd+is:pr+is:merged+merged:2018-05-28..2018-06-03&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 54 | 55 | ## Added 56 | 57 | - [Encode and decode for arrow chunk](https://github.com/pingcap/tikv/pull/3001) 58 | 59 | ## Fixed 60 | 61 | - [Report an error instead of getting a result if the divisor/dividend is 0 in `do_div_mod`](https://github.com/pingcap/tikv/pull/3099) 62 | - [Fix the bug that the Learner flag mistakenly reports to PD](https://github.com/pingcap/tikv/pull/3112) 63 | 64 | ## Improved 65 | 66 | - [Remove `NumberDecoder` trait from `codec`](https://github.com/pingcap/tikv/pull/3108) 67 | - [Use the average Region size to check if stores need balance](https://github.com/pingcap/pd/pull/1085) 68 | - [Check the Region epoch before adding operators](https://github.com/pingcap/pd/pull/1095) 69 | 70 | # New contributors (Thanks!) 71 | 72 | TiDB： 73 | 74 | - [谷月轩](https://github.com/SilverRainZ) 75 | - [bb7133](https://github.com/bb7133) 76 | 77 | TiKV： 78 | 79 | - [bb7133](https://github.com/bb7133) -------------------------------------------------------------------------------- /2018-06-19-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 11 ~ June 17, 2018) 3 | date: 2018-06-19 4 | summary: Last week, we landed 26 PRs in the TiDB repositories and 28 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [26 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-06-11..2018-06-17) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support the MySQL syntax `show privileges`](https://github.com/pingcap/tidb/pull/6792) 15 | - [Add the limit for the number of columns when adding columns](https://github.com/pingcap/tidb/pull/6778) 16 | - [Add the sanity check of the precision and the scale for numeric types](https://github.com/pingcap/tidb/pull/6813) 17 | 18 | ## Fixed 19 | 20 | - [Fix the wrong results of the `CONCAT_WS` built-in function](https://github.com/pingcap/tidb/pull/6762) 21 | - [Fix a bug in right join when some predicates are pushed to the right table](https://github.com/pingcap/tidb/pull/6809) 22 | - [Fix the missing start timestamp for `TableDual` in a transaction](https://github.com/pingcap/tidb/pull/6830) 23 | 24 | ## Improved 25 | 26 | - [Refactor the structure of the DDL package](https://github.com/pingcap/tidb/pull/6449) 27 | - [Remove new lines and add the user information in the query log](https://github.com/pingcap/tidb/pull/6748) 28 | - [Make the limitation of query memory usage configurable](https://github.com/pingcap/tidb/pull/6788) 29 | - [Change the factor of the descending scan according to the improvement of descending scan performance in TiKV](https://github.com/pingcap/tidb/pull/6812) 30 | 31 | # Weekly update in TiKV and PD 32 | 33 | Last week, we landed [28 PRs](https://github.com/search?p=1&q=repo:pingcap/tikv+repo:pingcap/pd+is:pr+is:merged+merged:2018-06-11..2018-06-17&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 34 | 35 | ## Added 36 | 37 | - [Enable `prevote` in PD by default](https://github.com/pingcap/pd/pull/1103) 38 | - [Process approximate rows in Region](https://github.com/pingcap/pd/pull/1104) 39 | 40 | ## Fixed 41 | 42 | - [Fix the issue of escaping the `\xFF` sequences to a single byte](https://github.com/pingcap/tikv/pull/3182) 43 | 44 | ## Improved 45 | 46 | - [Shrink the pending command queue in `ApplyDelegate`](https://github.com/pingcap/tikv/pull/3106) 47 | - [Output a log when GC finds too many versions for a single key](https://github.com/pingcap/tikv/pull/3178) 48 | - [Upgrade `protobuf` and `grpcio`](https://github.com/pingcap/tikv/pull/3142) 49 | - [Support initialization empty Region in `tikv-ctl`](https://github.com/pingcap/tikv/pull/3178) 50 | - [Adjust the pending peer filter](https://github.com/pingcap/pd/pull/1110) 51 | 52 | # New contributors (Thanks!) 53 | 54 | TiDB: 55 | 56 | - [chenyang8094](https://github.com/chenyang8094) 57 | - [Angryrou](https://github.com/angryrou) 58 | 59 | TiKV: 60 | 61 | - [kbacha](https://github.com/kbacha) 62 | - [maninalift](https://github.com/maninalift) 63 | -------------------------------------------------------------------------------- /2018-06-25-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 18 ~ June 24, 2018) 3 | date: 2018-06-25 4 | summary: Last week, we landed 18 PRs in the TiDB repositories, 5 PRs in the TiSpark repositories, and 19 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [18 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is:pr+is:merged+merged:2018-06-18..2018-06-24) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support the binary fetch command](https://github.com/pingcap/tidb/pull/6648) 15 | - [Add a variable to disable auto-retry of the transaction block](https://github.com/pingcap/tidb/pull/6872) 16 | 17 | ## Fixed 18 | 19 | - [Allow comments to end up with multiple asterisks as MySQL does](https://github.com/pingcap/tidb/pull/6847) 20 | 21 | ## Improved 22 | 23 | - [Allow using `IndexJoin` in more scenarios](https://github.com/pingcap/tidb/pull/6664) 24 | - [Improve the performance of the `insert ignore on duplicate key update` statement](https://github.com/pingcap/tidb/pull/6760) 25 | - [Optimize the accuracy of index row count estimation](https://github.com/pingcap/tidb/pull/6869) 26 | 27 | # Weekly update in TiSpark 28 | 29 | Last week, we landed [5 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-06-18..2018-06-24) in the TiSpark repositories. 30 | 31 | ## Added 32 | 33 | - [Add deployment tools and information in `pom`](https://github.com/pingcap/tispark/pull/369) 34 | - [Add the code coverage report tool](https://github.com/pingcap/tispark/pull/368) 35 | 36 | # Weekly update in TiKV and PD 37 | 38 | Last week, we landed [19 PRs](https://github.com/search?p=2&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-06-18..2018-06-24&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 39 | 40 | ## Added 41 | 42 | - [Count each index prefix when executing the Analyze operation](https://github.com/pingcap/tikv/pull/3206) 43 | - [Allow configuring the timespan of log rotation](https://github.com/pingcap/tikv/pull/3219) 44 | - [Provide more RocksDB metrics](https://github.com/pingcap/tikv/pull/3209) 45 | 46 | ## Fixed 47 | 48 | - [Fix TiKV panic when multiplying specific decimals](https://github.com/pingcap/tikv/pull/3222) 49 | 50 | ## Improved 51 | 52 | - [Change the maximum size of the bucket for snapshot from 2G to 1T](https://github.com/pingcap/tikv/pull/3221) 53 | - Improve TiKV metrics performance [PR1](https://github.com/pingcap/tikv/pull/3227) [PR2](https://github.com/pingcap/tikv/pull/3225) 54 | - [Preserve logs instead of dropping logs when logs overflow](https://github.com/pingcap/tikv/pull/3191) 55 | 56 | # New contributors (Thanks!) 57 | 58 | TiDB: 59 | 60 | - [mz1999](https://github.com/mz1999) 61 | - [liuzhengyang](https://github.com/liuzhengyang) -------------------------------------------------------------------------------- /2018-07-09-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 02 ~ July 08, 2018) 3 | date: 2018-07-09 4 | summary: Last week, we landed 34 PRs in the TiDB repositories, 5 PRs in the TiSpark repositories, and 26 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [34 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-02..2018-07-08) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support session variables `warning_count` and `error_count`](https://github.com/pingcap/tidb/pull/6945) 15 | - [Support `BIT_OR` in the new aggregation function framework](https://github.com/pingcap/tidb/pull/6975) 16 | 17 | ## Fixed 18 | 19 | - [Fix the privilege bug when reusing chunks](https://github.com/pingcap/tidb/pull/6976) 20 | - [Fix the issue that the `Hash Aggregate` operator cannot exit](https://github.com/pingcap/tidb/pull/6982) 21 | - [Fix a panic on `Stream Aggregate`](https://github.com/pingcap/tidb/pull/6984) 22 | - [Fix the results of `SHOW CREATE TABLE` when adding indices](https://github.com/pingcap/tidb/pull/6993) 23 | - [Fix the results of non-integer inputs for bit related aggregate functions](https://github.com/pingcap/tidb/pull/6994) 24 | 25 | ## Improved 26 | 27 | - [Use feedback to refine updating statistics information](https://github.com/pingcap/tidb/pull/6796) 28 | - [Refactor statistics updating mechanism to speed up analyzing tables](https://github.com/pingcap/tidb/pull/6901) 29 | - [Allow the user to kill his own connections without the `SUPER` privilege](https://github.com/pingcap/tidb/pull/6954) 30 | 31 | # Weekly update in TiSpark 32 | 33 | Last week, we landed [5 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-02..2018-07-08) in the TiSpark repositories. 34 | 35 | ## Improved 36 | 37 | - [Allow TiSpark to retrieve row ID](https://github.com/pingcap/tispark/pull/367) 38 | - [Add more rules for `scalafmt`](https://github.com/pingcap/tispark/pull/386) 39 | 40 | ## Fixed 41 | 42 | - [Fix the issue that the scan iterator throws `NoSuchElement Exception` when encountering the last Region](https://github.com/pingcap/tispark/pull/383) 43 | - [Fix the issue that tispark-sql `dbName` is displayed as the table name](https://github.com/pingcap/tispark/pull/379) 44 | 45 | # Weekly update in TiKV and PD 46 | 47 | Last week, we landed [26 PRs](https://github.com/search?p=1&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-07-02..2018-07-08&type=Issues&utf8=%E2%9C%93) in the TiKV and PD repositories. 48 | 49 | ## Added 50 | 51 | - [Add a new scalar function `multiply_int_unsigned`](https://github.com/pingcap/tikv/pull/3277) 52 | - [Support getting Region approximate middle key by tikv-ctl](https://github.com/pingcap/tikv/pull/3260) 53 | - [Add an option to restrict the number of RocksDB log files](https://github.com/pingcap/tikv/pull/3259) 54 | - [Add the development workflow file for PD](https://github.com/pingcap/pd/pull/1141) 55 | 56 | ## Fixed 57 | 58 | - [Fix the split check bug when `region_max_size` equals to `region_split_size`](https://github.com/pingcap/tikv/pull/3274) 59 | - [Fix the panic issue when no operator is produced by the adjacent Region scheduler](https://github.com/pingcap/pd/pull/1139) 60 | - [Fix the issue that the store space is used up due to moving replicas](https://github.com/pingcap/pd/pull/1138) 61 | 62 | ## Improved 63 | 64 | - [Use `crossbeam-channel` to improve the performance](https://github.com/pingcap/tikv/pull/3278) 65 | - [Enlarge the total slots of the scheduler latch](https://github.com/pingcap/tikv/pull/3283) 66 | - [Exit all Goroutines ASAP when the PD client is closed](https://github.com/pingcap/pd/pull/1135) 67 | - [Send back HTTP 400 where there is a client error](https://github.com/pingcap/pd/pull/1131) 68 | 69 | # New contributors (Thanks!) 70 | 71 | - TiDB: [zbdba](https://github.com/zbdba) 72 | - TiSpark: [gkdoc](https://github.com/gkdoc) 73 | - TiKV: [GuillaumeGomez](https://github.com/GuillaumeGomez) -------------------------------------------------------------------------------- /2018-07-16-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 09 ~ July 15, 2018) 3 | date: 2018-07-16 4 | summary: Last week, we landed 30 PRs in the TiDB repositories and 19 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-09..2018-07-15) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support `BIT_AND`/`BIT_XOR` in the new aggregation framework](https://github.com/pingcap/tidb/pull/7004) 15 | - [Support `COUNT` in the new aggregation framework](https://github.com/pingcap/tidb/pull/7009) 16 | - [Support `AVG(DISTINCT)` in the new aggregation framework](https://github.com/pingcap/tidb/pull/7015) 17 | - [Add the `GENERATION_EXPRESSION` column in `information_schema.columns`](https://github.com/pingcap/tidb/pull/7017) 18 | - [Support more syntactic rules regarding the `SET` syntax](https://github.com/pingcap/tidb/pull/7020) 19 | - [Support `ADMIN SHOW DDL JOBS ` to specify the lines of the results](https://github.com/pingcap/tidb/pull/7020) 20 | - [Support showing `AUTO_INCREMENT` in `information_schema.tables`](https://github.com/pingcap/tidb/pull/7037) 21 | 22 | ## Fixed 23 | 24 | - [Fix a bug in `INSERT SELECT FROM ON DUPLICATE KEY UPDATE`](https://github.com/pingcap/tidb/pull/6593) 25 | - [Fix the numeric type overflow in the binary protocol](https://github.com/pingcap/tidb/pull/6922) 26 | - [Fix the results of decimal `Minus`/`Round`/`Mul`](https://github.com/pingcap/tidb/pull/7001) 27 | 28 | ## Improved 29 | 30 | - [Check the schema when the DDL fails](https://github.com/pingcap/tidb/pull/6797) 31 | - [Refine the `explain` result format](https://github.com/pingcap/tidb/pull/7011) 32 | - [Speed up `autoAnalyze` when data is unchanged](https://github.com/pingcap/tidb/pull/7022) 33 | 34 | # Weekly update in TiKV and PD 35 | 36 | Last week, we landed [19 PRs](https://github.com/search?q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-07-09..2018-07-15&type=Issues) in the TiKV and PD repositories. 37 | 38 | ## Added 39 | 40 | - [Add new builtin UDFs `regexp` and `regexp_binary`](https://github.com/pingcap/tikv/pull/3196) 41 | - [Introduce the `loose` channel](https://github.com/pingcap/tikv/pull/3286) 42 | - [Add options to disable replica-checker features](https://github.com/pingcap/pd/pull/1140) 43 | - [Support filtering JSON output by calling the external `jq`](https://github.com/pingcap/pd/pull/1126) 44 | 45 | ## Fixed 46 | 47 | - [Fix the unexpected behavior of tikv-ctl `unsafe-recover` command](https://github.com/pingcap/tikv/pull/3125) 48 | 49 | ## Improved 50 | 51 | - [Report `approximate_keys` instead of `approximate_rows`](https://github.com/pingcap/tikv/pull/3295) 52 | - [Add TiKV adopters and Roadmap](https://github.com/pingcap/tikv/pull/3301) 53 | - [Update `rustc` and `clippy`](https://github.com/pingcap/tikv/pull/3302) 54 | 55 | # New contributor (Thanks!) 56 | 57 | docs: [brunoban](https://github.com/brunoban) -------------------------------------------------------------------------------- /2018-07-30-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 23 ~ July 29, 2018) 3 | date: 2018-07-30 4 | summary: Last week, we landed 43 PRs in the TiDB repositories, 6 PRs in the TiSpark repositories, and 17 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [43 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-23..2018-07-29+) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Add the `sum_decimal` method for `AggFunc`](https://github.com/pingcap/tidb/pull/7096) 15 | - [Support truncating and dropping partitioned tables](https://github.com/pingcap/tidb/pull/7036) 16 | - [Implement the reorganization of table partition when adding the index](https://github.com/pingcap/tidb/pull/6814) 17 | 18 | ## Fixed 19 | 20 | - [Fix a bug that the `bit` and `year column` types are not supported when a partition table is created](https://github.com/pingcap/tidb/pull/7122) 21 | - [Fix a bug in the decimal modulo operation](https://github.com/pingcap/tidb/pull/7113) 22 | - [Refactor the code of building `Insert`](https://github.com/pingcap/tidb/pull/7068) 23 | - [Fix a panic caused by the outdated feedback](https://github.com/pingcap/tidb/pull/7128) 24 | - [Fix a panic that is upgraded from the old version TiDB](https://github.com/pingcap/tidb/pull/7136) 25 | - [Fix a bug that null values cannot be found using the unique index](https://github.com/pingcap/tidb/pull/7163) 26 | 27 | ## Improved 28 | 29 | - [Add the partition function check when creating a partition table](https://github.com/pingcap/tidb/pull/7111) 30 | - [Provide preliminary support for the parallel DDL operation](https://github.com/pingcap/tidb/pull/6955) 31 | - [Use `feedback` timely](https://github.com/pingcap/tidb/pull/6859) 32 | - [Optimize `DecodeRowKey`](https://github.com/pingcap/tidb/pull/7149) 33 | - [Remove the `types.Row` interface](https://github.com/pingcap/tidb/pull/7170) 34 | - [Pass `row pointer` rather than `row` to avoid `convertT2I`](https://github.com/pingcap/tidb/pull/7143) 35 | 36 | # Weekly update in TiSpark 37 | 38 | Last week, we landed [6 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-23..2018-07-29) in the TiSpark repositories. 39 | 40 | ## Fixed 41 | 42 | - [Fix a decimal decoding bug](https://github.com/pingcap/tispark/pull/401) 43 | 44 | # Weekly update in TiKV and PD 45 | 46 | Last week, we landed [17 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-07-23..2018-07-29) in the TiKV and PD repositories. 47 | 48 | ## Added 49 | 50 | - [Support encoding and decoding a Chunk](https://github.com/pingcap/tikv/pull/3332) 51 | - [Introduce a version check mechanism](https://github.com/pingcap/pd/pull/1148) 52 | - [Add thread I/O metrics](https://github.com/pingcap/tikv/pull/3338) 53 | - [Add a document about the PD API](https://github.com/pingcap/pd/pull/1105) 54 | 55 | ## Fixed 56 | 57 | - [Fix a bug in `AdjacentRegionScheduler`](https://github.com/pingcap/pd/pull/1158) 58 | 59 | ## Improved 60 | 61 | - [Keep the number of operators generated by `HotRegionScheduler` within the schedule limit](https://github.com/pingcap/pd/pull/1155) 62 | - [Stop searching in `get_txn_commit_info`](https://github.com/pingcap/tikv/pull/3308) 63 | - [Check the legality of the label](https://github.com/pingcap/pd/pull/1154) 64 | - [Escape key in `Error`](https://github.com/pingcap/tikv/pull/3361) 65 | - [Refine the task log in `raftstore`](https://github.com/pingcap/tikv/pull/3339) 66 | 67 | # New contributor (Thanks!) 68 | 69 | - tidb: [laidahe](https://github.com/laidahe) 70 | -------------------------------------------------------------------------------- /2018-08-06-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (July 30 ~ August 05, 2018) 3 | date: 2018-08-06 4 | summary: Last week, we landed 68 PRs in the TiDB repositories and 30 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [68 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-07-30..2018-08-05+) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support the `Delete` operation for table partition](https://github.com/pingcap/tidb/pull/7147) 15 | - [Support analyzing the partition table](https://github.com/pingcap/tidb/pull/7190) 16 | 17 | ## Fixed 18 | 19 | - [Fix the union result when mixing signed and unsigned columns](https://github.com/pingcap/tidb/pull/7112) 20 | - [Add `BatchPut` for `RawKV`](https://github.com/pingcap/tidb/pull/7135) 21 | - [Fix a bug about wrong copying in index join](https://github.com/pingcap/tidb/pull/7150) 22 | - [Fix a panic caused by the local feedback](https://github.com/pingcap/tidb/pull/7152) 23 | - [Fix a bug in decimal multiplication](https://github.com/pingcap/tidb/pull/7208) 24 | - [Sort user records in the privilege cache](https://github.com/pingcap/tidb/pull/7211) 25 | - [Fix `TruncateTo`](https://github.com/pingcap/tidb/pull/7234) 26 | - [Fix a bug of update with an outer join](https://github.com/pingcap/tidb/pull/7177) 27 | - [Fix `admin cleanup index` for non-unique handles in a unique index](https://github.com/pingcap/tidb/pull/7248) 28 | - [Fix a bug when eliminating a projection](https://github.com/pingcap/tidb/pull/7257/files) 29 | - [Skip inner rows when the join keys contain `NULL`](https://github.com/pingcap/tidb/pull/7255) 30 | 31 | ## Improved 32 | 33 | - [Support fast path point select](https://github.com/pingcap/tidb/pull/6937) 34 | - [Always choose the smaller child as the outer table for `IndexJoin`](https://github.com/pingcap/tidb/pull/7019) 35 | - [Remove `FromID` from `expression.Column`](https://github.com/pingcap/tidb/pull/7157) 36 | - [Add default value check of the primary key when creating a table](https://github.com/pingcap/tidb/pull/7169) 37 | - [Use the revive linter](https://github.com/pingcap/tidb/pull/7197) 38 | 39 | # Weekly update in TiKV and PD 40 | 41 | Last week, we landed [30 PRs](https://github.com/search?p=2&q=repo%3Apingcap%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-07-30..2018-08-05&type=Issues) in the TiKV and PD repositories. 42 | 43 | ## Added 44 | 45 | - [Support specifying the time zone by name](https://github.com/pingcap/tikv/pull/3281) 46 | - [Add etcd Raft state metrics](https://github.com/pingcap/pd/pull/1172) 47 | - [Add hierarchy in the error code](https://github.com/pingcap/pd/pull/1156) 48 | 49 | ## Fixed 50 | 51 | - [Fix the issue that the operator kind is not set correctly](https://github.com/pingcap/pd/pull/1176) 52 | - [Fix a bug in `from_bytes`](https://github.com/pingcap/tikv/pull/3377) 53 | - [Perform GC on stale peers which send pre-vote messages](https://github.com/pingcap/tikv/pull/3369) 54 | 55 | ## Improved 56 | 57 | - [Use `RangeProperties` instead of `SizeProperties`](https://github.com/pingcap/tikv/pull/3322) 58 | - [Optimize `scan_lock`](https://github.com/pingcap/tikv/pull/3350) 59 | - [Refactor Row in the executor](https://github.com/pingcap/tikv/pull/3359) 60 | - [Avoid reading etcd if possible](https://github.com/pingcap/pd/pull/1164) 61 | - [Reduce `Key` related `memcpy`](https://github.com/pingcap/tikv/pull/3372) 62 | - [Export the `seek_region` interface](https://github.com/pingcap/tikv/pull/3107) 63 | 64 | # New contributors (Thanks!) 65 | 66 | TiDB: 67 | 68 | - [hhxcc](https://github.com/hhxcc) 69 | 70 | TiKV: 71 | 72 | - [TennyZhuang](https://github.com/TennyZhuang) 73 | - [lerencao](https://github.com/lerencao) 74 | 75 | TiSpark: 76 | 77 | - [ariesdevil](https://github.com/ariesdevil) 78 | 79 | docs-cn: 80 | 81 | - [motian](https://github.com/motian) -------------------------------------------------------------------------------- /2018-08-13-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 06 ~ August 12, 2018) 3 | date: 2018-08-13 4 | summary: Last week, we landed 46 PRs in the TiDB repositories and 27 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [46 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-08-06..2018-08-12+) in the TiDB repositories. 11 | 12 | ## Added 13 | 14 | - [Support the `Update` operation for table partition](https://github.com/pingcap/tidb/pull/7166) 15 | - [Support the prefix index in `admin check table`](https://github.com/pingcap/tidb/pull/7241) 16 | 17 | ## Fixed 18 | 19 | - [Fix behaviors of builtin `LTrim`, `RTrim` and `Trim`](https://github.com/pingcap/tidb/pull/7291) 20 | - [Fix `group_concat(a)` when `a` is null](https://github.com/pingcap/tidb/pull/7287) 21 | - [Make `USE INDEX(PRIMARY)` work on the integer primary key](https://github.com/pingcap/tidb/pull/7298) 22 | - [Fix `admin check table` false alarm when the index contains the `pkIsHandle` column](https://github.com/pingcap/tidb/pull/7317) 23 | - [Fix inconsistent row count estimation](https://github.com/pingcap/tidb/pull/7233) 24 | - [Fix a bug when applying the `RenameTable` diff](https://github.com/pingcap/tidb/pull/7336) 25 | 26 | ## Improved 27 | 28 | - [Perform the batch check for the constrains when adding a unique index](https://github.com/pingcap/tidb/pull/7132) 29 | - [Remove `Exists` in `plan` and `executor`](https://github.com/pingcap/tidb/pull/7207) 30 | - [Disable the Read Committed isolation level](https://github.com/pingcap/tidb/pull/7280) 31 | - [Refactor `joinResultGenerator` to handle the unmatched outer records](https://github.com/pingcap/tidb/pull/7288) 32 | - [Adjust the way of checking all the schema versions](https://github.com/pingcap/tidb/pull/7319) 33 | - [Update the import path from `coreos/gofail` to `etcd-io/gofail` to fix CI](https://github.com/pingcap/tidb/pull/7329) 34 | 35 | # Weekly update in TiKV and PD 36 | 37 | Last week, we landed [27 PRs](https://github.com/search?p=1&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-08-06..2018-08-13&type=Issues) in the TiKV and PD repositories. 38 | 39 | ## Added 40 | 41 | - Support more functions in Coprocessor: 42 | 43 | - [`upper/lower`](https://github.com/tikv/tikv/pull/3433) 44 | - [`bin`](https://github.com/tikv/tikv/pull/3397) 45 | - [`PI`](https://github.com/tikv/tikv/pull/3382) 46 | - [`interval`](https://github.com/tikv/tikv/pull/3330) 47 | 48 | - [Support splitting Regions by the number of keys](https://github.com/tikv/tikv/pull/3317) 49 | - [Make PD support allocating timestamp after recovering from incorrect system time](https://github.com/pingcap/pd/pull/1173) 50 | 51 | ## Fixed 52 | 53 | - [Fix the TiKV panic when the decimal overflows](https://github.com/tikv/tikv/pull/3343) 54 | - [Prevent `dynamic-level-size` from being turned on for existing TiKV clusters](https://github.com/tikv/tikv/pull/3348/files) 55 | 56 | ## Improved 57 | 58 | - [Output unit `B` in tikv-ctl](https://github.com/tikv/tikv/pull/3421) 59 | - [Improve TiKV Read flow statistics accuracy](https://github.com/tikv/tikv/pull/3402) 60 | - Improve the TiKV performance: 61 | 62 | - [PR1](https://github.com/tikv/tikv/pull/3429) 63 | - [PR2](https://github.com/tikv/tikv/pull/3419) 64 | - [PR3](https://github.com/tikv/tikv/pull/2639) 65 | 66 | - [Improve the PD performance](https://github.com/pingcap/pd/pull/1180) 67 | - [Improve the TiKV log output](https://github.com/tikv/tikv/pull/3416) 68 | - [Add a test for time fallback in PD](https://github.com/pingcap/pd/pull/1186) 69 | - [Improve the PD error code](https://github.com/pingcap/pd/pull/1167) 70 | 71 | # New contributors (Thanks!) 72 | 73 | docs-cn: 74 | 75 | - Lunatictwo 76 | 77 | TiKV: 78 | 79 | - [smallyard](https://github.com/smallyard) 80 | - [sweetIan](https://github.com/sweetIan) 81 | -------------------------------------------------------------------------------- /2018-08-27-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 20 ~ August 26, 2018) 3 | date: 2018-08-27 4 | summary: Last week, we landed 34 PRs in the TiDB repository, 3 PRs in the TiSpark repository, and 27 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD', 'TiSpark'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [34 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-08-20..2018-08-26+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Make the query feedback work for the partitioned table](https://github.com/pingcap/tidb/pull/7394) 15 | - [Support a new aggregate framework for `HashAggExec`](https://github.com/pingcap/tidb/pull/7268) 16 | 17 | ## Fixed 18 | 19 | - [Fix a bug when using a correlated column as the index](https://github.com/pingcap/tidb/pull/7357) 20 | - [Fix the `prepare` result for zero `timestamp`/`time`/`datetime`](https://github.com/pingcap/tidb/pull/7415) 21 | - [Fix the `Enum` type flag bug](https://github.com/pingcap/tidb/pull/7438) 22 | - [Make partition by range value accept the constant expression](https://github.com/pingcap/tidb/pull/7442) 23 | - [Fix `concat` in the `GROUP` statement](https://github.com/pingcap/tidb/pull/7448) 24 | - [Fix selecting null value for table partition](https://github.com/pingcap/tidb/pull/7452) 25 | - [Use the unified `infoschema` in `select ... information_schema.tables`](https://github.com/pingcap/tidb/pull/7459) 26 | - [Fix the `Format` function for the `Mod` opcode](https://github.com/pingcap/tidb/pull/7455) 27 | 28 | ## Improved 29 | 30 | - [Split ranges if the slice is too big](https://github.com/pingcap/tidb/pull/7454) 31 | - [Execute the `admin` command with `Super_priv`](https://github.com/pingcap/tidb/pull/7486) 32 | 33 | # Weekly update in TiSpark 34 | 35 | Last week, we landed [3 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-08-20..2018-08-26) in the TiSpark repository. 36 | 37 | ## Added 38 | 39 | - [Decode `JSON` to `string`](https://github.com/pingcap/tispark/pull/417) 40 | 41 | # Weekly update in TiKV and PD 42 | 43 | Last week, we landed [27 PRs](https://github.com/search?p=1&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-08-20..2018-08-26&type=Issues) in the TiKV and PD repositories. 44 | 45 | ## Added 46 | 47 | - Add new built-in functions: 48 | 49 | - [`builtin-cos`](https://github.com/tikv/tikv/pull/3410) 50 | - [`builtin-date`](https://github.com/tikv/tikv/pull/3428) 51 | - [`builtin-inet6_aton`](https://github.com/tikv/tikv/pull/3480) 52 | 53 | - [Support producing multiple split keys in `split-checker`](https://github.com/tikv/tikv/pull/3464) 54 | 55 | ## Fixed 56 | 57 | - [Update `approximate_size` and `approximate_keys` after the Region is merged](https://github.com/tikv/tikv/pull/3497) 58 | 59 | ## Improved 60 | 61 | - [Make a more efficient workflow for Raft `LocalReader`](https://github.com/tikv/tikv/pull/3443) 62 | - [Remove the `IsolationLevel` and `ScanMode` options from `MvccTxn`](https://github.com/tikv/tikv/pull/3445) 63 | - [Handle the API error properly instead of turning them into gRPC errors](https://github.com/tikv/tikv/pull/3450) 64 | - [Add new forward/backward Scanners to improve the `scan` performance](https://github.com/tikv/tikv/pull/3458) 65 | - [Try `ask_split` when `ask_batch_split` is incompatible](https://github.com/tikv/tikv/pull/3459) 66 | - [Associate a buffer to `AggFuncExpr` to reduce memory allocation](https://github.com/tikv/tikv/pull/3490) 67 | 68 | # New contributors (Thanks!) 69 | 70 | TiKV: 71 | 72 | - [hawkingrei](https://github.com/hawkingrei) 73 | - [niedhui](https://github.com/niedhui) 74 | - [vkorenev](https://github.com/vkorenev) 75 | 76 | TiSpark: 77 | 78 | - [alex-lx](https://github.com/alex-lx) -------------------------------------------------------------------------------- /2018-11-26-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (November 19 ~ November 25, 2018) 3 | date: 2018-11-26 4 | summary: Last week, we landed 46 PRs in the TiDB repository, 2 PRs in the TiSpark repository, and 20 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [46 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-11-19..2018-11-25+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add the http API to get database and table information](https://github.com/pingcap/tidb/pull/8256) 15 | - [Propose the table partition design](https://github.com/pingcap/tidb/pull/7969) 16 | - [Support creating hash partitioned tables](https://github.com/pingcap/tidb/pull/8026) 17 | 18 | ## Improved 19 | 20 | - [Add missing columns for `information_schema.files`](https://github.com/pingcap/tidb/pull/8387) 21 | - [Impose user authentication for unix socket connections](https://github.com/pingcap/tidb/pull/8381) 22 | - [Redesign the `trace` statement with JSON output](https://github.com/pingcap/tidb/pull/8357) 23 | - [Support JSON as the return type for the `case` expression](https://github.com/pingcap/tidb/pull/8355) 24 | - [Preallocate the columns array in `MutRow` to avoid array resizing](https://github.com/pingcap/tidb/pull/8348) 25 | - [Support subqueries in the `Do` statement](https://github.com/pingcap/tidb/pull/8343) 26 | - [Add the memory guard to prevent OOM caused by the plan cache](https://github.com/pingcap/tidb/pull/8339) 27 | - [Clean up the plan cache entry in the `Deallocate` statement](https://github.com/pingcap/tidb/pull/8332) 28 | - [Support `ADMIN CHECK TABLE`/`ADMIN CHECK INDEX` using specified `tidb_snapshot`](https://github.com/pingcap/tidb/pull/8172) 29 | 30 | ## Fixed 31 | 32 | - [Fix incorrect privilege check for the `UPDATE` statement](https://github.com/pingcap/tidb/pull/8376) 33 | - [Fix the bootstrap error when the SQL mode is set to `ANSI`](https://github.com/pingcap/tidb/pull/8353) 34 | - [Make sure goroutines of HashJoin exit before its `Close` returns](https://github.com/pingcap/tidb/pull/8338) 35 | - [Remove partition IDs for partition tables in `DROP DATABASE`](https://github.com/pingcap/tidb/pull/8319) 36 | - [Fix the panic caused by EOF when Coprocessor is in the streaming mode](https://github.com/pingcap/tidb/pull/8297) 37 | 38 | # Weekly update in TiSpark 39 | 40 | Last week, we landed [2 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-11-19..2018-11-25+) in the TiSpark repository. 41 | 42 | ## Added 43 | 44 | - [Support raw partition Read](https://github.com/pingcap/tispark/pull/495) 45 | 46 | # Weekly update in TiKV and PD 47 | 48 | Last week, we landed [20 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-11-19..2018-11-25&type=Issues) in the TiKV and PD repositories. 49 | 50 | ## Added 51 | 52 | - [Support interactive Region scan in pd-ctl](https://github.com/pingcap/pd/pull/1320) 53 | - [Add the history index to `sync` when `stream` is established](https://github.com/pingcap/pd/pull/1305) 54 | - [Add normal index scan benchmarks](https://github.com/tikv/tikv/pull/3814) 55 | 56 | ## Improved 57 | 58 | - [Improve Region key print](https://github.com/pingcap/pd/pull/1335) 59 | - [Move unrelated benchmarks into individual directories](https://github.com/tikv/tikv/pull/3809) 60 | - [Check the `conf` version for `split`](https://github.com/tikv/tikv/pull/3807) 61 | 62 | ## Fixed 63 | 64 | - [Fix a deadlock in `GetOpInfluence`](https://github.com/pingcap/pd/pull/1340) 65 | - [Fix the issue that configurations cannot be set to zero values](https://github.com/pingcap/pd/pull/1334) 66 | - [Fix `go mod tidy` in PD](https://github.com/pingcap/pd/pull/1330) 67 | 68 | # New contributor (Thanks!) 69 | 70 | docs-cn: [bugwz](https://github.com/bugwz) -------------------------------------------------------------------------------- /2018-12-24-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (December 17 ~ December 23, 2018) 3 | date: 2018-12-24 4 | summary: Last week, we landed 48 PRs in the TiDB repository and 29 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [48 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2018-12-17..2018-12-23) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add the `CFB` mode for the `AES` encryption](https://github.com/pingcap/tidb/pull/8760) 15 | - [Implement the basic `CreateView` feature](https://github.com/pingcap/tidb/pull/8571) 16 | - [Add the HTTP API to query hot tables/indexes](https://github.com/pingcap/tidb/pull/7890) 17 | 18 | ## Improved 19 | 20 | - [Make `Admin Check Table` only check the public index](https://github.com/pingcap/tidb/pull/8748) 21 | - [Handle non-BMP characters in the UTF-8 charset](https://github.com/pingcap/tidb/pull/8738) 22 | - [Specify the sort order for the columns in the `physical` property](https://github.com/pingcap/tidb/pull/8715) 23 | - [Refactor error handling of transactions](https://github.com/pingcap/tidb/pull/8712) 24 | - [Close all connections directly when terminating TiDB](https://github.com/pingcap/tidb/pull/8692) 25 | - [Ignore the unknown hint and return a warning](https://github.com/pingcap/tidb/pull/8685) 26 | - [Support specifying the ending of a range to be scanned](https://github.com/pingcap/tidb/pull/8602) 27 | - [Add the extra information message to be sent to the MySQL client](https://github.com/pingcap/tidb/pull/8285) 28 | 29 | ## Fixed 30 | 31 | - [Fix the wrong output of `Show Master Status`](https://github.com/pingcap/tidb/pull/8737) 32 | - [Fix the incorrect result related to the `Duration` columns](https://github.com/pingcap/tidb/pull/8725) 33 | - [Fix the compatibility problem of renaming tables](https://github.com/pingcap/tidb/pull/8709) 34 | - [Correct the column name with the unary plus sign](https://github.com/pingcap/tidb/pull/8702) 35 | - [Handle corner cases for `auto_increment` columns](https://github.com/pingcap/tidb/pull/8181) 36 | 37 | # Weekly update in TiKV and PD 38 | 39 | Last week, we landed [29 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2018-12-17..2018-12-23&type=Issues) in the TiKV and PD repositories. 40 | 41 | ## Added 42 | 43 | - [Add `lpad` and `lpad_binary` built-in functions](https://github.com/tikv/tikv/pull/3943) 44 | - [Add `add_datetime_and_duration`, `add_datetime_and_string` and `add_time_datetime_null` built-in functions](https://github.com/tikv/tikv/pull/3899) 45 | - [Add an HTTP port for Prometheus](https://github.com/tikv/tikv/pull/3855) 46 | - [Introduce the Raftstore router](https://github.com/tikv/tikv/pull/3916) 47 | 48 | ## Improved 49 | 50 | - [Check overlapped Regions for the new Region](https://github.com/pingcap/pd/pull/1377) 51 | - [Remove the disturbing log when the store is `tombstone`](https://github.com/pingcap/pd/pull/1382) 52 | 53 | ## Fixed 54 | 55 | - [Fix the possible panic issue caused by `Approximate Size Split`](https://github.com/tikv/tikv/pull/3942) 56 | - [Fix a bug about Region merge in the case of multiple snapshots](https://github.com/tikv/tikv/pull/3873) 57 | 58 | # New contributors (Thanks!) 59 | 60 | tidb-operator: 61 | 62 | - [queenliuxx](https://github.com/queenliuxx) 63 | 64 | tidb: 65 | 66 | - [cuining](https://github.com/cuining) 67 | - [kjzz](https://github.com/kjzz) 68 | 69 | parser: 70 | 71 | - [TennyZhuang](https://github.com/TennyZhuang) 72 | - [caohe](https://github.com/caohe) 73 | - [exialin](https://github.com/exialin) 74 | - [hanchuanchuan](https://github.com/hanchuanchuan) 75 | - [honestold3](https://github.com/honestold3) 76 | - [kangkaisen](https://github.com/kangkaisen) 77 | - [knarfeh](https://github.com/knarfeh) 78 | - [tony612](https://github.com/tony612) -------------------------------------------------------------------------------- /2019-01-28-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 21 ~ January 27, 2019) 3 | date: 2019-01-28 4 | summary: Last week, we landed 22 PRs in the TiDB repository, 1 PR in the TiSpark repository, and 20 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [22 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-01-21..2019-01-27+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add a variable to control whether to check MB4 characters in the UTF-8 charset](https://github.com/pingcap/tidb/pull/9175) 15 | 16 | ## Improved 17 | 18 | - [Log failure reasons for `AutoAnalyze`](https://github.com/pingcap/tidb/pull/9178) 19 | - [Log the reason why `AutoAnalyze` is triggered](https://github.com/pingcap/tidb/pull/9176) 20 | - [Improve the message compatibility with MySQL when setting up connections with the server](https://github.com/pingcap/tidb/pull/9140) 21 | - [Improve the syntax error code and message compatibility with MySQL](https://github.com/pingcap/tidb/pull/9103) 22 | 23 | ## Fixed 24 | 25 | - [Use a separate `backoffer` structure for asynchronous commits](https://github.com/pingcap/tidb/pull/9119) 26 | - [Prohibit altering tables from the binary charset to `utf8mb4`](https://github.com/pingcap/tidb/pull/9107) 27 | - [Fix wrong results of queries that contain `any`/`all`](https://github.com/pingcap/tidb/pull/9106) 28 | - [Resolve the charset of table columns correctly](https://github.com/pingcap/tidb/pull/9105) 29 | 30 | # Weekly update in TiSpark 31 | 32 | Last week, we landed [1 PR](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-01-21..2019-01-27+) in the TiSpark repository. 33 | 34 | ## Fixed 35 | 36 | - [Fix case sensitive configurations](https://github.com/pingcap/tispark/pull/557) 37 | 38 | # Weekly update in TiKV and PD 39 | 40 | Last week, we landed [20 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-01-21..2019-01-27&type=Issues) in the TiKV and PD repositories. 41 | 42 | ## Improved 43 | 44 | - [Update etcd in PD](https://github.com/pingcap/pd/pull/1414) 45 | - [Make the hot Region scheduler configurable](https://github.com/pingcap/pd/pull/1412) 46 | 47 | ## Fixed 48 | 49 | - [Fix the event listener issue by checking the `CompactionJobInfos` status](https://github.com/tikv/tikv/pull/4126) 50 | - [Fix the `is_point` usage issue in `IndexScanExecutor`](https://github.com/tikv/tikv/pull/4119) 51 | - [Fix the GC state of invalid logs](https://github.com/tikv/tikv/pull/4090) 52 | 53 | # New contributors (Thanks!) 54 | 55 | tidb: 56 | 57 | - [hueypark](https://github.com/hueypark) 58 | 59 | tikv: 60 | 61 | - [fredchenbj](https://github.com/fredchenbj) 62 | 63 | parser: 64 | 65 | - [arnkore](https://github.com/arnkore) 66 | 67 | docs-cn: 68 | 69 | - [tender-boluo](https://github.com/tender-boluo) -------------------------------------------------------------------------------- /2019-02-11-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 28 ~ February 10, 2019) 3 | date: 2019-02-11 4 | summary: Last two weeks, we landed 25 PRs in the TiDB repository, 2 PRs in the TiSpark repository, and 23 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last two weeks, we landed [25 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-01-28..2019-02-10+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add the `tidb_indexes` table in `infoschema`](https://github.com/pingcap/tidb/pull/9183) 15 | 16 | ## Improved 17 | 18 | - [Enable the `any_value` function in aggregation if `ONLY_FULL_GROUP_BY` is set](https://github.com/pingcap/tidb/pull/9255) 19 | - [Improve the compatibility of the `format` function with MySQL](https://github.com/pingcap/tidb/pull/9182) 20 | - [Support the JSON type for the `COALESCE` built-in function](https://github.com/pingcap/tidb/pull/9087) 21 | - [Rewrite the exact `like` expression to the equal condition](https://github.com/pingcap/tidb/pull/9071) 22 | - [Derive the `col is not null` condition from `col op col`](https://github.com/pingcap/tidb/pull/8603) 23 | 24 | ## Fixed 25 | 26 | - [Create a new slice when cloning arguments of `baseFuncDesc`](https://github.com/pingcap/tidb/pull/9254) 27 | - [Handle `Float32` for the `values` built-in function](https://github.com/pingcap/tidb/pull/9215) 28 | - [Fix precision when casting a float to a string](https://github.com/pingcap/tidb/pull/9137) 29 | 30 | # Weekly update in TiSpark 31 | 32 | Last two weeks, we landed [2 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-01-28..2019-02-10+) in the TiSpark repository. 33 | 34 | ## Added 35 | 36 | - [Support using TiDB as a meta store](https://github.com/pingcap/tispark/pull/544) 37 | 38 | ## Fixed 39 | 40 | - [Fix the timestamp consistency issue](https://github.com/pingcap/tispark/pull/550) 41 | 42 | # Weekly update in TiKV and PD 43 | 44 | Last two weeks, we landed [23 PRs](https://github.com/search?utf8=%E2%9C%93&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-01-28..2019-02-10&type=Issues) in the TiKV and PD repositories. 45 | 46 | ## Improved 47 | 48 | - [Configure criterion from TiKV command line arguments](https://github.com/tikv/tikv/pull/4169) 49 | - [Enlarge `max-manifest-file-size` to 128MB](https://github.com/tikv/tikv/pull/4140) 50 | - [Make PD `Region` commands support `jq`](https://github.com/pingcap/pd/pull/1420) 51 | 52 | ## Fixed 53 | 54 | - [Revert updating to the latest version of etcd](https://github.com/pingcap/pd/pull/1425) 55 | - [Do not return a retriable error when TiKV is closing](https://github.com/tikv/tikv/pull/4146) 56 | - [Upgrade to Rust 2018](https://github.com/tikv/tikv/pull/4138) 57 | - [Disable `procinfo` on the non-Linux platform](https://github.com/tikv/tikv/pull/4133) 58 | 59 | # New contributors (Thanks!) 60 | 61 | tidb: 62 | 63 | - [caohe](https://github.com/caohe) 64 | - [tender-boluo](https://github.com/tender-boluo) 65 | 66 | pd: 67 | 68 | - [fredchenbj](https://github.com/fredchenbj) -------------------------------------------------------------------------------- /2019-06-24-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 17 ~ June 23, 2019) 3 | date: 2019-06-24 4 | summary: Last week, we landed 68 PRs in the TiDB repository, 12 PRs in the TiSpark repository, and 47 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [68 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-06-17..2019-06-23+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add a column describing memory usage for `information_schema.processlist`](https://github.com/pingcap/tidb/pull/10837) 15 | - [Add the `update-stats` bool configuration to control the updating statistics](https://github.com/pingcap/tidb/pull/10772) 16 | 17 | ## Improved 18 | 19 | - [Remove expired keys from PD](https://github.com/pingcap/tidb/pull/10406) 20 | - [Reuse the `tipb.Expr` value to push down expression `implicitParameters`](https://github.com/pingcap/tidb/pull/10790) 21 | - [Make `RangeTaskRunner` support dividing tasks by Region](https://github.com/pingcap/tidb/pull/10482) 22 | - [Notify affected Regions after sending `UnsafeDestroyRange` requests](https://github.com/pingcap/tidb/pull/10069) 23 | 24 | ## Fixed 25 | 26 | - [Fix the `alter table drop partition` check on hash partitioned tables](https://github.com/pingcap/tidb/pull/10902) 27 | - [Fix the wrong row count in fast `Analyze`](https://github.com/pingcap/tidb/pull/10859) 28 | - [Fix the performance issue in the mixed transaction mode](https://github.com/pingcap/tidb/pull/10847) 29 | - [Re-implement the `kill` statement in a safe way](https://github.com/pingcap/tidb/pull/10841) 30 | - [Fix the `CMSketch` index for fast `Analyze`](https://github.com/pingcap/tidb/pull/10839) 31 | - [Fix the configuration JSON key of `PessimisticTxn`](https://github.com/pingcap/tidb/pull/10820) 32 | - [Fix the issue that the `pb` memory cannot be released quickly](https://github.com/pingcap/tidb/pull/10815) 33 | - [Fix the issue that GC stops working when an error occurs during the execution process of the `UnsafeDestroyRange` operation](https://github.com/pingcap/tidb/pull/10743) 34 | 35 | # Weekly update in TiSpark 36 | 37 | Last week, we landed [12 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-06-17..2019-06-23+) in the TiSpark repository. 38 | 39 | ## Added 40 | 41 | - [Add a feature of locking a table](https://github.com/pingcap/tispark/pull/824) 42 | - [Add documents about `Timezone` and support writing data of the `Timestamp` type](https://github.com/pingcap/tispark/pull/842) 43 | 44 | ## Improved 45 | 46 | - [Update Spark version for the `spark_2.4` profile to Spark 2.4.3](https://github.com/pingcap/tispark/pull/852) 47 | - [Extend `JODA DateTime` to support scaling `Timestamp` up to microseconds](https://github.com/pingcap/tispark/pull/853) 48 | 49 | # Weekly update in TiKV and PD 50 | 51 | Last week, we landed [47 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-06-17..2019-06-23&type=Issues) in the TiKV and PD repositories. 52 | 53 | ## Improved 54 | 55 | - [Adjust the meaning for `store-balance-rate`](https://github.com/pingcap/pd/pull/1589) 56 | - [Resolve the problem that stores might be overloaded for a long time](https://github.com/pingcap/pd/pull/1586) 57 | - [Validate `block-size` in the column family option of RocksDB](https://github.com/tikv/tikv/pull/4920) 58 | - [Add a command to show the replication configuration in pd-ctl](https://github.com/pingcap/pd/pull/1587) 59 | - [Do not support dynamic allocation in `decimal`](https://github.com/tikv/tikv/pull/4909) 60 | 61 | ## Added 62 | 63 | - [Implement the `if_null` RPN Function](https://github.com/tikv/tikv/pull/4911) 64 | - [Implement the `add_time_string_null` RPN Function](https://github.com/tikv/tikv/pull/4855) 65 | 66 | # New contributors (Thanks!) 67 | 68 | tikv: 69 | 70 | * [NOVA-ME](https://github.com/NOVA-ME) 71 | * [summer-slow-grace](https://github.com/summer-slow-grace) 72 | -------------------------------------------------------------------------------- /2019-07-01-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (June 24 ~ June 30, 2019) 3 | date: 2019-07-01 4 | summary: Last week, we landed 52 PRs in the TiDB repository, 9 PRs in the TiSpark repository, and 38 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [52 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-06-24..2019-06-30+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Add support for `MAX_EXECUTION_TIME`](https://github.com/pingcap/tidb/pull/10541) 15 | - [Add a check for the GC life time that is too short](https://github.com/pingcap/tidb/pull/10936) 16 | - [Add an HTTP API to get some information of the sub-optimal query](https://github.com/pingcap/tidb/pull/10717) 17 | - [Add support for mysqldump from MySQL 8.0](https://github.com/pingcap/tidb/pull/10829) 18 | 19 | ## Improved 20 | 21 | - [Relax the restrictions of `trace format='row'`](https://github.com/pingcap/tidb/pull/10979) 22 | - [Make auto-increment ID adjustable](https://github.com/pingcap/tidb/pull/10978) 23 | - [Lock the key in the Point Get executor for pessimistic transactions](https://github.com/pingcap/tidb/pull/10972) 24 | - [Set up connection information in the session when the audit plugin is enabled](https://github.com/pingcap/tidb/pull/10923) 25 | - [Do not change the DDL lease during the bootstrap process](https://github.com/pingcap/tidb/pull/10908) 26 | - [Support `IF EXISTS`/`IF NOT EXISTS` for some DDL operations](https://github.com/pingcap/tidb/pull/10723) 27 | - [Fix the `MAX_EXECUTION_TIME` SQL hint and a global variable](https://github.com/pingcap/tidb/pull/10963) 28 | 29 | ## Fixed 30 | 31 | - [Fix the `show create table` output for generated columns](https://github.com/pingcap/tidb/pull/9608) 32 | - [Fix the bug of saving the GC safe point in PD before doing distributed GC](https://github.com/pingcap/tidb/pull/10927) 33 | - [Let `baseFuncDesc.typeInfer` return an error instead of triggering a panic](https://github.com/pingcap/tidb/pull/10910) 34 | 35 | # Weekly update in TiSpark 36 | 37 | Last week, we landed [9 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-06-24..2019-06-30+) in the TiSpark repository. 38 | 39 | ## Fixed 40 | 41 | - [Fix the column size estimation issue](https://github.com/pingcap/tispark/pull/858) 42 | - [Fix the incorrect timestamp of `tidbMapDatabase`](https://github.com/pingcap/tispark/pull/862) 43 | - [Fix the issue that the Region and Store information do not come from the same `RegionTask`](https://github.com/pingcap/tispark/pull/869) 44 | 45 | # Weekly update in TiKV and PD 46 | 47 | Last week, we landed [38 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-06-24..2019-06-30&type=Issues) in the TiKV and PD repositories. 48 | 49 | ## Improved 50 | 51 | - [Only debug log outputs when batch execution cannot be utilized](https://github.com/tikv/tikv/pull/4985) 52 | - [Print the pd-ctl success response message](https://github.com/pingcap/pd/pull/1600) 53 | - [Tolerate a backslash in the label name](https://github.com/pingcap/pd/pull/1595) 54 | - [Move duplicated code into the existing macro](https://github.com/tikv/tikv/pull/4955) 55 | - [Refine the deadlock](https://github.com/tikv/tikv/pull/4932) 56 | - [Output most keys in the hex format](https://github.com/tikv/tikv/pull/4921) 57 | 58 | ## Added 59 | 60 | - [Add an option about the gRPC gateway](https://github.com/pingcap/pd/pull/1596) 61 | - [Add some metrics to Coprocessor](https://github.com/tikv/tikv/pull/4959) 62 | 63 | ## Fixed 64 | 65 | - [Fix some bugs in date time processing](https://github.com/tikv/tikv/pull/4918) 66 | - [Fix multiple double panics in the drop path with the added `safe_panic` macro](https://github.com/tikv/tikv/pull/4552) 67 | - [Fix the upgrade problem caused by `TwoWayMerge`](https://github.com/pingcap/pd/pull/1602) 68 | - [Fix a pd-ctl subcommand option](https://github.com/pingcap/pd/pull/1582) 69 | 70 | # New contributor (Thanks!) 71 | 72 | tikv: [uvd](https://github.com/uvd) -------------------------------------------------------------------------------- /2019-09-02-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (August 26 ~ September 01, 2019) 3 | date: 2019-09-02 4 | summary: Last week, we landed 59 PRs in the TiDB repository, 12 PRs in the TiSpark repository, and 40 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # Weekly update in TiDB 9 | 10 | Last week, we landed [59 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-08-26..2019-09-01+) in the TiDB repository. 11 | 12 | ## Added 13 | 14 | - [Make the projection executor support the vectorized expression evaluation](https://github.com/pingcap/tidb/pull/11917) 15 | - [Support using query blocks in the optimizer hint](https://github.com/pingcap/tidb/pull/11861) 16 | 17 | ## Improved 18 | 19 | - [Refine the usage of the expression blacklist](https://github.com/pingcap/tidb/pull/11940) 20 | - [Eliminate the top level `Sort` in subqueries](https://github.com/pingcap/tidb/pull/11935) 21 | - [Support pushing down predicates for window functions](https://github.com/pingcap/tidb/pull/11915) 22 | - [Allow inserting `default` into the generated columns](https://github.com/pingcap/tidb/pull/11901) 23 | - [Improve the length and decimal size when a base type adds/minuses/multiplies a decimal](https://github.com/pingcap/tidb/pull/11873) 24 | - [Decrease the memory usage of `hashTable` in `HashJoinExec`](https://github.com/pingcap/tidb/pull/11832) 25 | - [Replace `memdb` with a more efficient memory version](https://github.com/pingcap/tidb/pull/11807) 26 | 27 | ## Fixed 28 | 29 | - [Fix the failure to add a unique index on the partitioned table (by `RANGE COLUMNS`)](https://github.com/pingcap/tidb/pull/11946) 30 | - [Fix an over-quoted bug in the `BinaryJSON.Unquote` function](https://github.com/pingcap/tidb/pull/11934) 31 | - [Limit the number of `TopN` items](https://github.com/pingcap/tidb/pull/11906) 32 | - [Fix the start timestamp in the slow log when a transaction is retried](https://github.com/pingcap/tidb/pull/11851) 33 | - [Set the correct `stmtCtx` for the `EXPLAIN` statement](https://github.com/pingcap/tidb/pull/11186) 34 | 35 | # Weekly update in TiSpark 36 | 37 | Last week, we landed [12 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-08-26..2019-09-01+) in the TiSpark repository and released TiSpark [2.1.4](https://github.com/pingcap/tispark/releases/tag/v2.1.4). 38 | 39 | ## Improved 40 | 41 | - [Remove useless dependencies](https://github.com/pingcap/tispark/pull/1075) 42 | 43 | # Weekly update in TiKV and PD 44 | 45 | Last week, we landed [40 PRs](https://github.com/search?q=repo:tikv/tikv+repo:pingcap/pd+is:pr+is:merged+merged:2019-08-26..2019-09-01&type=Issues) in the TiKV and PD repositories. 46 | 47 | ## Added 48 | 49 | - [Add an API to get the store ID and the cluster ID](https://github.com/tikv/tikv/pull/5257) 50 | - [Add an API to clear the tombstone store](https://github.com/pingcap/pd/pull/1705) 51 | 52 | ## Improved 53 | 54 | - [Improve parsing of URLs without HTTP prefixes](https://github.com/pingcap/pd/pull/1703) 55 | - [Improve the GC of Raft logs by a dedicated thread](https://github.com/pingcap/pd/pull/1703) 56 | 57 | ## Fixed 58 | 59 | - [Fix the panic during the Region Merge](https://github.com/tikv/tikv/pull/5354) 60 | - [Fix the panic when starting TiKV](https://github.com/tikv/tikv/pull/5350) 61 | - [Fix building a Docker image](https://github.com/tikv/tikv/pull/5337) 62 | - [Fix a deadlock in the `Scatter` Region](https://github.com/pingcap/pd/pull/1706) 63 | - [Fix the silent `ReadIndex` response](https://github.com/tikv/tikv/pull/5316) 64 | 65 | # New contributors (Thanks!) 66 | 67 | tidb: 68 | 69 | - [newer027](https://github.com/newer027) 70 | 71 | parser: 72 | 73 | - [zuoRambo](https://github.com/zuoRambo) 74 | - [yunnian](https://github.com/yunnian) 75 | -------------------------------------------------------------------------------- /2019-09-16-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 09 ~ September 15, 2019) 3 | date: 2019-09-16 4 | summary: Last week, we landed 92 PRs in the TiDB repository and 39 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## Community 11 | 12 | ### New contributors 13 | 14 | tidb: 15 | 16 | * [hey-kong](https://github.com/hey-kong) 17 | * [lizhenda](https://github.com/lizhenda) 18 | 19 | raft-rs: 20 | 21 | * [MaiCw4J](https://github.com/MaiCw4J) 22 | 23 | raft-prometheus: 24 | 25 | * [ekse](https://github.com/ekse) 26 | 27 | ## Call for participation 28 | 29 | TiDB: 30 | 31 | * [Vectorize all the built-in functions](https://github.com/pingcap/tidb/issues/12058) 32 | * [Issues to solve](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 33 | 34 | TiKV: 35 | 36 | * [Check code for common misspellings](https://github.com/tikv/tikv/issues/5456) 37 | * [Issues to solve](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 38 | 39 | ## Updates of the week 40 | 41 | ### Progress 42 | 43 | TiDB: 44 | 45 | Last week, we landed [92 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-09..2019-09-15+) in the TiDB repository. 46 | 47 | * Release TiDB [v2.1.17](https://pingcap.com/docs/v3.0/releases/2.1.17/) 48 | * Support generating hints from physical plans 49 | * Introduce the cascades adapter model and implement the `handle range` scan 50 | 51 | TiKV and PD: 52 | 53 | Last week, we landed [39 PRs](https://github.com/search?p=3&q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-09-09..2019-09-15&type=Issues) in the TiKV and PD repositories. 54 | 55 | * Release TiKV and PD [v2.1.17](https://pingcap.com/docs/v3.0/releases/2.1.17/) 56 | * Enable `DoublySkiplist` by default 57 | 58 | ### Critical PRs 59 | 60 | TiDB: 61 | 62 | * [Support generating hints from physical plans](https://github.com/pingcap/tidb/pull/11936) 63 | * [Implement the `CheckTxnStatus` API for the large transaction](https://github.com/pingcap/tidb/pull/11974) 64 | * [Introduce the cascades adapter model and implement the `handle range` scan](https://github.com/pingcap/tidb/pull/11566) 65 | * [Improve the row count estimation of `IndexJoin`'s inner scan](https://github.com/pingcap/tidb/pull/12085) 66 | * [Support the `unix_timestamp()` function in partition pruning](https://github.com/pingcap/tidb/pull/12035) 67 | * [Fix the issue that `MaxUint64` and `MaxInt64 autoID` are incorrectly allocated](https://github.com/pingcap/tidb/pull/12119) 68 | * [Fix the invalid snapshot cache under the pessimistic transaction](https://github.com/pingcap/tidb/pull/12147) 69 | 70 | TiKV and PD: 71 | 72 | * [Enable `DoublySkiplist` by default](https://github.com/tikv/tikv/pull/5430) 73 | * [Introduce `PointGetter`](https://github.com/tikv/tikv/pull/5424) 74 | * [Support backup with the rate limit](https://github.com/tikv/tikv/pull/5451) 75 | * [Fix the calculation of Region flow](https://github.com/pingcap/pd/pull/1688) 76 | * [Fix the TiKV panic when the `aggregation expr` type is invalid](https://github.com/tikv/tikv/pull/5429) 77 | 78 | ## Upcoming TiDB events 79 | 80 | * [TiDB Hackathon 2019 (in Chinese)](https://github.com/pingcap/presentations/tree/master/hackathon-2019/) 81 | * [Paper Reading 0918 (in Chinese)](https://github.com/pingcap/presentations/blob/master/paper-reading.md) 82 | -------------------------------------------------------------------------------- /2019-09-23-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 16 ~ September 22, 2019) 3 | date: 2019-09-23 4 | summary: Last week, we landed 58 PRs in the TiDB repository, 7 PRs in the TiSpark repository, and 27 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## News & blog post 11 | 12 | Jepsen is a project to analyze distributed systems under stress and to understand if concurrency problems are going to manifest, not only in applications but in databases and queues. It occupies a particular niche of the correctness testing landscape. 13 | 14 | Last week, we published an article that introduces why Jepsen is important to the distributed database industry, how it works, common issues found, how we use Jepsen with TiDB, and a short summary of all problems Jepsen has found. 15 | 16 | The full article is here: 17 | 18 | [Safety First! Common Safety Pitfalls in Distributed Databases Found by Jepsen Tests](https://pingcap.com/blog/safety-first-common-safety-pitfalls-in-distributed-databases-found-by-jepsen-tests/) 19 | 20 | ## Community 21 | 22 | ### New contributors 23 | 24 | tidb: 25 | 26 | * [jacklightChen](https://github.com/jacklightChen) 27 | * [doggeral](https://github.com/doggeral) 28 | * [ekalinin](https://github.com/ekalinin) 29 | * [tsthght](https://github.com/tsthght) 30 | * [ZoeShaw101](https://github.com/ZoeShaw101) 31 | 32 | rust-prometheus： 33 | 34 | * [qmx](https://github.com/qmx) 35 | 36 | ## Call for participation 37 | 38 | TiDB: 39 | 40 | * [Vectorize all the built-in functions](https://github.com/pingcap/tidb/issues/12058) 41 | * [Issues to solve](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 42 | 43 | TiKV: 44 | 45 | [Issues to solve](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 46 | 47 | ## Updates of the week 48 | 49 | ### Progress 50 | 51 | TiDB: 52 | 53 | Last week, we landed [58 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-16..2019-09-22+) in the TiDB repository. 54 | 55 | TiSpark: 56 | 57 | Last week, we landed [7 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-16..2019-09-22+) in the TiSpark repository. 58 | 59 | TiKV and PD: 60 | 61 | Last week, we landed [27 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-09-16..2019-09-22&type=Issues) in the TiKV and PD repositories. 62 | 63 | ### Critical PRs 64 | 65 | TiDB: 66 | 67 | * [Do not lock the untouched unique key in the pessimistic mode](https://github.com/pingcap/tidb/pull/12256) 68 | * [Support setting `tidb_enable_stmt_summary` in the session scope](https://github.com/pingcap/tidb/pull/12217) 69 | * [Separate the data preparing routine and the commit routine](https://github.com/pingcap/tidb/pull/11533) 70 | * [Add several SQL hints related to the session variables](https://github.com/pingcap/tidb/pull/11809) 71 | * [Make sure that `IndexReaderExecutor` or `TableReaderExecutor` implements the `Executor` interface](https://github.com/pingcap/tidb/pull/12020) 72 | 73 | TiSpark: 74 | 75 | * [Add `FieldType` in `DAGRequest`](https://github.com/pingcap/tispark/pull/1101) 76 | * [Support reading data from TiDB in the Spark Structured Streaming](https://github.com/pingcap/tispark/pull/1104) 77 | * [Fix the bug that the TiSpark Catalog has 10s to 20s delay](https://github.com/pingcap/tispark/pull/1108) 78 | 79 | TiKV and PD: 80 | 81 | * [Enable the backup feature](https://github.com/tikv/tikv/pull/5476) 82 | * [Fix a performance issue about `PointGetter`](https://github.com/tikv/tikv/pull/5469) 83 | * [Support specifying keys to split Regions](https://github.com/tikv/tikv/pull/5458) 84 | * [Handle the read index requests with lease](https://github.com/tikv/tikv/pull/5401) 85 | 86 | ## Upcoming TiDB events 87 | 88 | * [TiDB Hackathon 2019 (in Chinese)](https://github.com/pingcap/presentations/tree/master/hackathon-2019/) 89 | * [Paper Reading 0926 (in Chinese)](https://github.com/pingcap/presentations/blob/master/paper-reading.md) 90 | -------------------------------------------------------------------------------- /2019-09-30-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 23 ~ September 29, 2019) 3 | date: 2019-09-30 4 | summary: Last week, we landed 126 PRs in the TiDB repository, 15 PRs in the TiSpark repository, and 54 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## Community 11 | 12 | ### New contributors 13 | 14 | tidb: 15 | 16 | - [tangwz](https://github.com/tangwz) 17 | - [polyrabbit](https://github.com/polyrabbit) 18 | - [k-ye](https://github.com/k-ye) 19 | - [PiotrNewt](https://github.com/PiotrNewt) 20 | - [hellojujian](https://github.com/hellojujian) 21 | - [shihongzhi](https://github.com/shihongzhi) 22 | - [luyunyyyyy](https://github.com/luyunyyyyy) 23 | - [Handora](https://github.com/Handora) 24 | 25 | tikv: 26 | 27 | - [wshwsh12](https://github.com/wshwsh12) 28 | 29 | raft-rs: 30 | 31 | - [psinghal20](https://github.com/psinghal20) 32 | 33 | ## Call for participation 34 | 35 | TiDB: 36 | 37 | - [Issues to solve](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 38 | 39 | TiKV: 40 | 41 | - [Issues to solve](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 42 | 43 | ## Updates of the week 44 | 45 | ### Progress 46 | 47 | TiDB: 48 | 49 | Last week, we landed [126 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-23..2019-09-29+) in the TiDB repository. 50 | 51 | TiSpark: 52 | 53 | Last week, we landed [15 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-23..2019-09-29+) in the TiSpark repository. 54 | 55 | TiKV and PD: 56 | 57 | Last week, we landed [54 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-09-23..2019-09-29&type=Issues) in the TiKV and PD repositories. 58 | 59 | ### Critical PRs 60 | 61 | TiDB: 62 | 63 | - [Fix the error occurred when converting the subqueries contained in the `UPDATE` statement](https://github.com/pingcap/tidb/pull/12476) 64 | - [Fix the `ttlManager` race](https://github.com/pingcap/tidb/pull/12398) 65 | - [Fix the wrong `Flen` when processing `Decimal` and `Int`](https://github.com/pingcap/tidb/pull/12312) 66 | - [Update the `kvrpc.Cleanup` protocol and change its behavior](https://github.com/pingcap/tidb/pull/12212) 67 | - [Implement the disk-based hash join](https://github.com/pingcap/tidb/pull/12067) 68 | - [Enable Region requests to be sent to TiFlash stores](https://github.com/pingcap/tidb/pull/11652) 69 | 70 | TiSpark: 71 | 72 | - [Fix the `fastxml` security alert](https://github.com/pingcap/tispark/pull/1127) 73 | 74 | TiKV and PD: 75 | 76 | - [Fix the issue that the commit index is not forwarded when the merge entry is empty](https://github.com/tikv/tikv/pull/5512) 77 | - [Support the memory quota](https://github.com/tikv/tikv/pull/5524) 78 | - [Enable RocksDB `force_consistency_checks` for all CFs](https://github.com/tikv/tikv/pull/5491) 79 | - [Check lock's TTL when doing cleanup](https://github.com/tikv/tikv/pull/5471) 80 | - [Fix the panic caused by `GetLeader`](https://github.com/pingcap/pd/pull/1766) 81 | - [Return the chunk-encoded data when the requested `EncodeType` is `TypeArrow`](https://github.com/tikv/tikv/pull/5461) 82 | - [Replace the pending peers instead of removing them directly](https://github.com/pingcap/pd/pull/1607) 83 | -------------------------------------------------------------------------------- /2019-10-14-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (September 30 ~ October 13, 2019) 3 | date: 2019-10-14 4 | summary: Last two weeks, we landed 131 PRs in the TiDB repository, 4 PRs in the TiSpark repository, and 46 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## Community 11 | 12 | ### New contributors 13 | 14 | tidb: 15 | 16 | * [big747386](https://github.com/big747386) 17 | * [liuhao2050](https://github.com/liuhao2050) 18 | * [xiaoronglv](https://github.com/xiaoronglv) 19 | * [gtygo](https://github.com/gtygo) 20 | * [shldreams](https://github.com/shldreams) 21 | 22 | tikv: 23 | 24 | * [hk1997](https://github.com/hk1997) 25 | * [ming-relax](https://github.com/ming-relax) 26 | * [pentium3](https://github.com/pentium3) 27 | 28 | docs-cn: 29 | 30 | * [llussy](https://github.com/llussy) 31 | * [qiukun](https://github.com/qiukun) 32 | 33 | tidb-operator: 34 | 35 | * [nyurik](https://github.com/nyurik) 36 | 37 | ## Call for participation 38 | 39 | TiDB: 40 | 41 | * [Issues to solve](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 42 | 43 | TiKV: 44 | 45 | * [Issues to solve](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 46 | 47 | ## Updates of the week 48 | 49 | ### Progress 50 | 51 | TiDB: 52 | 53 | Last week, we landed [131 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-30..2019-10-13+) in the TiDB repository, and [48 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-30..2019-10-13+in%3Atitle%3Avectorized+evaluation) on the [Vectorized Expressions](https://github.com/pingcap/tidb/issues/12058) issue. 54 | 55 | TiSpark: 56 | 57 | Last week, we landed [4 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-09-30..2019-10-13+) in the TiSpark repository. 58 | 59 | TiKV and PD: 60 | 61 | Last week, we landed [46 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-09-30..2019-10-13&type=Issues) in the TiKV and PD repositories. 62 | 63 | ### Critical PRs 64 | 65 | TiDB: 66 | 67 | * [Fix the panic when checking the `NULL` rejection for `from_unixtime`](https://github.com/pingcap/tidb/pull/12413) 68 | * [Fix incorrect `OriginDefaultValue` in `ColumnInfo`](https://github.com/pingcap/tidb/pull/12168) 69 | * [Calculate the GC `safePoint` based on the global `MinStart` timestamp](https://github.com/pingcap/tidb/pull/12223) 70 | * [Replace the cost model factor constants with the system variable](https://github.com/pingcap/tidb/pull/12367) 71 | * [Do not return the first row until the frame is completed](https://github.com/pingcap/tidb/pull/12480) 72 | 73 | TiSpark: 74 | 75 | * [Forbid adding the TiDB password to `SparkConf`](https://github.com/pingcap/tispark/pull/1139) 76 | 77 | TiKV and PD: 78 | 79 | * [Fix a resource leak bug about `mpsc::batch`](https://github.com/tikv/tikv/pull/5566) 80 | * [Introduce the `engine_rocks` component](https://github.com/tikv/tikv/pull/5541) 81 | 82 | ## Upcoming TiDB events 83 | 84 | * [TiDB Hackathon 2019 (in Chinese)](http://nc9hsk15y2xczuor.mikecrm.com/PiwBPaL) 85 | * [Infra Meetup No.115: Infra Meetup X Kubernetes & Cloud Native Meetup (in Chinese)](https://github.com/pingcap/meetup/) 86 | * [Infra Meetup No.116 Chengdu (in Chinese)](https://github.com/pingcap/meetup/) 87 | * [Infra Meetup No.117 Shanghai (in Chinese)](https://github.com/pingcap/meetup/) 88 | -------------------------------------------------------------------------------- /2019-10-28-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (October 21 ~ October 27, 2019) 3 | date: 2019-10-28 4 | summary: Last week, we landed 77 PRs in the TiDB repository, 6 PRs in the TiSpark repository, and 34 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## Community 11 | 12 | ### New contributors 13 | 14 | tidb: 15 | 16 | * [young-127](https://github.com/young-127) 17 | * [yongchaoyan](https://github.com/yongchaoyan) 18 | * [chacha923](https://github.com/chacha923) 19 | * [liugangjian](https://github.com/liugangjian) 20 | 21 | parser: 22 | 23 | * [ekalinin](https://github.com/ekalinin) 24 | * [sim41](https://github.com/sim41) 25 | 26 | docs-cn: 27 | 28 | * [elvizlai](https://github.com/elvizlai) 29 | 30 | ## Call for participation 31 | 32 | * [Vectorized Expression Working Group](https://github.com/pingcap/community/blob/master/working-groups/wg-vec-expr.md) 33 | * [`Date` or `Time` built-in functions (14/65)](https://github.com/pingcap/tidb/issues/12101) 34 | * [`Decimal` built-in functions (15/31)](https://github.com/pingcap/tidb/issues/12102) 35 | * [`Int` built-in functions (69/187)](https://github.com/pingcap/tidb/issues/12103) 36 | * [`JSON` built-in functions (13/27)](https://github.com/pingcap/tidb/issues/12104) 37 | * [`Real` built-in functions (41/49)](https://github.com/pingcap/tidb/issues/12105) 38 | * [`String` built-in functions (53/133)](https://github.com/pingcap/tidb/issues/12106) 39 | * [`Duration` built-in functions (13/45)](https://github.com/pingcap/tidb/issues/12176) 40 | * Last week, [30 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+sort%3Aupdated-desc+merged%3A2019-10-21..2019-10-27+label%3Acomponent%2Fexpression) are landed in the expression component. 41 | * [Issues to solve for TiDB](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 42 | * [Issues to solve for TiKV](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 43 | 44 | ## Updates of the week 45 | 46 | ### Progress 47 | 48 | Last week, we landed [77 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-10-21..2019-10-27+) in the TiDB repository, [6 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2019-10-21..2019-10-27+) in the TiSpark repository, and [34 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2019-10-21..2019-10-27&type=Issues) in the TiKV and PD repositories. 49 | 50 | ### Critical PRs 51 | 52 | TiDB: 53 | 54 | * [Introduce `TransformationID` in the cascades planner](https://github.com/pingcap/tidb/pull/12879) 55 | * [Fix the issue that the snapshot does not cache the non-existing KV entries that lead to the poor `insert ignore` performance](https://github.com/pingcap/tidb/pull/12872) 56 | * [Reuse the chunk row for the row insertion on the duplicate update](https://github.com/pingcap/tidb/pull/12847) 57 | * [Fix the panic caused by the data race in `GetDirtyTable()`](https://github.com/pingcap/tidb/pull/12767) 58 | * [Support `CREATE VIEW` on the union](https://github.com/pingcap/tidb/pull/12595) 59 | * [Make requests fail quickly when the dial times out](https://github.com/pingcap/tidb/pull/12819) 60 | 61 | TiSpark: 62 | 63 | * [Fix the `No Matching column` bug](https://github.com/pingcap/tispark/pull/1162) 64 | 65 | TiKV and PD: 66 | 67 | * [Add the checksum feature for the backup and restore](https://github.com/tikv/tikv/pull/5683) 68 | * [Update the rust-rocksdb to avoid the intra-L0 compaction issue](https://github.com/tikv/tikv/pull/5710) 69 | * [Revert the `approximate` update in the pd-worker](https://github.com/tikv/tikv/pull/5711) 70 | * [Add `used_size` for the store API](https://github.com/pingcap/pd/pull/1844/files) 71 | * [Fix the race issue of the scatter range scheduler](https://github.com/pingcap/pd/pull/1840) 72 | * [Add options to enable the placement rules](https://github.com/pingcap/pd/pull/1835) 73 | -------------------------------------------------------------------------------- /2020-01-20-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 13 ~ January 19, 2020) 3 | date: 2020-01-20 4 | summary: Last week, we landed 43 PRs in the TiDB repository, 11 PRs in the TiSpark repository, and 24 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## News & blog post 11 | 12 | In the world of distributed computing, faults can happen to your clusters unpredictably any time, anywhere. Therefore, we present to you Chaos Mesh, a cloud-native Chaos Engineering platform that orchestrates chaos experiments on Kubernetes environments. Last week, we published a post that introduces what Chaos Mesh is, how we design and implement it, and finally how you can use it in your environment. 13 | 14 | The full post is here: 15 | 16 | [Chaos Mesh - Your Chaos Engineering Solution for System Resiliency on Kubernetes](https://pingcap.com/blog/chaos-mesh-your-chaos-engineering-solution-for-system-resiliency-on-kubernetes/) 17 | 18 | ## Community 19 | 20 | ### New contributors 21 | 22 | docs-cn: 23 | 24 | * [ran-huang](https://github.com/ran-huang) 25 | 26 | tidb-operator: 27 | 28 | * [longfangsong](https://github.com/longfangsong) 29 | 30 | parser: 31 | 32 | * [zhaox1n](https://github.com/zhaox1n) 33 | * [hg2990656](https://github.com/hg2990656) 34 | 35 | tidb-binlog: 36 | 37 | * [freemindLi](https://github.com/freemindLi) 38 | 39 | ## Call for participation 40 | 41 | * [Issues to solve for TiDB](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 42 | * [Issues to solve for TiKV](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 43 | 44 | ## Updates of the week 45 | 46 | ### Progress 47 | 48 | Last week, we landed [43 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2020-01-13..2020-01-19+) in the TiDB repository, [11 PRs](https://github.com/pingcap/tispark/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2020-01-13..2020-01-19+) in the TiSpark repository, and [24 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2020-01-13..2020-01-19&type=Issues) in the TiKV and PD repositories. 49 | 50 | ### Critical PRs 51 | 52 | TiDB: 53 | 54 | * [Add the data accessibility check for `point get`](https://github.com/pingcap/tidb/pull/14459) 55 | * [Add `ImplementationRule` for `MergeJoin` in the cascades planner](https://github.com/pingcap/tidb/pull/14450) 56 | * [Add a server-level configuration to control `IsolationRead`](https://github.com/pingcap/tidb/pull/14440) 57 | * [Support limiting the number of client connections](https://github.com/pingcap/tidb/pull/14409) 58 | * [Fix the bug occurred when inserting partitioned tables caused by the timezone change](https://github.com/pingcap/tidb/pull/14370) 59 | * [Improve the performance of `WindowExec` by using the multi-thread hash grouping](https://github.com/pingcap/tidb/pull/14238) 60 | 61 | TiSpark: 62 | 63 | * [Fix the issue that the partitioned table is not shown in `ShowCommand`](https://github.com/pingcap/tispark/pull/1354) 64 | 65 | TiKV and PD: 66 | 67 | * [Fix the inconsistency with TiDB when the `CAST` function converts the binary string to `int`](https://github.com/tikv/tikv/pull/6463) 68 | * [Support getting the configuration in use through the status server](https://github.com/tikv/tikv/pull/6480) 69 | * [Fix the inconsistency with TiDB when parsing `Duration` from a string](https://github.com/tikv/tikv/pull/6474) 70 | * [Integrate the dashboard into PD](https://github.com/pingcap/pd/pull/2086) 71 | * [Fix the issue that `enable-placement-rules` cannot be set twice](https://github.com/pingcap/pd/pull/2102) 72 | * [Do not build the dashboard UI on Windows](https://github.com/pingcap/pd/pull/2105) 73 | -------------------------------------------------------------------------------- /2020-02-03-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (January 20 ~ February 02, 2020) 3 | date: 2020-02-03 4 | summary: Last two weeks, we landed 25 PRs in the TiDB repository and 7 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## News & blog post 11 | 12 | One of the fundamental tradeoffs of programming language design is run-time performance vs. compile-time performance. The Rust team nearly always (if not always) chose run-time over compile-time. 13 | 14 | Last week, we published a post that discusses the following topics as the first episode in a series of posts: 15 | 16 | - The spectre of poor Rust compile times at PingCAP 17 | - The TiKV compile-time adventure so far 18 | - Rust's designs for poor compilation time 19 | - Bootstrapping Rust 20 | - (Un)virtuous cycles 21 | - Early decisions that favored run-time over compile-time 22 | - Recent work on Rust compile times 23 | 24 | The full post is here: 25 | 26 | [The Rust Compilation Model Calamity](https://pingcap.com/blog/rust-compilation-model-calamity/) 27 | 28 | ## Community 29 | 30 | ### New contributors 31 | 32 | tidb: 33 | 34 | - [ldnvnbl](https://github.com/ldnvnbl) 35 | - [ZiheLiu](https://github.com/ZiheLiu) 36 | 37 | tikv: 38 | 39 | - [silathdiir](https://github.com/silathdiir) 40 | 41 | parser: 42 | 43 | - [rubb1sh](https://github.com/rubb1sh) 44 | 45 | ## Call for participation 46 | 47 | - [More issues to solve for TiDB](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 48 | - [More issues to solve for TiKV](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 49 | 50 | ## Updates of the week 51 | 52 | ### Progress 53 | 54 | Last two weeks, we landed [25 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2020-01-20..2020-02-02+) in the TiDB repository and [7 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2020-01-20..2020-02-02&type=Issues) in the TiKV and PD repositories. 55 | 56 | ### Critical PRs 57 | 58 | TiDB: 59 | 60 | - [Use the 8-byte `MysqlTime` format](https://github.com/pingcap/tidb/pull/14278) 61 | - [Handle events of adding or truncating partitions](https://github.com/pingcap/tidb/pull/14500) 62 | - [Fix the bug that the table's existence is not checked when granting privileges on this table to users](https://github.com/pingcap/tidb/pull/14540) 63 | - [Enhance the rule of partition pruning](https://github.com/pingcap/tidb/pull/14544) 64 | - [Fix the issue that the `RowKVClient` scan method cannot correctly break the loop](https://github.com/pingcap/tidb/pull/14365) 65 | 66 | TiKV and PD: 67 | 68 | - [Ensure that the peer with pending reads does not become hibernate](https://github.com/tikv/tikv/pull/6438) 69 | - [Support using S3 as the external storage](https://github.com/tikv/tikv/pull/6209) 70 | - [Enable the default protocol feature flag](https://github.com/tikv/tikv/pull/6436) 71 | - [Switch the `Chunk` time to use the new 8-byte format](https://github.com/tikv/tikv/pull/6418) 72 | -------------------------------------------------------------------------------- /2020-03-02-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (February 24 ~ March 01, 2020) 3 | date: 2020-03-01 4 | summary: Last week, we landed 68 PRs in the TiDB repository and 58 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiSpark', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## News & blog post 11 | 12 | Nick Cameron is a long-time Rust programmer who has recently started using Go. Last week, we published a post in which he talks about his early impressions of Go. Read this post to learn more: 13 | 14 | [Early Impressions of Go from a Rust Programmer](https://pingcap.com/blog/early-impressions-of-go-from-a-rust-programmer/) 15 | 16 | ## Community 17 | 18 | ### New contributors 19 | 20 | tidb: 21 | 22 | * [mgkanani](https://github.com/mgkanani) 23 | * [wangwangwar](https://github.com/wangwangwar) 24 | 25 | tikv: 26 | 27 | * [ZiheLiu](https://github.com/ZiheLiu) 28 | * [govardhangdg](https://github.com/govardhangdg) 29 | * [lsampras](https://github.com/lsampras) 30 | 31 | docs: 32 | 33 | * [ldnvnbl](https://github.com/ldnvnbl) 34 | 35 | tidb-operator: 36 | 37 | * [u5surf](https://github.com/u5surf) 38 | * [Smana](https://github.com/Smana) 39 | 40 | parser: 41 | 42 | * [dasinlsb](https://github.com/dasinlsb) 43 | 44 | chaos-mesh: 45 | 46 | * [Gallardot](https://github.com/Gallardot) 47 | 48 | ## Call for participation 49 | 50 | * [Issues to solve for TiDB](https://github.com/pingcap/tidb/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) 51 | * [Issues to solve for TiKV](https://github.com/tikv/tikv/labels/S%3A%20HelpWanted) 52 | 53 | ## Updates of the week 54 | 55 | ### Progress 56 | 57 | Last week, we landed [68 PRs](https://github.com/pingcap/tidb/pulls?utf8=%E2%9C%93&q=is%3Apr+is%3Amerged+merged%3A2020-02-24..2020-03-01+) in the TiDB repository and [58 PRs](https://github.com/search?q=repo%3Atikv%2Ftikv+repo%3Apingcap%2Fpd+is%3Apr+is%3Amerged+merged%3A2020-02-24..2020-03-01&type=Issues) in the TiKV and PD repositories. 58 | 59 | ### Critical PRs 60 | 61 | TiDB: 62 | 63 | * [Add more metrics table for the diagnosis report](https://github.com/pingcap/tidb/pull/14964) 64 | * [Support changing more configuration items online](https://github.com/pingcap/tidb/pull/14952) 65 | * [Show the `CAST` type in the `EXPLAIN` statement](https://github.com/pingcap/tidb/pull/14942) 66 | * [Fold the constant in the projection elimination and Top-N push-down](https://github.com/pingcap/tidb/pull/14927) 67 | * [Consider collations when comparing strings](https://github.com/pingcap/tidb/pull/14913) 68 | * [Support index encoding or decoding for the new collation](https://github.com/pingcap/tidb/pull/14876) 69 | * [Disable pushing down the `Duration` or JSON-related function to TiFlash](https://github.com/pingcap/tidb/pull/14861) 70 | * [Support the `SELECT INTO ... OUTFILE` syntax](https://github.com/pingcap/tidb/pull/14848) 71 | * [Implement the sequence allocator](https://github.com/pingcap/tidb/pull/14829) 72 | * [Enable the inline projection for Hash Join](https://github.com/pingcap/tidb/pull/14783) 73 | * [Improve the projection to keep the order or keep the index in some cases](https://github.com/pingcap/tidb/pull/14510) 74 | 75 | TiKV and PD: 76 | 77 | * [Avoid handling requests for multiple times](https://github.com/tikv/tikv/pull/6677) 78 | * [Let the collated `GROUP BY` column return the original data](https://github.com/tikv/tikv/pull/6716) 79 | * [Return values when acquiring pessimistic locks successfully](https://github.com/tikv/tikv/pull/6696) 80 | * [Fix the panic caused by not destroying `apply fsm` in some cases](https://github.com/tikv/tikv/pull/6692) 81 | * [Wake up the hibernated leader after the failed read index](https://github.com/tikv/tikv/pull/6648) 82 | * [Wake up the Raft leader for more cases](https://github.com/tikv/tikv/pull/6672) 83 | * [Wake up the Raft leader on the proposal](https://github.com/tikv/tikv/pull/6736) 84 | * [Introduce the solution-based balance solver](https://github.com/pingcap/pd/pull/2141) 85 | 86 | ## Upcoming TiDB event 87 | 88 | [TiDB Usability Challenge Program](https://pingcap.com/community/tidb-usability-challenge/) 89 | -------------------------------------------------------------------------------- /2020-04-13-tidb-weekly.md: -------------------------------------------------------------------------------- 1 | --- 2 | title: Weekly update (April 06 ~ April 12, 2020) 3 | date: 2020-04-13 4 | summary: Last week, we landed 100 PRs in the TiDB repository and 32 PRs in the TiKV and PD repositories. 5 | tags: ['TiDB', 'TiKV', 'PD'] 6 | --- 7 | 8 | # TiDB Weekly 9 | 10 | ## News & blog posts 11 | 12 | April 8th, 2020 is the 5th anniversary of PingCAP. Last week, we published an article written by our CTO Ed Huang to look back and to share his thoughts about the future of databases. The full article is here: 13 | 14 | [A Peek into the Future of Database: A Unified Infrastructure to Adapt Intelligently](https://pingcap.com/blog/future-of-database-unified-infrastructure-to-adapt-intelligently/) 15 | 16 | Last week, we also published a post that walks you through TiDB 4.0's highlights across its deployment, use, operations and maintenance, ecosystem, and cloud services. You're welcome to join us in [TiDB Community Slack](https://join.slack.com/t/tidbcommunity/shared_invite/enQtNzc0MzI4ODExMDc4LWYwYmIzMjZkYzJiNDUxMmZlN2FiMGJkZjAyMzQ5NGU0NGY0NzI3NTYwMjAyNGQ1N2I2ZjAxNzc1OGUwYWM0NzE) to give us advice or feedback on your user experience. The full article is here: 17 | 18 | [TiDB 4.0 Preview: An Easier-to-Use, Production-Ready HTAP Database](https://pingcap.com/blog/tidb-4.0-preview-easier-to-use-production-ready-htap-database/) 19 | 20 | ## Community 21 | 22 | ### New contributors 23 | 24 | tidb: 25 | 26 | * [time-and-fate](https://github.com/time-and-fate) 27 | 28 | docs: 29 | 30 | * [mmyj](https://github.com/mmyj) 31 | 32 | docs-cn: 33 | 34 | * [wyuchen007](https://github.com/wyuchen007) 35 | * [piperck](https://github.com/piperck) 36 | 37 | parser: 38 | 39 | * [cncal](https://github.com/cncal) 40 | 41 | ## Call for participation 42 | 43 | ### TiDB 44 | 45 | * [All help-wanted issues in TiDB](https://github.com/pingcap/tidb/issues?q=is%3Aopen+is%3Aissue+label%3Ahelp-wanted) 46 | 47 | ### TiKV 48 | 49 | * [To support removing bad Regions by one command](https://github.com/tikv/tikv/issues/6976) 50 | * [To combine the store balance rate and the store limit](https://github.com/pingcap/pd/issues/2245) 51 | * [All help-wanted issues in TiKV](https://github.com/tikv/tikv/issues?q=is%3Aopen+is%3Aissue+label%3Astatus%2Fhelp-wanted) 52 | * [All help-wanted issues in PD](https://github.com/pingcap/pd/issues?q=is%3Aissue+is%3Aopen+label%3Astatus%2Fhelp-wanted) 53 | 54 | ## Updates of the week 55 | 56 | ### Progress 57 | 58 | Last week, we landed [100 PRs](https://github.com/pingcap/tidb/pulls?q=is%3Apr+is%3Amerged+merged%3A2020-04-06..2020-04-12) in the TiDB repository and [32 PRs](https://github.com/tikv/tikv/pulls?q=is%3Apr+is%3Amerged+merged%3A2020-04-06..2020-04-12+) in the TiKV and PD repositories. 59 | 60 | #### TiDB 61 | 62 | * [Enable the inline projection for `MergeJoin`](https://github.com/pingcap/tidb/pull/15463) 63 | * [Support adding multiple columns](https://github.com/pingcap/tidb/pull/15540) 64 | 65 | #### TiDB Dashboard 66 | 67 | * [Remove some dependencies](https://github.com/pingcap-incubator/tidb-dashboard/pull/328) 68 | 69 | #### TiUP 70 | 71 | * The `mirrors` component is released, which is used to build a local mirror of TiUP and make TiUP available in offline scenarios. 72 | 73 | #### TiKV 74 | 75 | * [Improve TiKV metrics performance for `tidb_query` and `engine_rocks`](https://github.com/tikv/tikv/pull/7267) 76 | * [Make `ChangeCmd` a significant message](https://github.com/tikv/tikv/pull/7377) 77 | * [Set the term in the read index response](https://github.com/tikv/tikv/pull/7372) 78 | * [Remove the scan cache and add the `ObserveID`](https://github.com/tikv/tikv/pull/7278) 79 | 80 | #### PD 81 | 82 | * [Support the rate control for removing peers](https://github.com/pingcap/pd/pull/2226) 83 | * [Implement the recovery progress](https://github.com/pingcap/pd/pull/2322) 84 | * [Update the state change process](https://github.com/pingcap/pd/pull/2332) 85 | 86 | ## On-going TiDB event 87 | 88 | [TiDB Usability Challenge Program](https://pingcap.com/community/tidb-usability-challenge/) 89 | -------------------------------------------------------------------------------- /media/.gitkeep: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/pingcap/weekly/d9632beaa26dc8bf7f022a082034253b12384896/media/.gitkeep --------------------------------------------------------------------------------