Edit

关于mysql 事务性的一点探究

事件起因

夺宝吧优惠券体系中要加行优惠券的预算控制。 预算控制的表结构如下

字段名 类型 解释
id int AI,PK 自增id
deliver_budget int 分发预算
delivered_num int 实际分发的值

因为优惠券的分发,涉及到几个表的修改。又需要控制预算, 一个比较直观的方法是在事务开始的时候select ... for update 锁住这一行, 之后在进行各种操作。 这肯定没有问题。但是代码太多了(主要是beego 的orm没有select for update的支持。 于是想到用update voucher set delivered_num = delivered_num + 1 where id = ? and deliver_budget > delivered_num 并检查update的数量来操作。但是对于mysql了解比较少, 不知道这样行不行。于是验证一下。

验证过程

开了两个session, 并start transaction 然后进行操作 ,过程如下

Session1 Session2 说明
1.start transaction 1.start transaction
2.检查原始值 select * from voucher where id=1; 2.检查原始值 select * from voucher where id=1; 初始值 deliver_budget=1 delivered_num=0
3.进行update update voucher set delivered_num = delivered_num + 1 where id = 1 and deliver_budget > delivered_num; Rows matched: 1 Changed: 1 Warnings: 0 update 成功
4.重新select select * from voucher where id=1; update 确实生效
5.检查select select * from voucher where id=1; 这里的返回结果与初始值相同,可见mysql的默认事物级别Repeatable reads是有效的, 在事物中所有的读保持一致性。
6.update update voucher set delivered_num = delivered_num + 1 where id = 1 and deliver_budget > delivered_num; update操作wait for lock。这里就解决了我之前的移问 两个事物update同一行的时候会有锁机制。 而且这个锁并不是在update之后就即刻释放。
7.commit session2中的操作6完成。 进一步证明了在isolation level 为Repeatable reads下所有的锁是在事物结束时才进行。同时第6步返回的结果是 Rows matched: 0 Changed: 0 Warnings: 0。 这是我在这次实验中发现的最有趣的地方 从逻辑上来讲, select 的结果 delivered_num = 0 deliver_budget = 1 是会进行updat的但是mysql确没有。 这一块很令我费解于是有了第8步验证
8.select * from voucher where id=1 and deliver_budget > delivered_num; 结果这时居然返回了一行。 看来 mysql的selectupdate是两个完全不同的逻辑
9.我想验证一下update直接+=1会是什么鬼 update voucher set delivered_num = delivered_num + 1 where id=1又出现了正确的但是逻辑很诡异的结果 出来的结果delivered_num 为2, 不是在这个事物中update之前delivered_num是0嘛,+1 之后成了2(mysql你他妈在逗我!)

到此验证结束。 想一想mysql还蛮智能的,在事务中select 满足repeatable reads
update不满足。这样就保持了数据的一致性。然而从程序的逻辑角度来讲还是蛮诡异的。

探究的过程

对于验证得到的结果,蛮超出我的想像的。 然后就google一通搜索。首先重新去了解了一下isolation 这个概念。isolation有几个级别: Serializable, Repeatable reads, Read committed, Read uncommitted 这几个概念之前也听说过,每次看完之后都觉得理解了,过会就忘。
mysql默认的隔离级别是repeatable reads, 也就是说在一个事物中,所有的读都是读的最开始select的snapshot。验证操作中的第5步也印证了这个问题。但是从程序的角度来讲,update操作不应该是先读到原来的值然后在更新一下么。按照这个逻辑 读的是snapshot update应该是基于这个snapshot进行的update操作才对。(但是从业务逻辑的角度来讲确实需要这样来实现一致性,不由得为mysql的设计点个赞。)

于是继续翻文档: http://dev.mysql.com/doc/refman/5.7/en/innodb-consistent-read.html 在一个隐藏的角落看到这样一些话 The snapshot of the database state applies to SELECT statements within a transaction, not necessarily to DML statements. If you insert or modify some rows and then commit that transaction, a DELETE or UPDATE statement issued from another concurrent REPEATABLE READ transaction could affect those just-committed rows, even though the session could not query them. If a transaction does update or delete rows committed by a different transaction, those changes do become visible to the current transaction. For example, you might encounter a situation like the following。

But 这是如何实现的呢? 简单的猜想一下觉得可能是通过MVCC来实现的

innodb为每一个我们看到的数据行存储了多个版本并标记每一个版本的创建版本号和删除版本号。 repeatable reads 的实现就是去在第一次读的时候找低于事务开始时的版本号的数据版本。 而按照这个推论,UPDATE就是永远基于最新版本的数据进行的操作了 这是一个猜测,没有在文档中找到。小心求证的过程就不做了。

总结

  • 以后在处理并发问题的时候就可以放心的在事物中用update了。而不用去显示的select for update 锁住一行。
  • 在事务操作中 select得到的数据不可信,不要基于select的结果去进行下一步操作。update尽量用一个原子操作去完成。
%23%20%u5173%u4E8Emysql%20%u4E8B%u52A1%u6027%u7684%u4E00%u70B9%u63A2%u7A76%0A@%28work%29%0A%0A%23%23%20%20%u4E8B%u4EF6%u8D77%u56E0%0A%u593A%u5B9D%u5427%u4F18%u60E0%u5238%u4F53%u7CFB%u4E2D%u8981%u52A0%u884C%u4F18%u60E0%u5238%u7684%u9884%u7B97%u63A7%u5236%u3002%20%u9884%u7B97%u63A7%u5236%u7684%u8868%u7ED3%u6784%u5982%u4E0B%0A%0A%7C%20%u5B57%u6BB5%u540D%7C%20%20%u7C7B%u578B%20%7C%20%u89E3%u91CA%7C%0A%7C---------%7C-----------%7C---------%7C%0A%7C%60id%60%7Cint%20AI%2CPK%7C%u81EA%u589Eid%7C%0A%7C%60deliver_budget%60%7Cint%7C%u5206%u53D1%u9884%u7B97%7C%0A%7C%60delivered_num%60%7Cint%7C%u5B9E%u9645%u5206%u53D1%u7684%u503C%7C%0A%0A%u56E0%u4E3A%u4F18%u60E0%u5238%u7684%u5206%u53D1%uFF0C%u6D89%u53CA%u5230%u51E0%u4E2A%u8868%u7684%u4FEE%u6539%u3002%u53C8%u9700%u8981%u63A7%u5236%u9884%u7B97%uFF0C%20%u4E00%u4E2A%u6BD4%u8F83%u76F4%u89C2%u7684%u65B9%u6CD5%u662F%u5728%u4E8B%u52A1%u5F00%u59CB%u7684%u65F6%u5019%60select%20...%20for%20update%60%20%u9501%u4F4F%u8FD9%u4E00%u884C%2C%20%u4E4B%u540E%u5728%u8FDB%u884C%u5404%u79CD%u64CD%u4F5C%u3002%20%u8FD9%u80AF%u5B9A%u6CA1%u6709%u95EE%u9898%u3002**%u4F46%u662F%u4EE3%u7801%u592A%u591A%u4E86%uFF08%u4E3B%u8981%u662Fbeego%20%u7684orm%u6CA1%u6709select%20for%20update%u7684%u652F%u6301**%u3002%20%u4E8E%u662F%u60F3%u5230%u7528%60update%20voucher%20set%20delivered_num%20%20%3D%20delivered_num%20+%201%20where%20id%20%3D%20%3F%20and%20deliver_budget%20%3E%20delivered_num%60%20%u5E76%u68C0%u67E5update%u7684%u6570%u91CF%u6765%u64CD%u4F5C%u3002%u4F46%u662F%u5BF9%u4E8Emysql%u4E86%u89E3%u6BD4%u8F83%u5C11%uFF0C%20%u4E0D%u77E5%u9053%u8FD9%u6837%u884C%u4E0D%u884C%u3002%u4E8E%u662F%u9A8C%u8BC1%u4E00%u4E0B%u3002%0A%0A%0A%23%23%20%20%u9A8C%u8BC1%u8FC7%u7A0B%0A%0A%u5F00%u4E86%u4E24%u4E2Asession%2C%20%u5E76%60start%20transaction%60%20%u7136%u540E%u8FDB%u884C%u64CD%u4F5C%20%uFF0C%u8FC7%u7A0B%u5982%u4E0B%0A%0A%7C%20%20Session1%7C%20%20%20Session2%7C%20%20%u8BF4%u660E%7C%0A%7C--------------%7C-----------------%7C------%7C%0A%7C1.%60start%20transaction%60%7C%201.%60start%20transaction%60%7C%7C%0A%7C2.%u68C0%u67E5%u539F%u59CB%u503C%20%60select%20*%20from%20voucher%20where%20id%3D1%3B%60%7C%202.%u68C0%u67E5%u539F%u59CB%u503C%20%60select%20*%20from%20voucher%20where%20id%3D1%3B%60%7C%u521D%u59CB%u503C%20%60deliver_budget%3D1%60%20%60delivered_num%3D0%60%7C%20%0A%7C3.%u8FDB%u884Cupdate%20%60update%20voucher%20set%20delivered_num%20%20%3D%20delivered_num%20+%201%20where%20id%20%3D%201%20and%20deliver_budget%20%3E%20delivered_num%3B%60%7C%7C%20Rows%20matched%3A%201%20%20Changed%3A%201%20%20Warnings%3A%200%20%20update%20%u6210%u529F%7C%0A%7C4.%u91CD%u65B0select%20%60select%20*%20from%20voucher%20where%20id%3D1%3B%60%7C%7C%20update%20%u786E%u5B9E%u751F%u6548%7C%0A%7C%7C5.%u68C0%u67E5select%20%60select%20*%20from%20voucher%20where%20id%3D1%3B%60%7C%u8FD9%u91CC%u7684%u8FD4%u56DE%u7ED3%u679C%u4E0E%u521D%u59CB%u503C%u76F8%u540C%uFF0C%u53EF%u89C1mysql%u7684%u9ED8%u8BA4%u4E8B%u7269%u7EA7%u522B%60Repeatable%20reads%60%u662F%u6709%u6548%u7684%uFF0C%20%u5728%u4E8B%u7269%u4E2D%u6240%u6709%u7684%u8BFB%u4FDD%u6301%u4E00%u81F4%u6027%u3002%7C%0A%7C%7C6.update%20%60update%20voucher%20set%20delivered_num%20%20%3D%20delivered_num%20+%201%20where%20id%20%3D%201%20and%20deliver_budget%20%3E%20delivered_num%3B%60%7Cupdate%u64CD%u4F5Cwait%20for%20lock%u3002**%u8FD9%u91CC%u5C31%u89E3%u51B3%u4E86%u6211%u4E4B%u524D%u7684%u79FB%u95EE**%20%u4E24%u4E2A%u4E8B%u7269update%u540C%u4E00%u884C%u7684%u65F6%u5019%u4F1A%u6709%u9501%u673A%u5236%u3002%20%u800C%u4E14%u8FD9%u4E2A%u9501%u5E76%u4E0D%u662F%u5728update%u4E4B%u540E%u5C31%u5373%u523B%u91CA%u653E%u3002%7C%0A%7C7.commit%7C%7Csession2%u4E2D%u7684%u64CD%u4F5C6%u5B8C%u6210%u3002%20%u8FDB%u4E00%u6B65%u8BC1%u660E%u4E86%u5728isolation%20level%20%u4E3A%60Repeatable%20reads%60%u4E0B%u6240%u6709%u7684%u9501%u662F%u5728%u4E8B%u7269%u7ED3%u675F%u65F6%u624D%u8FDB%u884C%u3002%u540C%u65F6%u7B2C6%u6B65%u8FD4%u56DE%u7684%u7ED3%u679C%u662F%20Rows%20matched%3A%200%20%20Changed%3A%200%20%20Warnings%3A%200%u3002%20**%u8FD9%u662F%u6211%u5728%u8FD9%u6B21%u5B9E%u9A8C%u4E2D%u53D1%u73B0%u7684%u6700%u6709%u8DA3%u7684%u5730%u65B9**%20%u4ECE%u903B%u8F91%u4E0A%u6765%u8BB2%uFF0C%20select%20%u7684%u7ED3%u679C%20%60delivered_num%20%3D%200%60%20%60deliver_budget%20%3D%201%60%20%u662F%u4F1A%u8FDB%u884Cupdat%u7684%u4F46%u662Fmysql%u786E%u6CA1%u6709%u3002%20%u8FD9%u4E00%u5757%u5F88%u4EE4%u6211%u8D39%u89E3%u4E8E%u662F%u6709%u4E86%u7B2C8%u6B65%u9A8C%u8BC1%7C%0A%7C%7C8.%60select%20*%20from%20voucher%20where%20id%3D1%20and%20deliver_budget%20%3E%20delivered_num%3B%60%7C%u7ED3%u679C%u8FD9%u65F6%u5C45%u7136%u8FD4%u56DE%u4E86%u4E00%u884C%u3002%20%u770B%u6765%20mysql%u7684%60select%60%u548C%60update%60%u662F%u4E24%u4E2A**%u5B8C%u5168%u4E0D%u540C%u7684%u903B%u8F91**%7C%0A%7C%7C9.%u6211%u60F3%u9A8C%u8BC1%u4E00%u4E0Bupdate%u76F4%u63A5%60+%3D1%60%u4F1A%u662F%u4EC0%u4E48%u9B3C%20%60update%20voucher%20set%20delivered_num%20%3D%20delivered_num%20+%201%20where%20id%3D1%60%u53C8%u51FA%u73B0%u4E86%u6B63%u786E%u7684%u4F46%u662F%u903B%u8F91%u5F88%u8BE1%u5F02%u7684%u7ED3%u679C%7C%u51FA%u6765%u7684%u7ED3%u679C%60delivered_num%60%20%u4E3A2%uFF0C%20%u4E0D%u662F%u5728%u8FD9%u4E2A%u4E8B%u7269%u4E2Dupdate%u4E4B%u524D%60delivered_num%60%u662F0%u561B%uFF0C%60+1%60%20%u4E4B%u540E%u6210%u4E862%uFF08mysql%u4F60%u4ED6%u5988%u5728%u9017%u6211%uFF01%uFF09%7C%0A%0A%u5230%u6B64%u9A8C%u8BC1%u7ED3%u675F%u3002%20%u60F3%u4E00%u60F3%60mysql%60%u8FD8%u86EE%u667A%u80FD%u7684%uFF0C%u5728%u4E8B%u52A1%u4E2D%60select%60%20%u6EE1%u8DB3%60repeatable%20reads%60%0A%u800C%60update%60%u4E0D%u6EE1%u8DB3%u3002%u8FD9%u6837%u5C31%u4FDD%u6301%u4E86%u6570%u636E%u7684%u4E00%u81F4%u6027%u3002%u7136%u800C%u4ECE%u7A0B%u5E8F%u7684%u903B%u8F91%u89D2%u5EA6%u6765%u8BB2%u8FD8%u662F%u86EE%u8BE1%u5F02%u7684%u3002%0A%0A%0A%23%23%20%u63A2%u7A76%u7684%u8FC7%u7A0B%0A%0A%u5BF9%u4E8E%u9A8C%u8BC1%u5F97%u5230%u7684%u7ED3%u679C%uFF0C%u86EE%u8D85%u51FA%u6211%u7684%u60F3%u50CF%u7684%u3002%20%u7136%u540E%u5C31google%u4E00%u901A%u641C%u7D22%u3002%u9996%u5148%u91CD%u65B0%u53BB%u4E86%u89E3%u4E86%u4E00%u4E0Bisolation%20%u8FD9%u4E2A%u6982%u5FF5%u3002isolation%u6709%u51E0%u4E2A%u7EA7%u522B%uFF1A%5B%20**Serializable**%2C%20%20**Repeatable%20reads**%2C%20%20**Read%20committed**%2C%20**Read%20uncommitted**%20%5D%28https%3A//en.wikipedia.org/wiki/Isolation_%28database_systems%29%29%20%u8FD9%u51E0%u4E2A%u6982%u5FF5%u4E4B%u524D%u4E5F%u542C%u8BF4%u8FC7%uFF0C%u6BCF%u6B21%u770B%u5B8C%u4E4B%u540E%u90FD%u89C9%u5F97%u7406%u89E3%u4E86%uFF0C%u8FC7%u4F1A%u5C31%u5FD8%u3002%0Amysql%u9ED8%u8BA4%u7684%u9694%u79BB%u7EA7%u522B%u662Frepeatable%20reads%2C%20%u4E5F%u5C31%u662F%u8BF4%u5728%u4E00%u4E2A%u4E8B%u7269%u4E2D%uFF0C%u6240%u6709%u7684%u8BFB%u90FD%u662F%u8BFB%u7684%u6700%u5F00%u59CBselect%u7684snapshot%u3002%u9A8C%u8BC1%u64CD%u4F5C%u4E2D%u7684%u7B2C5%u6B65%u4E5F%u5370%u8BC1%u4E86%u8FD9%u4E2A%u95EE%u9898%u3002%u4F46%u662F%u4ECE%u7A0B%u5E8F%u7684%u89D2%u5EA6%u6765%u8BB2%uFF0Cupdate%u64CD%u4F5C%u4E0D%u5E94%u8BE5%u662F%u5148%u8BFB%u5230%u539F%u6765%u7684%u503C%u7136%u540E%u5728%u66F4%u65B0%u4E00%u4E0B%u4E48%u3002%u6309%u7167%u8FD9%u4E2A%u903B%u8F91%20%u8BFB%u7684%u662Fsnapshot%20update%u5E94%u8BE5%u662F%u57FA%u4E8E%u8FD9%u4E2Asnapshot%u8FDB%u884C%u7684update%u64CD%u4F5C%u624D%u5BF9%u3002%uFF08%u4F46%u662F%u4ECE%u4E1A%u52A1%u903B%u8F91%u7684%u89D2%u5EA6%u6765%u8BB2%u786E%u5B9E%u9700%u8981%u8FD9%u6837%u6765%u5B9E%u73B0%u4E00%u81F4%u6027%uFF0C%u4E0D%u7531%u5F97%u4E3Amysql%u7684%u8BBE%u8BA1%u70B9%u4E2A%u8D5E%u3002%uFF09%0A%0A%0A%u4E8E%u662F%u7EE7%u7EED%u7FFB%u6587%u6863%uFF1A%20http%3A//dev.mysql.com/doc/refman/5.7/en/innodb-consistent-read.html%20%20%u5728%u4E00%u4E2A%u9690%u85CF%u7684%u89D2%u843D%u770B%u5230%u8FD9%u6837%u4E00%u4E9B%u8BDD%20The%20snapshot%20of%20the%20database%20state%20applies%20to%20SELECT%20statements%20within%20a%20transaction%2C%20not%20necessarily%20to%20DML%20statements.%20If%20you%20insert%20or%20modify%20some%20rows%20and%20then%20commit%20that%20transaction%2C%20a%20DELETE%20or%20UPDATE%20statement%20issued%20from%20another%20concurrent%20REPEATABLE%20READ%20transaction%20could%20affect%20those%20just-committed%20rows%2C%20even%20though%20the%20session%20could%20not%20query%20them.%20If%20a%20transaction%20does%20update%20or%20delete%20rows%20committed%20by%20a%20different%20transaction%2C%20those%20changes%20do%20become%20visible%20to%20the%20current%20transaction.%20For%20example%2C%20you%20might%20encounter%20a%20situation%20like%20the%20following%u3002%20%0A%0ABut%20%u8FD9%u662F%u5982%u4F55%u5B9E%u73B0%u7684%u5462%3F%20%u7B80%u5355%u7684%u731C%u60F3%u4E00%u4E0B%u89C9%u5F97%u53EF%u80FD%u662F%u901A%u8FC7MVCC%u6765%u5B9E%u73B0%u7684%0A%0Ainnodb%u4E3A%u6BCF%u4E00%u4E2A%u6211%u4EEC%u770B%u5230%u7684%u6570%u636E%u884C%u5B58%u50A8%u4E86%u591A%u4E2A%u7248%u672C%u5E76%u6807%u8BB0%u6BCF%u4E00%u4E2A%u7248%u672C%u7684%u521B%u5EFA%u7248%u672C%u53F7%u548C%u5220%u9664%u7248%u672C%u53F7%u3002%20repeatable%20reads%20%u7684%u5B9E%u73B0%u5C31%u662F%u53BB%u5728%u7B2C%u4E00%u6B21%u8BFB%u7684%u65F6%u5019%u627E%u4F4E%u4E8E%u4E8B%u52A1%u5F00%u59CB%u65F6%u7684%u7248%u672C%u53F7%u7684%u6570%u636E%u7248%u672C%u3002%20%u800C%u6309%u7167%u8FD9%u4E2A%u63A8%u8BBA%uFF0C**UPDATE%u5C31%u662F%u6C38%u8FDC%u57FA%u4E8E%u6700%u65B0%u7248%u672C%u7684%u6570%u636E%u8FDB%u884C%u7684%u64CD%u4F5C%u4E86**%20%u8FD9%u662F%u4E00%u4E2A%u731C%u6D4B%uFF0C%u6CA1%u6709%u5728%u6587%u6863%u4E2D%u627E%u5230%u3002%u5C0F%u5FC3%u6C42%u8BC1%u7684%u8FC7%u7A0B%u5C31%u4E0D%u505A%u4E86%u3002%0A%0A%0A%23%23%20%u603B%u7ED3%0A%0A+%20%u4EE5%u540E%u5728%u5904%u7406%u5E76%u53D1%u95EE%u9898%u7684%u65F6%u5019%u5C31%u53EF%u4EE5%u653E%u5FC3%u7684%u5728%u4E8B%u7269%u4E2D%u7528update%u4E86%u3002%u800C%u4E0D%u7528%u53BB%u663E%u793A%u7684%60select%20for%20update%60%20%u9501%u4F4F%u4E00%u884C%u3002%0A+%20%u5728%u4E8B%u52A1%u64CD%u4F5C%u4E2D%20select%u5F97%u5230%u7684%u6570%u636E%u4E0D%u53EF%u4FE1%uFF0C%u4E0D%u8981%u57FA%u4E8Eselect%u7684%u7ED3%u679C%u53BB%u8FDB%u884C%u4E0B%u4E00%u6B65%u64CD%u4F5C%u3002update%u5C3D%u91CF%u7528%u4E00%u4E2A%u539F%u5B50%u64CD%u4F5C%u53BB%u5B8C%u6210%u3002%0A