Commit Graph

53 Commits

Author SHA1 Message Date
Syed Paymaan Raza
c146ee0869 [fdbserver] Use STL contains method and std::find for containment checks (#11702) 2024-10-15 11:40:02 -07:00
Syed Paymaan Raza
c3e7542cda Update end year in copyright header 2024-08-02 09:40:11 -07:00
Zhe Wang
970175a8a2 cherrypick storage queue aware getteam (#11154) 2024-01-30 15:15:18 -08:00
Dan Lambright
015167c17e Throttle commits against hot shards (#10970)
* throttle hot shards

* expire throttled shards over time

* add backoff

* Parallelize messaging from RK to CP

* Obtain shards from a single SS

* handle expired transactions

* bump transaction_throttled_hot_shard

* Change SevError to SevWarn for CannotMonitorHotShardForSS

* Add log per request
2023-10-31 12:01:34 -04:00
Xiaoxi Wang
32f6c02ba7 Add coalesceCompletedRange method 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
8abfffb508 Don't coalesce in setShardStatus 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
7465da29c1 Change setShardStatus implementation 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
c307795301 Fix merge shard bug in mock finishMoveKeys; And testRawFinishMoveKeys bug in workload IDDTxnProcessorApiCorrectness.actor.cpp 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
e3c9a1a7f5 Disable same address detection in mock DD and implement MockStorageServer::getStorageMetrics 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
b09483a644 addStoragePerProcess method. Add testClass for mock dd test. 2023-06-07 22:01:33 -07:00
Xiaoxi Wang
e139f5bf90 Correctly handle buggify errors in MGSWaitStorageMetrics 2023-06-07 22:01:33 -07:00
Jefferson Zhong
492c74b679 Implement IStorageMetricsService intef for BlobMigrator 2023-05-25 15:58:05 -07:00
Xiaoxi Wang
c6439f6ba2 add mock DD classes comments; mark code probe rare 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
b8ae2437b6 also make MockStorageMetrics log bytes stored 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
a05e078c4a Remove locations.size() == expectedShardCount assertion and add comments 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
d2bbc69a3c Fix MockDDTrackerShardEvaluator.actor.cpp check; add trace event to MGS get locations; 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
acd953af9b Change the way MGS unit test setup; add stdout info about mock cluster layout. 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
a182ce423f add cluster layout to MGS 2023-04-26 14:23:09 -07:00
Xiaoxi Wang
4201f5bd9a mock cpu usage from ops
modify calculateCpuUsage
2023-04-26 14:23:09 -07:00
Xiaoxi Wang
ee4798572c change allServers use Reference<MockStorageServer>; create CommonStorageCounters 2023-04-26 14:23:09 -07:00
Ankita Kejriwal
9529f360ee Update storage metrics functions to use the version at which tenant was read 2023-02-01 19:44:31 -08:00
A.J. Beamon
f999623bb1 Add a tenant lookup interface and use it when starting transactions 2023-01-06 15:51:12 -08:00
A.J. Beamon
62604bcc28 Merge branch 'main' into expand-optional-erroror-map 2023-01-04 15:46:23 -08:00
sfc-gh-tclinkenbeard
a408a90cd0 Removed unnecessary rare annotations 2023-01-03 11:17:07 -08:00
A.J. Beamon
985bbe66d4 Add support for flatMap in optional and erroror. Allow calling map with a lambda without specifying the return type template parameter. 2022-12-15 15:32:02 -08:00
A.J. Beamon
ce4a2a55b2 Remove the usage of tenant names (mostly) from the storage server 2022-12-05 15:44:41 -08:00
Trevor Clinkenbeard
6f70fc243b Add rare code probe annotations (#8948) 2022-12-05 09:23:47 -08:00
sfc-gh-tclinkenbeard
994fd4aa41 Remove rare annotation from some code probes 2022-12-01 09:59:08 -08:00
Xiaoxi Wang
8971b5907c add comments; mark some methods const 2022-11-16 13:18:40 -08:00
Xiaoxi Wang
907d7af966 solve merge conflict upstream/main 2022-11-15 14:59:31 -08:00
sfc-gh-tclinkenbeard
c03f60c618 Update rare code probe annotations 2022-11-15 13:21:25 -08:00
Xiaoxi Wang
89b3862497 fix randomKeyBetween bug 2022-11-14 15:10:33 -08:00
Xiaoxi Wang
f997e73758 rename variable and solve some light comments 2022-11-14 13:11:27 -08:00
Xiaoxi Wang
7c9334121a mark MoveKeysParams const& 2022-11-10 12:51:22 -08:00
Xiaoxi Wang
3fb12680e3 revert the mvccStorageBytes for write sample change and mark it with FIXME 2022-11-09 13:15:46 -08:00
Xiaoxi Wang
13fae7ba8a finish add MockDDTrackerShardEvaluatorWorkload 2022-11-02 13:45:53 -07:00
Xiaoxi Wang
5a4736a574 fix setShardStatus bug and finish the unit test 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
7ed5a99213 add setShardStatus unit test and change signatures of methods to const& 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
d2ecc3cb48 handling no-sampled scenario in unit test 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
802dce47b6 unit test clean; fix some bugs 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
004a0f8915 update data ops definition and comments; add a unit test 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
55a3db82b5 update the name, comment and discription of write byte sampling; update the calculation of write bandwidth metrics 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
0cbd1dfcca add comment and MockDDTest base class file 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
cc61ea6a01 finish the clearrange ops 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
334fced572 add data api implementations; add more realistic fetchKey implementation; finish randomKeyBetween implementation 2022-11-01 14:56:55 -07:00
Xiaoxi Wang
8a59bc276d data operation api (not finished) 2022-11-01 14:56:54 -07:00
Xiaoxi Wang
0a5e596758 fix network failure check in unit test 2022-10-25 16:43:00 -07:00
Xiaoxi Wang
36d9de9072 change UNREACHABLE to ASSERT(false); change function name 2022-10-25 15:43:24 -07:00
Xiaoxi Wang
0d4b4d05e2 implement MSS as IStorageMetricsService and pass the unit test 2022-10-24 09:58:41 -07:00
Xiaoxi Wang
3c67b7df39 extract serveStorageMetricsRequests template function 2022-10-24 09:58:41 -07:00