Ything-RepoMirrors/apple-foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2026-01-25 12:28:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,529 Commits 39 Branches 326 Tags
version-vector-disk-queue
Commit Graph

334 Commits

Author SHA1 Message Date
Syed Paymaan Raza
c3e7542cda Update end year in copyright header 2024-08-02 09:40:11 -07:00
Xiaoge Su
ecdd78f65e Add extra informations when checkExclusion receives a problematic status json 2024-07-12 17:51:49 -07:00
Boris Korzun
f7a443aea4 Add libfmt 10+ support (#11140) 2024-02-13 23:09:58 +03:00
Dimitris Apostolou
a88114c222 Fix typos 2024-02-07 01:16:00 +02:00
Johannes M. Scheuermann
64b45088ae Make sure server list is validated against the excluded localites 2023-10-24 10:28:23 +02:00
Zhe Wang
5f43fc91e7 pr-10985 2023-10-17 11:19:25 -07:00
Sreenath Bodagala
3c01b1befe - Add a special key in order to fetch a specific group of status json fields. 2023-09-25 16:23:19 +00:00
Zhe Wang
3426fc3c1a Add DD Security Mode (#10646) 
* dd-security-mode

* address comments

* cleanup

* revise tr option set in loadAndUpdateAuditMetadataWithNewDDId

* address comments

* reset auditStorageInitStarted before DD init

* decouple audit resume and audit launch

* audit launch new request should wait for resuming existing requests

* address comment/clean up/fix

* fix

* fix initAuditMetadata retry

* fix initAuditMetadata retry should reset tr
 2023-07-21 17:06:25 -07:00
Ankita Kejriwal
9373191e0a Fix two bugs in checkExclusion() and add a trace event for better observability (#10330) 
* Fix a division in checkExclusion() to be double and add a trace event

* Update the ssExcludedCount only if the role is storage
 2023-05-24 10:58:03 -07:00
A.J. Beamon
d8141c049d Add code probes for tenant code 2023-05-10 20:44:39 -07:00
Zhe Wu
50a20946d1 Implement check if locality is already excluded in exclude locality command 2023-04-01 19:04:58 -07:00
Johannes M. Scheuermann
6a612dd85f Don't stop iterating over all storage processes in exclusion check 2023-03-30 13:52:23 +02:00
Zhe Wu
8211b5d097 Add a check in excludeServer function that if the exclusion list already exists, don't need to issue new writes. 2023-03-24 14:57:31 -07:00
Johannes M. Scheuermann
694263ae5f Format code and update comment 2023-03-22 16:31:04 +01:00
Johannes M. Scheuermann
b317928646 Only consider newly excluded processes 2023-03-15 15:36:15 +01:00
Johannes M. Scheuermann
c6eca3f398 Format code 2023-03-08 08:33:19 +01:00
Johannes M. Scheuermann
1550f3c596 Make use of precomputed exclude check 2023-03-08 08:19:42 +01:00
Johannes M. Scheuermann
bae627f016 Fix syntax 2023-03-08 08:19:42 +01:00
Johannes M. Scheuermann
db8c60c80f Don't block the exclusion of stateless processes by the free capacity check 2023-03-08 08:19:41 +01:00
Ankita Kejriwal
99a1fb52e3 Prevent divison by 0 2023-02-24 18:36:55 -08:00
Ankita Kejriwal
64ac92bd4b Improve comments as per review 2023-02-22 17:13:44 -08:00
Ankita Kejriwal
8aafbfe6cc Improve space estimation in checkExclusion() 2023-02-22 15:58:25 -08:00
FoundationDB CI
86d6106dc1 format source code after switch to clang 15 2022-12-08 17:26:45 +00:00
Chaoguang Lin
4dbfa01fbf Add a new robustness workload for testing special keys (#8957) 
* Add a new robustness workload for testing special keys

* Fix a few robustness related issues and remove duplicate tests

* Add comments
 2022-12-05 14:05:26 -08:00
Markus Pilman
23edfd0d59 Fix formatting 2022-10-04 18:33:30 -06:00
Markus Pilman
550488b020 Merge remote-tracking branch 'origin/main' into bugfixes/open-for-ide 
# Conflicts:
#	bindings/c/CMakeLists.txt
#	fdbclient/include/fdbclient/GetEncryptCipherKeys.actor.h
#	fdbserver/BackupWorker.actor.cpp
#	fdbserver/BlobWorker.actor.cpp
#	fdbserver/CommitProxyServer.actor.cpp
#	fdbserver/KeyValueStoreMemory.actor.cpp
#	fdbserver/StorageCache.actor.cpp
#	fdbserver/include/fdbserver/GetEncryptCipherKeys.actor.h
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/PhysicalShardMove.actor.cpp
#	flow/CMakeLists.txt
 2022-10-04 18:27:48 -06:00
Jingyu Zhou
772a9ab9fc Merge pull request #8185 from vishesh/issue-8127-exclude 
Make exclusion less pessimistic when warning about low space usage
 2022-09-27 14:14:25 -07:00
Chaoguang Lin
9628561235 Add DataDistributionMetrics workload into correctness packages, (#8237) 
which makes the code probe hit in nightly tests.
 2022-09-20 15:33:15 -07:00
Vishesh Yadav
ddd3217471 Make exclusion less pessimistic when warning about low space usage 
Tries to account for shared disks by looking at disk_id if available.
 2022-09-20 11:02:19 -07:00
Chaoguang Lin
125137b987 Change the special key space correctness workload to hit code probe (#8214) 2022-09-19 15:01:21 -07:00
A.J. Beamon
4fd64630e8 Convert literal string ref instances to use _sr suffix 2022-09-19 11:35:58 -07:00
Lukas Joswiak
1a33515934 Add --no-config-db option to fdbcli coordinators command 
Specifying the `--no-config-db` option when changing coordinators
through fdbcli will prevent the command from hanging when the
configuration database is not active. Failing to specify this option
when the configuration database is not active will not affect the
correctness of the command, but it will hang instead of returning.
 2022-09-13 16:53:54 -07:00
Jon Fu
dbb6357371 add conflict range tests and change tenant prefix code to work with RYW 2022-09-06 16:55:57 -07:00
Jon Fu
479d774e79 set raw access for certain management API functions and update special key test 2022-08-29 11:45:56 -07:00
Jon Fu
ee707b8f87 initial commit for explicit tenant support in special key space 2022-08-25 12:44:10 -07:00
Chaoguang Lin
3fed0456ca Add an verify option for \xff\xff/worker_interfaces special keys (#7873) 
* Add the verify option for \xff\xff/worker_interfaces

* Remove unused code

* update documentations

* update documentations

* solve comments from review

* update some of the comments to be more clear
 2022-08-15 14:05:07 -04:00
Lukas Joswiak
a4c4eadffc Write tracing and ALP special key errors as JSON 2022-08-08 10:31:10 -07:00
Chaoguang Lin
48e46cbc81 Add test coverage for SpecialKeyRangeAsyncImpl::getRange (#7671) 
* Add getRange test coverage for SpecialKeyRangeAsyncImpl

* Fix the bug in SpecialKeyRangeAsyncImpl found by the test

* Refactor ConflictingKeysImpl::getRange to use containedRanges to simplify the code

* Fix file format

* Initialize SpecialKeyRangeAsyncImpl cache with correct end key

* Add release notes

* Revert "Refactor ConflictingKeysImpl::getRange to use containedRanges to simplify the code"

This reverts commit fdd298f469.
 2022-08-02 12:04:40 -07:00
Andrew Noyes
89141d4b3a Validate subrange reads in simulation (#7597) 
* Add extra validation to special key space reads in simulation

* Fix bugs turned up by validating subrange reads

* Change to validateSpecialSubrangeRead

It is in general not safe to expect that a read from the special key
space returns the same results if performed again, since the
transaction may be being modified concurrently.

* Add comment

* Add comment
 2022-07-21 14:42:08 -07:00
A.J. Beamon
410f27412b Merge pull request #7620 from sfc-gh-ajbeamon/make-tuple 
Add a Tuple::makeTuple function to easily construct a tuple
 2022-07-20 17:09:10 -07:00
A.J. Beamon
190ad8c7e9 Convert existing tuple usages to use Tuple::makeTuple() 2022-07-19 13:45:59 -07:00
Markus Pilman
1de37afd52 Make TEST macros C++ only (#7558) 
* proof of concept

* use code-probe instead of test

* code probe working on gcc

* code probe implemented

* renamed TestProbe to CodeProbe

* fixed refactoring typo

* support filtered output

* print probes at end of simulation

* fix missed probes print

* fix deduplication

* Fix refactoring issues

* revert bad refactor

* make sure file paths are relative

* fix more wrong refactor changes
 2022-07-19 13:15:51 -07:00
A.J. Beamon
1b81e72604 Add a Tuple::makeTuple function to easily construct a tuple. Update Tuple to allow all types to be passed via .append() so they can be used with makeTuple. 2022-07-19 11:50:58 -07:00
A.J. Beamon
c4b0f6eaae Add an internal C API to support connection to a cluster using a connection string (#7438) 
* Add an internal C API to support memory connection records

* Track shared state in the client using a unique and immutable cluster ID from the cluster

* Add missing code to store the clusterId in the database state object

* Update some arguments to pass by const&
 2022-07-07 10:12:49 +02:00
A.J. Beamon
2f67328a0c Update the tenant special keys submodule to support multiple sub-ranges. This will enable future work that allows configuring tenants at the same time as creating them. 2022-06-30 15:03:37 -07:00
A.J. Beamon
4bafe77889 Some refactoring of tenant code: 
* extract tenant management into its own file and namespace
* rename the tenant management workload source file
* extract tenant special keys functions to a separate file
* extract some helper functions to GenericTransactionHelper.h
* convert StringRef -> TenantNameRef
* move some TenantMapEntry implementation into the cpp file
* add some helper functions to decode/encode a tenant mode
 2022-06-27 12:32:49 -07:00
A.J. Beamon
90625ba20d Update the create tenant transaction to take the ID as a parameter. Generate unique IDs for multiple creations in the same transaction. Don't set lock aware options inside the tenant transaction code. 2022-06-06 09:45:14 -07:00
Lukas Joswiak
43ece953e1 Remove actor for client profiling get range 
Since the client profiling special key range now uses global config,
there is no longer any `wait` required.
 2022-05-27 10:25:29 -07:00
Jingyu Zhou
ae5818afa8 Merge pull request #7240 from jzhou77/fix-7109 
CC sends recovery txn version during TLog recruitment
 2022-05-27 09:27:19 -07:00
Jingyu Zhou
0aea52d640 Disable verbose NormalizeKeySelector event 
This type of events can exceed 0.5M in one of tests and cause
SpecialKeySpaceCorrectness.toml fail.
 2022-05-25 13:23:43 -07:00