Ything-RepoMirrors/apple-foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2026-01-25 12:28:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,529 Commits 39 Branches 326 Tags
version-vector-disk-queue
Commit Graph

76 Commits

Author SHA1 Message Date
Syed Paymaan Raza
c3e7542cda Update end year in copyright header 2024-08-02 09:40:11 -07:00
Johannes M. Scheuermann
b2b3a8e791 Fix complie issue for ALLOC_INSTRUMENTATION 2024-02-01 14:48:04 +01:00
Andrew Noyes
218cda3cf6 Lower ASAN memory usage (#9216) 
* Print an asan heap profile on OOM

* Use 32KiB stacks for boost coro

* Print 100%, 10 max contexts for asan OOM

* Lower machineCount to 30 in DataLossRecovery test

* Add asanMachineCount override to control ASAN memory usage
 2023-01-24 13:04:47 -08:00
sfc-gh-tclinkenbeard
5a1a969343 Trace data hall id in MachineMetrics events 2023-01-11 10:02:31 -08:00
Sreenath Bodagala
774fc1168e - Log FoundationDB version as part of "ProcessMetrics". 2022-12-12 21:16:30 +00:00
Xiaoge Su
970463223c Merge branch 'main' into main 2022-09-20 16:56:56 -07:00
A.J. Beamon
4fd64630e8 Convert literal string ref instances to use _sr suffix 2022-09-19 11:35:58 -07:00
Xiaoge Su
8130fce97f Update code per comments 
Also sort #include in Platform.actor.cpp
 2022-09-12 11:44:41 -07:00
Xiaoge Su
92eaf53da3 Reads and reports cpu.stat 
Per #7952, content in /sys/fs/cgroup/cpu,cpuacct/cpu.stat is reported in
MachineMetrics.

If the file does not exist, reports `NoCpuStatFile`.

If the file is not parsable, reports `CpuStatFileParseError`.
 2022-09-12 11:43:10 -07:00
Yi Wu
994b8c92f8 Add option to limit resident memory and remove default memory limit (#6719) 
Changing `memory` option to limit resident memory instead of virtual memory, in config file and fdbserver/fdbbackup/fdbcli command-line argument. Since `rlimit` doesn't support limiting virtual memory, the current implementation have both of fdbmonitor and the fdbserver/fdbbackup process checking process RSS periodically and kill and restart the process if the limit is exceeded.

Adding a new `memory_vsize` option to limit virtual memory, if backward-compatible behavior is desired.

closes #6671, closes #6672
 2022-04-06 20:06:24 -07:00
Trevor Clinkenbeard
6390d93efd Merge pull request #6646 from sfc-gh-tclinkenbeard/fix-copyright-headers 
Update copyright header dates
 2022-03-21 16:49:20 -07:00
sfc-gh-tclinkenbeard
a71099471b Update copyright header dates 2022-03-21 13:36:23 -07:00
Steve Atherton
074698cdb1 Added 16k magazine size to memory stats. (#6639) 2022-03-21 13:30:27 -07:00
Andrew Noyes
7a9217a392 Add contrib/debug_determinism (#6389) 
* Add contrib/debug_determinism

Add an instrumentation-based technique for debugging unseen mismatches. Also guard a few existing sources of nondeterminism that don't affect unseen with the DEBUG_DETERMINISM macro.

Also change the simulated run loop to not run as the only task inside the real run loop, since that was a source of nondeterminism.

Also fix nondeterminism from calling timer_int

* Add StorageMetadataType::currentTime

Basically a deterministic-in-simulation version of timer_int that we can
use instead of timer_int for StorageMetadataType::createdTime
 2022-02-25 12:54:31 -08:00
Renxuan Wang
4a8e2a80e6 Improve/fix disk metrics. 
1. Introduce processDiskReadSeconds and processDiskWriteSeconds, which stands for disk read/write times `since the last logging`. They can only be obtained on Linux and macOS, and will be 0 on Windows and FreeBSD;
2. Rename `busyTicks` to `IOMilliSecs`;
3. On FreeBSD, the metrics should be collected among all devices.
 2022-01-27 14:40:32 -08:00
Yao Xiao
c8e6819a10 Add FastAlloc memory utilization trace. (#5739) 
Co-authored-by: Yao Xiao <yaoxiao@Yaos-MacBook-Pro.local>
 2021-10-11 15:06:43 -07:00
Zhe Wu
c07a07dbbe Take uptime into account when making failover decision 2021-10-07 11:19:34 -07:00
Trevor Clinkenbeard
0120a6ba72 Merge pull request #4936 from sfc-gh-tclinkenbeard/remove-string-copies 
Remove unnecessary std::string copies from flow
 2021-06-14 13:49:20 -07:00
sfc-gh-tclinkenbeard
399c2c96f0 Remove unnecessary std::string copies from flow 2021-06-09 11:40:01 -07:00
sfc-gh-tclinkenbeard
f28ac955c3 Remove unnecessary temporary objects while growing objects of type std::vector<std::pair<A, B>> 2021-05-10 16:32:50 -07:00
FDB Formatster
df90cc89de apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-03-10 10:18:07 -08:00
Andrew Noyes
877997632d Merge branch 'release-6.3' into anoyes/merge-release-6.3-master 
Include conflict markers for review purposes
 2020-12-04 01:38:07 +00:00
Andrew Noyes
1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge 
Merge, leaving conflict markers for now
 2020-11-24 16:55:34 +00:00
David Youngworth
d64cf8b9e3 Merge branch 6.3 into master 2020-11-17 11:22:45 -08:00
David Youngworth
d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
Xiaoge Su
3a6948c199 Report histogram periodically 2020-11-12 17:04:33 -08:00
Vishesh Yadav
2c56d379b2 Merge pull request #3998 from dongxinEric/misc/attach-dcid-to-process-metrics-when-possible 
Attach datacenter id to process, network, machine and memory metrics.
 2020-11-06 10:54:23 -08:00
Andrew Noyes
c50e997f60 Make status tests deterministic 
This change seems to be incorrect since afaict INetwork::timer isn't
guaranteed to be monotonic. Maybe we can make that guarantee or add an
INetwork::timer_monotonic symbol?
 2020-11-05 17:05:34 +00:00
Russell Sears
32c87bbb33 Lightweight, power of two spaced histogram implementation + automatic reporting 2020-11-02 11:13:16 -08:00
Xin Dong
e73d189f88 Attach datacenter id to process, network, machine and memory metrics. 2020-10-30 11:20:40 -07:00
Young Liu
8cc3e4d3c6 Merge release-6.3 into master 2020-10-19 22:51:56 -07:00
Meng Xu
4dff55c4ea Add comment for PriorityStarved metrics 
Metrics include:
PriorityStarvedBelowX, PriorityMaxStarvedBelowX and PriorityBusyX
 2020-10-16 13:45:03 -07:00
sfc-gh-tclinkenbeard
0ac08f6a9b Replace NULL with nullptr in flow 2020-09-20 11:31:49 -07:00
Evan Tschannen
2f5359fa13 fix: lastRunLoopBusyness did count the currently active time 2020-08-31 09:21:44 -07:00
Evan Tschannen
f6f9aea09e fix: runLoopBusyness was always zero 2020-08-28 09:29:54 -07:00
Evan Tschannen
9e2ee1ed4c fixed lastedZeroBusy; added a knob 2020-08-17 23:16:59 -07:00
Evan Tschannen
c72068d6b5 clients load balance across proxies based on process busyness instead of number of requests 2020-08-12 17:17:21 -07:00
A.J. Beamon
d8690d31cd Merge branch 'master' into per-priority-busy-logging 
# Conflicts:
#	flow/Net2.actor.cpp
 2020-04-15 08:31:30 -07:00
A.J. Beamon
b1172417f5 Merge branch 'master' into per-priority-busy-logging 
# Conflicts:
#	flow/Knobs.cpp
#	flow/Knobs.h
#	flow/Net2.actor.cpp
 2020-04-14 14:22:12 -07:00
A.J. Beamon
e104a2e3a6 Merge commit 'cf01233f28a2c42908656a39f458a4475c1d44a3' into run-loop-busy-profiler 
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbclient/NativeAPI.actor.h
#	fdbserver/fdbserver.actor.cpp
#	flow/Net2.actor.cpp
 2020-04-14 14:02:24 -07:00
Alex Miller
04498cbc0e Make policy failures be reported as per 1s and not over 5s. 2020-03-13 02:49:06 -07:00
Alex Miller
75e2fffe5a Add a ProcessMetrics.TLSPolicyFailures metric 
This reports the number of policy failures over the past 5s interval.
It also is step 1 towards getting this information into status json.
 2020-03-13 02:24:37 -07:00
Evan Tschannen
1128666840 added additional logging on the log router 2020-03-05 18:17:06 -08:00
A.J. Beamon
abb75f7eb7 Add logging to indicate the time spent at each priority that exceeds some minimum busyness threshold 2020-02-07 14:34:24 -08:00
A.J. Beamon
182dac7cd5 Convert the slow task profiler into a run loop profiler that also logs when the run loop is 100% busy for a knob-configurable duration. 2020-01-28 12:09:37 -08:00
Evan Tschannen
1f7eb1f738 throttle outgoing tls connections before establishing a network connection 
store serverTLSConnectionThrottler map inside of g_network, so that it works properly with simulation
 2020-01-12 16:44:30 -08:00
A.J. Beamon
ca01593067 Cap busyness to 1.0 at logging time to cover all cases where it could be measured above. 2020-01-02 15:10:42 -08:00
A.J. Beamon
a093021855 Fix priority time calculation. Track max priority busy rather than seconds squared. 2019-12-17 09:14:54 -08:00
A.J. Beamon
fa6e45a852 Separate AsioReactor sleep and react into two different functions. Track slow tasks and time spent in react, track time spent in launch. Don't track react time at priority 0. 2019-08-28 14:35:48 -07:00
A.J. Beamon
b5d2234a13 Merge branch 'release-6.1' into merge-release-6.1-into-master 
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbbackup/backup.actor.cpp
#	fdbserver/MoveKeys.actor.cpp
#	flow/FastAlloc.h
#	versions.target
 2019-07-30 16:23:42 -07:00