87 Commits

Author SHA1 Message Date
Jingyu Zhou
2d2a2144f4 Update copyright years to 2013-2026 (#12653)
No functional changes.
2026-01-22 10:49:41 -08:00
Jingyu Zhou
9fe66e8b5a Add proxy option for fdbdecode (#12057) 2025-03-28 08:36:51 -07:00
michael stack
cab2f0d3d0 Remove duplicate code. Move BackupTLSConfig.* from fdbbackup to
fdbclient so can be used in fdbclient. Remove the copies of
BackupTLSConfig we had in place named BlobTLSConfig.*.
Keep the old name though it a little clunky.
2024-12-05 08:25:25 -08:00
Syed Paymaan Raza
c3e7542cda Update end year in copyright header 2024-08-02 09:40:11 -07:00
Matthew Newhook
4379fb45b0 merge changes for issue_1537 to main 2024-06-16 16:17:17 +00:00
Dimitris Apostolou
a88114c222 Fix typos 2024-02-07 01:16:00 +02:00
Uv
c1ba5d5733 To fix the fcntl2.h error, add the third parameter 2023-11-29 14:19:16 -08:00
Jingyu Zhou
b08291e8e2 Add more trace events 2023-03-03 09:40:44 -08:00
Jingyu Zhou
ee5154f478 Refactor decoder to read file as a whole once
To reduce the number of network requests.
2023-03-03 09:32:12 -08:00
Jingyu Zhou
c5a1fe7e6b Output in HEX format for easy regex matching 2023-02-28 14:59:06 -08:00
Jingyu Zhou
aca73a213d Change mutation and KV logging to SevInfo
Set max length as well to avoid TraceEventOverflow.
2023-02-28 10:07:04 -08:00
Jingyu Zhou
1313a7fa25 Use KeyspaceSnapshotFile to filter range files 2023-02-27 19:41:08 -08:00
Jingyu Zhou
ce123db490 Add a trace event for range files 2023-02-27 14:17:57 -08:00
Jingyu Zhou
944f5a1163 Fix merge conflict issues 2023-02-27 13:35:42 -08:00
Vishesh Yadav
58f8ede450 add command line option 2023-02-27 13:10:06 -08:00
Vishesh Yadav
3e6e31ad0b Use the RangeMapFilters 2023-02-27 13:08:55 -08:00
Jingyu Zhou
9ec9f38a50 Allow fdbbackup, fdbrestore to read keyranges from a file 2023-02-27 13:06:30 -08:00
Jingyu Zhou
dd4bc82862 Refactor code 2023-02-27 13:06:01 -08:00
Jingyu Zhou
3ab88442b9 Disable filter validate by default 2023-02-27 12:18:07 -08:00
Jingyu Zhou
8c8e20af5f Use KeyRangeMap for better matching performance 2023-02-27 12:17:26 -08:00
Jingyu Zhou
3c313c8ede Fix filter delimiter and print sub versions 2023-02-27 12:07:55 -08:00
Jingyu Zhou
93a8e00440 Allow fdbdecode to read filters from a file 2023-02-27 12:07:36 -08:00
Vishesh Yadav
64820fbfe5 add filtering 2023-02-27 12:03:23 -08:00
Vishesh Yadav
c66fd144c3 fdbdecode: read backup range files 2023-02-27 12:03:10 -08:00
Jingyu Zhou
7f21074916 Use KeyRangeMap for better matching performance 2023-02-27 12:02:52 -08:00
Jingyu Zhou
0a307d05ef Fix filter delimiter and print sub versions 2023-02-27 12:00:37 -08:00
Jingyu Zhou
09444d36ba Allow fdbdecode to read filters from a file 2023-02-27 12:00:24 -08:00
Vaidas Gasiunas
f8b1da8bc6 An option to initialize client tracing in setupNetwork (#9209)
* client_config_tester: use a generic mechanism to set specific network options

* trace_initialize_on_setup option to initialize client traces on network setup without local IP address

* trace_initialize_on_setup: Addressing review comments

* Restore correct formatting

* trace_initialize_on_setup: Update go bindings

* Include PID for identification into trace file names by default

* Use the same naming pattern for trace files in all configurations

* Empty commit
2023-02-02 10:00:51 +01:00
Robert Barabas
8606923da2 Arm64 related build fixes (#7319)
* Add missing include

* Fix open call on arm64

* Bump up doctest to 2.4.8
2022-06-08 11:20:27 -07:00
sfc-gh-tclinkenbeard
7f05221cfe Removed TLS_DISABLED macro 2022-05-02 22:15:27 -07:00
Mohamed Oulmahdi
5dc07c55f7 Add missing Windows headers 2022-04-06 14:43:59 +02:00
Jingyu Zhou
dcfb6ee520 Added an option to fdbdecode for saving processed files and fixed a memory corruption issue in clang build (#6767)
* Add save file locally feature to fdbdecode

* Fix use-after-free in fdbdecode

This only happens in clang, though.

* Minor refactor for fdbdecode

* Fix a small memory leak in fdbdecode
2022-04-05 16:16:59 -07:00
Jingyu Zhou
f68fd28d73 Refactor duplicated code into IKnobCollection::setupKnobs() 2022-04-05 02:06:38 -07:00
Renxuan Wang
0a332ee1c1 Add proxy option to backup and restore params. 2022-03-28 17:10:49 -07:00
Jingyu Zhou
2532ac5882 Add knob value changes to fdbdecode
E.g., HTTP_VERBOSE_LEVEL, and HTTP_REQUEST_AWS_V4_HEADER knobs.
2022-03-24 09:26:41 -07:00
Jingyu Zhou
cff1bc24fc Fix decoder for missing ClearRanges
If the ClearRange mutation happens within the given key prefix space,
previously the mutation is not printed. Fix by checking the prefix range
overlaps with the ClearRange mutation.
2022-03-22 16:04:56 -07:00
sfc-gh-tclinkenbeard
a71099471b Update copyright header dates 2022-03-21 13:36:23 -07:00
A.J. Beamon
f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
A.J. Beamon
f29f487823 Unify flags (#25)
* Unify flags implementation and change help text in backup.actor.cpp
Description

Testing

* Keep LOG_GROUP unchanged

Description

Testing

* Transfer the hyphens to underscores for internal options and user's input, EXCEPT leading hyphens

Description

Testing

* Use a deep copy of the user's input flag to do the match

Description

Testing

* Convert the _ to - in Option arrays of backup.actor.cpp

Description

Testing

* Transter _ to - for files:
        TLSConfig.actor.h, fdbcli.actor.cpp, fdbserver.actor.cpp, FileConverter.h, FileConverter.cpp

Description

Testing

* Change another way to unify flag: using SO_O_ICASE_HYPHEN_AND_UNDERSCORE to determine whether we do the conversion in function IsEqual

Description

Testing

* Change the config command's name from SO_O_ICASE_HYPHEN_AND_UNDERSCORE to SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Update the comment for the SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Fix left underscore in SOption arrays

Description

Testing

* Convert _ to - in several files for commands

Description

Testing

* Make the FDBService and fdbmonitor backward compatible

Description

Testing

* Fix bugs about pointers

Description

Testing

* Check underscore and hyphen at the same time for --knob_, --localily_ and --test_
And fix bugs in fdbmonitor and FDBService
Description

Testing

* Simplify the function in fdbmonitor and FDBService about retrieving arguments.
And fix some documents in masterserver.actor.cpp

Description

Testing

* Convert _ to - for knob in the setKnob functions

Description

Testing

* Convert - to _ in the setKnob functions

Description
Since key in the knob related maps only contain _

Testing

* Rename varialbe name in the fdbmonitor and FDBService for clarification

Description

Testing

Co-authored-by: Chang Liu <chang.liu@snowflake.com>
2021-12-14 08:44:39 -08:00
FDB Formatster
2c788c233d apply clang-format to *.c, *.cpp, *.h, *.hpp files 2021-08-27 17:07:47 -07:00
Steve Atherton
e5e8a56b66 Merge branch 'master' of https://github.com/apple/foundationdb into debugging-cleanup
# Conflicts:
#	fdbbackup/FileDecoder.actor.cpp
2021-08-09 23:36:57 -07:00
Steve Atherton
2bf7b9b7a9 Remove many calls to .toString(), .printable(), and printable(...) from TraceEvent .detail() values to avoid double-escaping characters such that the same values look different in different events and can't be easily searched for. Also fixed a few warnings found by clang. 2021-08-08 00:04:54 -07:00
Jingyu Zhou
5346213e7f Fix trace event UnfishedBlocks 2021-08-02 09:26:42 -07:00
Jingyu Zhou
31a64106fb Avoid memory copies after decoding a new file block 2021-08-02 09:21:33 -07:00
Jingyu Zhou
426e906a87 Remove duplicated code 2021-08-01 22:39:28 -07:00
Jingyu Zhou
8f1946f522 Remove unused code 2021-08-01 21:55:39 -07:00
Jingyu Zhou
1a97c3942a Fix trace events 2021-08-01 19:25:39 -07:00
Jingyu Zhou
4f5bcaf050 Remove verbose stdout messages 2021-08-01 19:11:23 -07:00
Jingyu Zhou
e3629ef356 Refactor decoder 2021-08-01 19:09:09 -07:00
Jingyu Zhou
d7ac5830e6 Fix decoder bug of shadowing loop index 2021-08-01 13:48:45 -07:00