Ything-RepoMirrors/apple-foundationdb
1
0
Fork 0
mirror of https://github.com/apple/foundationdb.git synced 2026-01-25 04:18:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,257 Commits 39 Branches 326 Tags
main
Commit Graph

51 Commits

Author SHA1 Message Date
michael stack
b37af3e959 Formatting 2025-01-10 09:54:12 -08:00
michael stack
fd239fcb2d Clarifying documentation on blob backup URL and credentials file. 
* documentation/sphinx/source/backups.rst
 Minor edit. Add more examples making it clearer how to do S3
 backup URLs in particular. Explain the 'trick' for omitting
 key, secret, and token from URL instead picking them up from
 the credentils file.

* fdbclient/S3Client_cli.actor.cpp
 Minor cleanup of usage.
 2025-01-10 09:30:24 -08:00
Dimitris Apostolou
a88114c222 Fix typos 2024-02-07 01:16:00 +02:00
Alexandre Burgoni
108ef9db3b Fix double quotes on code 2024-01-31 22:37:41 +01:00
Alexandre Burgoni
dca1611e24 docs: add backup details about parameters 2024-01-31 14:38:56 +00:00
hao fu
3967136eeb Add Knobs to control retry delays for BlobStore 
We learnt that a new connection needs to be made for each HTTP
request through proxy to AWS S3, thus it would fail when try
to re-use the connections and see retryable errors.

Meanwhile, delay between each retry grow 2x each time it failed,
if the connection pool has a larger size, the delay can be long.

As a result, this change adds Knobs to cap the max delay of
retryable errors, including one for general retryable errors,
and the other only for connection failure error.

This change also adds more logging for debugging.
 2023-10-23 16:39:34 -07:00
Josh Slocum
d68cd3493e making read caching configurable for blob store (#8607) 2022-11-03 16:42:46 -05:00
Nim Wijetunga
025359a974 Add Options to restore user/system keys in backup agent (#8497) 
* add options to restore user/system keys

* format help commands

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update documentation/sphinx/source/backups.rst

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* Update fdbbackup/backup.actor.cpp

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

* address pr comments

Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
 2022-10-20 09:58:00 -07:00
Zhanwei Wang
e632aef1c7 Make backup work with s3 compatible service (#6355)(#6382) (#7324) 
1. Support virtual hosting endpoint.

2. On-premise s3 compatible storage service may use IP instead of s3 form domain name,
especially for development/test environment.

Instead of parsing service and region from domain name,

1). Hard code "s3" as service name in v4 signature
2). Add new parameter to allow pass region name from url

3. Fix creating bucket issue on aws, adding request body.
 2022-06-13 13:33:05 -07:00
Josh Slocum
07adc873a6 Add documentation for aws sdk auth 2022-05-26 13:18:25 -05:00
Balachandar Namasivayam
831d2f8e2c Merge pull request #6660 from bnamasivayam/release-7.1 
Add backup documentation to select between v2 and v4 signature protocol.
 2022-03-24 09:41:06 -07:00
Bala Namasivayam
930cd7f9c7 Add backup documentation to select between v2 and v4 signature protocol. 2022-03-23 11:03:49 -07:00
sfc-gh-tclinkenbeard
8dcac2f76d Fix typos 2022-03-13 10:02:11 -03:00
Bala Namasivayam
a420098fc5 Support AWS v4 header for s3 backup and restore 2022-02-07 17:53:05 -08:00
sfc-gh-tclinkenbeard
ef711d405c Add fdbbackup tags command 2022-01-24 13:34:54 -08:00
A.J. Beamon
f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
RenxuanW
41ca11c3e5 Implement restoring an inconsistent snapshot as a real feature. 2021-04-22 13:53:37 -07:00
RenxuanW
41104040ad Rename init_snapshot_interval to initial_snapshot_interval. 2021-04-15 15:24:24 -07:00
RenxuanW
ebf37594f7 Change initialSnapshotIntervalSeconds from knob to a backup argument. 2021-04-13 19:22:13 -07:00
Steve Atherton
f0d35e87ef Renamed knob and URL parameter for request timeout to request timeout min to more accurately reflect what they do. 2020-07-19 17:41:59 -07:00
Jingyu Zhou
2c5da1c116 Remove "-p" option and use "--partitioned_log_experimental" option 2020-05-04 13:45:54 -07:00
Jingyu Zhou
e8ea9c5dba Update fdbbackup documentation on new "-p" option 
To use new backup system in 6.3 to generate partitioned mutation logs by backup
workers.
 2020-05-04 09:17:22 -07:00
Alex Miller
62a1983c62 reStructuredText uses `x as code font and not x`. 2020-02-21 17:48:34 -08:00
Kyle Snavely
08de50a487 Update backup in-flight TLS support documentation 2020-02-19 16:37:24 -07:00
tclinken
6aa8023788 Fixed minor documentation typo 2020-01-11 17:12:41 -08:00
Evan Tschannen
cadf82eca0 updated documentation for 6.2.5 2019-09-30 13:15:30 -07:00
Steve Atherton
93ba6f539a Update documentation/sphinx/source/backups.rst 
Co-Authored-By: A.J. Beamon <ajbeamon@users.noreply.github.com>
 2019-07-30 10:08:04 -07:00
Stephen Atherton
5462722825 Fixed incorrect documentation about fdbrestore cluster file argument. 2019-07-29 13:47:44 -07:00
A.J. Beamon
87e1860d7c A bunch of documentation fixes 2019-05-21 16:30:52 -07:00
Steve Atherton
8aab719c22 Merge branch 'master' into feature-backup-json 2019-03-12 18:23:16 -07:00
Stephen Atherton
bc0b2aa040 Merge branch 'release-6.0' of https://github.com/apple/foundationdb 
# Conflicts:
#	documentation/sphinx/source/release-notes.rst
#	fdbbackup/backup.actor.cpp
#	fdbclient/BlobStore.actor.cpp
 2019-03-12 04:49:12 -07:00
Stephen Atherton
adc5553cd9 Updated backup documentation regarding timestamp format. 2019-03-11 02:05:01 -07:00
Steve Atherton
563f6a21b1 Update documentation for modify active snapshot interval option 2019-03-11 01:50:34 -07:00
Stephen Atherton
a57ddd29f2 Bug fixes in fdbbackup modify command. Active snapshot interval was wrong. New backup destination containers were not being created. Renamed some variables for clarity. 2019-03-05 18:05:52 -08:00
Stephen Atherton
2f7d559442 Restore now requires an explicit destination cluster file. Restore target database version can now be specified by a timestamp, which must be resolved using the cluster file for the cluster from which the backup originated. 2019-03-05 12:28:05 -08:00
Stephen Atherton
a5b53d3c0f More documentation and release note changes for fdbbackup modify. Added release note for #1205 bug fix which was missed. 2019-03-05 10:44:14 -08:00
Stephen Atherton
f6559bbb11 Added help and documentation for fdbbackup modify. Add BackupUID and more parseable BackupURL to fdbbackup status output. 2019-03-05 05:13:48 -08:00
Stephen Atherton
d3377722d5 Added blob store Backup URL parameter 'header' which enables addition of custom HTTP header fields to blob store HTTP requests. Added 'fdbbackup modify' command line tool for changing the backup URL and parameters, default snapshot interval, and/or current snapshot interval of a running backup. 2019-03-05 04:00:11 -08:00
Chris Donati
1c2dc20007 Note dr_agent prerequisite for "fdbdr switch" 
If the user forgets to start a dr_agent with the right arguments
on the destination cluster, the switch cannot complete.
 2019-01-22 16:57:37 -08:00
Stephen Atherton
3125b807b3 Added documentation of the 'bucket' URL parameter for blobstore:// backup URLs. 2018-11-13 06:23:58 -08:00
A.J. Beamon
d54af96ba4 Various fixes to our documentation, such as syntax problems, broken links, etc. 2018-11-01 14:19:37 -07:00
Richard Low
29d365bcc8 Merge remote-tracking branch 'apple/release-5.2' into tls-docs 2018-05-23 14:58:59 -07:00
Richard Low
ac8da9589a Update TLS docs with new plugin options 2018-05-23 14:46:20 -07:00
Alvin Moore
463a8cf349 Fixed carriage return line endings 2018-05-23 11:30:48 -07:00
Bruce Mitchener
2f8a0240f1 Fix some typos. 2018-04-19 11:44:01 -07:00
Stephen Atherton
344093519a Merge branch 'release-5.1' of github.com:apple/foundationdb into backup-docs 
# Conflicts:
#	documentation/sphinx/source/backups.rst
 2018-03-24 15:15:43 -07:00
John Brownlee
993b53ea3b Fixes the name of the dr_agent command in the docs. 2018-03-23 12:48:58 -07:00
Stephen Atherton
10b1e76e4d More backup documentation, added blob credential file format and usage and a few other tweaks. 2018-03-23 02:46:25 -07:00
Stephen Atherton
b600691e6b Added documentation for recently added fddbackup subcommands expire, list, and describe. 2018-03-23 02:13:26 -07:00
Stephen Atherton
9852cb66a2 Rewrote and reformatted much of the Backup and DR documentation. Added introductions to explain the recently added continuous backup mode and to explain DR in more detail. Removed references to fdbblob, documented new command line options. 2018-03-23 01:29:33 -07:00