60 Commits

Author SHA1 Message Date
Darkarotte
286ce2067f Kkostial/minor refactorings 2025-12-03 13:55:25 -05:00
Philip O'Toole
8954781883 Check for invalid backup intervals 2025-10-09 13:20:26 -04:00
Copilot
9c74a149e1 Integrate "file" backend into Auto-Backup 2025-09-19 07:59:02 -04:00
Philip O'Toole
9276021481 Support automatic backup to local file storage 2025-09-17 07:33:20 -04:00
Philip O'Toole
80517cf1a1 Switch go mod from v8 to v9 (#2329) 2025-09-15 10:54:22 -04:00
Philip O'Toole
2dd2e1dfcd Consolidate utilities into internal module 2025-07-07 11:04:43 -04:00
Philip O'Toole
e4cfe85ea3 Consolidate source code 2025-07-07 10:22:05 -04:00
Philip O'Toole
9037ec5853 GCS upload supports timestamps 2025-07-07 09:08:30 -04:00
Philip O'Toole
45826f68b5 End-to-end testing of GCS Backup and Restore 2025-07-06 22:00:34 -04:00
Philip O'Toole
49493fa8ab Initial refactoring for GCS integration 2025-07-06 16:06:47 -04:00
Philip O'Toole
9e7b3370f5 Replace interface{} with any (#2077) 2025-04-28 08:12:18 -04:00
Oleksandr Redko
9f8dbd520f Simplify tests by using t.Setenv instead of os.Setenv (#2037) 2025-01-27 09:25:35 -05:00
Philip O'Toole
0656a64977 Fix single-upload test 2024-10-24 08:08:51 -04:00
Philip O'Toole
c22a4b8869 White-box testing of Linearizable upgrade 2024-10-23 20:25:47 -04:00
Philip O'Toole
5848975555 Support automatic PRAGMA optimize (#1879)
Support automatic PRAGMA optimize
2024-09-05 08:54:38 -04:00
Philip O'Toole
99fe74570b Make upload test more robust 2024-05-28 23:14:45 -04:00
Philip O'Toole
f1b9405acb Allow Timestamping to be enabled 2024-05-03 08:42:25 -04:00
Philip O'Toole
b425b62275 S3 client supports timestamping uploads 2024-05-03 08:33:29 -04:00
Philip O'Toole
05bb6b76b1 Remove unused "compress" flag in auto-upload code 2024-05-03 07:44:55 -04:00
Philip O'Toole
c3bd719951 Remove unused function 2024-03-04 14:55:30 -05:00
Philip O'Toole
fc01e21e3b Remove unneeded err=nil check 2024-03-04 14:55:09 -05:00
Josh Soref
63344c291e Spelling (#1713)
Fix misspellings
2024-03-01 11:22:47 -05:00
Philip O'Toole
41c59589d5 Actually fix it 2024-02-06 10:01:05 -05:00
Philip O'Toole
fbc860bb35 Fix racy test 2024-02-06 09:58:16 -05:00
Philip O'Toole
2b3e829fc8 Ensure table is created before shutting down 2024-02-03 11:47:19 -05:00
Philip O'Toole
6e294e2a3b Fix racy auto upload tests
https://app.circleci.com/pipelines/github/rqlite/rqlite/4606/workflows/4c739576-dd59-404a-81e6-694245eae0e6/jobs/41881
2024-02-03 11:07:32 -05:00
Mauri de Souza Meneguzzo
69933cbe35 aws: reuse session and S3 manager
The AWS session and s3 manager are concurrent safe, it should be reused
whenever possible:

    Sessions are safe to use concurrently as long as the Session is not
    being modified. Sessions should be cached when possible, because
    creating a new Session will load all configuration values from the
    environment, and config files each time the Session is created.

See https://pkg.go.dev/github.com/aws/aws-sdk-go/aws/session

Currently, an aws session and s3 client/manager are created every time a
call to Upload, CurrentID or Download is made. I changed it so it creates
one session and S3 manager during app startup and reuse it afterwards.
2024-01-28 12:51:59 -03:00
Philip O'Toole
cfefc090b0 Remove use of deprecated ioutil 2024-01-16 18:41:58 -05:00
Philip O'Toole
76dfa7cdea Remove unneeded files 2024-01-13 17:48:41 -05:00
Philip O'Toole
078d0eacaf Better timeout handling 2024-01-13 17:19:15 -05:00
Philip O'Toole
f324e6b404 Move from sums to strings 2024-01-13 16:24:17 -05:00
Philip O'Toole
a005620db4 Refactor and enhance upload logging 2024-01-12 11:04:08 -05:00
Philip O'Toole
aa2cf2dd46 Configure Store Provider 2024-01-11 18:32:14 -05:00
Philip O'Toole
f9ac68387c More consistent use of uploader sums 2024-01-11 17:51:25 -05:00
Philip O'Toole
7472f6a949 Fix up tests 2024-01-11 00:10:50 -05:00
Philip O'Toole
5f1d98a0e2 Use Canonical Header keys for AWS metadata 2024-01-10 23:21:06 -05:00
Philip O'Toole
08080883a9 Various fixes -- test still failing though 2024-01-10 23:09:28 -05:00
Philip O'Toole
7c11295863 End-to-end test for skipped uploads due to sum 2024-01-10 23:02:35 -05:00
Philip O'Toole
22c42eed0a Bit more uploader unit test 2024-01-10 22:39:39 -05:00
Philip O'Toole
24bfc82230 Unit test checksum compare 2024-01-10 22:36:59 -05:00
Philip O'Toole
c8e29c2269 Simpler cloud sum check logic 2024-01-10 20:45:10 -05:00
Philip O'Toole
48a000dc92 Test Storage client defaults to "no sum error" 2024-01-10 19:28:34 -05:00
Philip O'Toole
f3c1109325 More comments 2024-01-10 19:06:05 -05:00
Philip O'Toole
0d81e6f438 Fetch sums from S3 and compare 2024-01-10 19:01:09 -05:00
Philip O'Toole
58fbe3ee81 Initial framework for setting sums 2024-01-10 18:39:48 -05:00
Philip O'Toole
602d2874ca Move to times 2024-01-08 22:42:06 -05:00
Philip O'Toole
b111a7bf98 Provide should also return last modified 2024-01-08 21:12:46 -05:00
Philip O'Toole
14858a37d4 Use last DB mod time in Provider 2024-01-07 12:40:01 -05:00
Philip O'Toole
2db982f8e8 Put sum check back in
This is best, until Provider is perfect.
2024-01-07 12:13:54 -05:00
Philip O'Toole
7dcfea235c Move to move efficient index-checking for upload 2024-01-07 10:35:57 -05:00