aboutsummaryrefslogtreecommitdiff
path: root/weed/command
AgeCommit message (Collapse)AuthorFilesLines
2023-11-20weed/command: fix dropped errorLars Lehtonen1-0/+3
2023-11-17fix: add doDeleteFile option for filer backupKonstantin Lebedev2-10/+14
2023-11-13fix: excludeFileName is emptyKonstantin Lebedev1-3/+6
2023-11-13filer backup add option for exclude file names that match the regexp to sync ↵Konstantin Lebedev2-3/+14
on filer
2023-11-01Pass correct Filer's gRPC port to S3 server. (#4972)tired-engineer1-1/+1
Fixes seaweedfs/seaweedfs#4971
2023-10-13Add optional flags to enable mTLS with verification of client certificate ↵James Hedley2-1/+29
(#4910)
2023-10-12 fix: disallow file name too long when writing a file (#4881)Konstantin Lebedev1-0/+1
* fix: disallow file name too long when writing a file * bool LongerName to MaxFilenameLength --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-09 fix: skipping checking active volumes with the same number of files at the ↵Konstantin Lebedev1-1/+2
moment (#4893) * fix: skipping checking active volumes with the same number of files at the moment https://github.com/seaweedfs/seaweedfs/issues/4140 * refactor with comments https://github.com/seaweedfs/seaweedfs/issues/4140 * add TestShouldSkipVolume --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-01RetryForever => RetryUntilchrislu2-2/+2
2023-09-27fix: avoid error file name too long when writing a file (#4876)Konstantin Lebedev1-1/+1
2023-09-25Revert "Revert "Merge branch 'master' of ↵chrislu1-2/+2
https://github.com/seaweedfs/seaweedfs"" This reverts commit 8cb42c39
2023-09-18Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"chrislu1-2/+2
This reverts commit 2e5aa06026750c99ea283181974d2ccfe5eb0468, reversing changes made to 4d414f54a224142f3f4d934f4af3b5dceb6fec6b.
2023-09-18Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 (#4850)dependabot[bot]1-2/+2
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.63.1 to 1.64.0. - [Release notes](https://github.com/rclone/rclone/releases) - [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md) - [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0) --- updated-dependencies: - dependency-name: github.com/rclone/rclone dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * API changes * go mod --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2023-08-24Implement SRV lookups for filer (#4767)Nico D'Cotta3-6/+6
2023-08-16renamingchrislu3-12/+12
2023-08-16add separate cache directory for write bufferschrislu3-0/+5
2023-08-13Update weed fix description (#4745)SmsS41-3/+3
2023-07-11Fix the segfault from not setting s3 https port (#4667)Henco Appel1-0/+1
2023-07-07mount: create mount root on filerchrislu1-0/+8
fix https://github.com/seaweedfs/seaweedfs-csi-driver/issues/127
2023-06-26Unix Socket listener for S3 server (#4621)Amir H. Yeganemehr3-2/+28
Add localSocket option to s3 server
2023-06-14avoid data race read volume.IsEmpty (#4574)柏杰1-1/+1
* avoid data race read volume.IsEmpty - avoid phantom read isEmpty for onlyEmpty - use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope * add Destroy(onlyEmpty: true) test * add Destroy(onlyEmpty: false) test * remove unused `IsEmpty()` * change literal `8` to `SuperBlockSize`
2023-06-13optional https port for s3 (#4482)Konstantin Lebedev2-7/+29
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-06-04S3 TLS credentials Refreshing (#4506)Konstantin Lebedev1-2/+21
* S3 TLS credentials Refreshing * fix: logging --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-05-29adjust error messagechrislu1-0/+3
2023-05-18Feat: etcd filer store keys should have customizable prefix (#4484)Mesar Hameed1-0/+1
An etcd cluster is not necessarily only dedicated to seaweedfs. This security enhancement adds a customizable key_prefix option to the etcd filer store. This will allow an etcd cluster administrator to limit the seaweedfs etcd user to only read/write a subset of keys under the key_prefix, instead of all keys on the etcd cluster.
2023-05-16Use filerGroup for s3 buckets collection prefix (#4465)SmsS41-0/+3
* Use filerGroup for s3 buckets collection prefix * Fix templates * Remove flags * Remove s3CollectionPrefix
2023-05-15Feat: support username/password authentication for etcd filer store s… (#4477)Mesar Hameed1-0/+2
Feat: support username/password authentication for etcd filer store seaweedfs/seaweedfs#4262 Co-authored-by: Mesar Hameed <mesar.hameed@gmail.com>
2023-04-04use UPSERT for postgres style databaseschrislu1-3/+3
2023-03-25weed mount default EnableACL,Support chmod chown (#4335)renweijun1-1/+1
2023-03-21refactoringchrislu6-18/+94
2023-03-15Fix -raftHashicorp and -raftBootstrap flag propagation. (#4309)Stewart Miles2-6/+8
`weed server` was not correctly propagating `-master.raftHashicorp` and `-master.raftBootstrap` flags when starting the master server. Related to #4307
2023-02-25add -disk to filer command (#4247)lfhy2-0/+12
* add -disk to filer command * add diskType to filer.grpc * use filer.disk when filerWebDavOptions.disk is empty * add filer.disk to weed server command. --------- Co-authored-by: 三千院羽 <3000y@MacBook-Pro.lan>
2023-02-21Updated the deprecated ioutil dependency (#4239)Zachary Walters1-4/+3
2023-02-05adding support for B2 region (#4177)Muhammad Hallaj bin Subery1-0/+1
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2023-01-20grpc connection to filer add sw-client-id headerchrislu9-14/+16
2023-01-15adjust help messagechrislu1-2/+2
2023-01-08add missing options for webdavchrislu2-0/+2
2023-01-03add mount log (#4101)zemul1-1/+2
* filer.backup use replication.source.filer * add mount log * Revert "filer.backup use replication.source.filer" This reverts commit 07bf6f956c67b19ceed0f62e7d01e8ef1fdf6454. * fix Co-authored-by: zemul <zhouzemiao@ihuman.com>
2023-01-02more solid weed mount (#4089)Chris Lu1-4/+4
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2023-01-01filer.store.mysql: Use utf8mb4 instead of 3 byte UTF8 (#4094)CommanderRoot1-13/+13
2023-01-01filer.store.mysql: Replace deprecated upsert syntax (#4096)CommanderRoot1-2/+2
2022-12-19Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-1/+4
2022-12-17add -filer.path to webdav command (#4061)lfhy1-1/+4
2022-12-17more detailed logschrislu1-3/+15
2022-11-24[metrics] Add the ability to control bind ip (#4012)Jiffs Maverick6-6/+8
2022-11-15refactor filer_pb.Entry and filer.Entry to use GetChunks()chrislu1-1/+1
for later locking on reading chunks
2022-11-14Lazy loading (#3958)Guo Lei4-3/+8
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-04[filer.backup] add retention_duration (#3941)zemul1-0/+15
2022-10-28[fix] add param for ignore error (#3918)Konstantin Lebedev1-2/+13
2022-10-23remove volume server tcp clientchrislu1-24/+1