aboutsummaryrefslogtreecommitdiff
path: root/weed/command
AgeCommit message (Collapse)AuthorFilesLines
2023-09-25Revert "Revert "Merge branch 'master' of ↵chrislu1-2/+2
https://github.com/seaweedfs/seaweedfs"" This reverts commit 8cb42c39
2023-09-18Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"chrislu1-2/+2
This reverts commit 2e5aa06026750c99ea283181974d2ccfe5eb0468, reversing changes made to 4d414f54a224142f3f4d934f4af3b5dceb6fec6b.
2023-09-18Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 (#4850)dependabot[bot]1-2/+2
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.63.1 to 1.64.0. - [Release notes](https://github.com/rclone/rclone/releases) - [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md) - [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0) --- updated-dependencies: - dependency-name: github.com/rclone/rclone dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * API changes * go mod --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2023-08-24Implement SRV lookups for filer (#4767)Nico D'Cotta3-6/+6
2023-08-16renamingchrislu3-12/+12
2023-08-16add separate cache directory for write bufferschrislu3-0/+5
2023-08-13Update weed fix description (#4745)SmsS41-3/+3
2023-07-11Fix the segfault from not setting s3 https port (#4667)Henco Appel1-0/+1
2023-07-07mount: create mount root on filerchrislu1-0/+8
fix https://github.com/seaweedfs/seaweedfs-csi-driver/issues/127
2023-06-26Unix Socket listener for S3 server (#4621)Amir H. Yeganemehr3-2/+28
Add localSocket option to s3 server
2023-06-14avoid data race read volume.IsEmpty (#4574)柏杰1-1/+1
* avoid data race read volume.IsEmpty - avoid phantom read isEmpty for onlyEmpty - use `v.DataBackend.GetStat()` in v.dataFileAccessLock scope * add Destroy(onlyEmpty: true) test * add Destroy(onlyEmpty: false) test * remove unused `IsEmpty()` * change literal `8` to `SuperBlockSize`
2023-06-13optional https port for s3 (#4482)Konstantin Lebedev2-7/+29
Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-06-04S3 TLS credentials Refreshing (#4506)Konstantin Lebedev1-2/+21
* S3 TLS credentials Refreshing * fix: logging --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-05-29adjust error messagechrislu1-0/+3
2023-05-18Feat: etcd filer store keys should have customizable prefix (#4484)Mesar Hameed1-0/+1
An etcd cluster is not necessarily only dedicated to seaweedfs. This security enhancement adds a customizable key_prefix option to the etcd filer store. This will allow an etcd cluster administrator to limit the seaweedfs etcd user to only read/write a subset of keys under the key_prefix, instead of all keys on the etcd cluster.
2023-05-16Use filerGroup for s3 buckets collection prefix (#4465)SmsS41-0/+3
* Use filerGroup for s3 buckets collection prefix * Fix templates * Remove flags * Remove s3CollectionPrefix
2023-05-15Feat: support username/password authentication for etcd filer store s… (#4477)Mesar Hameed1-0/+2
Feat: support username/password authentication for etcd filer store seaweedfs/seaweedfs#4262 Co-authored-by: Mesar Hameed <mesar.hameed@gmail.com>
2023-04-04use UPSERT for postgres style databaseschrislu1-3/+3
2023-03-25weed mount default EnableACL,Support chmod chown (#4335)renweijun1-1/+1
2023-03-21refactoringchrislu6-18/+94
2023-03-15Fix -raftHashicorp and -raftBootstrap flag propagation. (#4309)Stewart Miles2-6/+8
`weed server` was not correctly propagating `-master.raftHashicorp` and `-master.raftBootstrap` flags when starting the master server. Related to #4307
2023-02-25add -disk to filer command (#4247)lfhy2-0/+12
* add -disk to filer command * add diskType to filer.grpc * use filer.disk when filerWebDavOptions.disk is empty * add filer.disk to weed server command. --------- Co-authored-by: 三千院羽 <3000y@MacBook-Pro.lan>
2023-02-21Updated the deprecated ioutil dependency (#4239)Zachary Walters1-4/+3
2023-02-05adding support for B2 region (#4177)Muhammad Hallaj bin Subery1-0/+1
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2023-01-20grpc connection to filer add sw-client-id headerchrislu9-14/+16
2023-01-15adjust help messagechrislu1-2/+2
2023-01-08add missing options for webdavchrislu2-0/+2
2023-01-03add mount log (#4101)zemul1-1/+2
* filer.backup use replication.source.filer * add mount log * Revert "filer.backup use replication.source.filer" This reverts commit 07bf6f956c67b19ceed0f62e7d01e8ef1fdf6454. * fix Co-authored-by: zemul <zhouzemiao@ihuman.com>
2023-01-02more solid weed mount (#4089)Chris Lu1-4/+4
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2023-01-01filer.store.mysql: Use utf8mb4 instead of 3 byte UTF8 (#4094)CommanderRoot1-13/+13
2023-01-01filer.store.mysql: Replace deprecated upsert syntax (#4096)CommanderRoot1-2/+2
2022-12-19Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-1/+4
2022-12-17add -filer.path to webdav command (#4061)lfhy1-1/+4
2022-12-17more detailed logschrislu1-3/+15
2022-11-24[metrics] Add the ability to control bind ip (#4012)Jiffs Maverick6-6/+8
2022-11-15refactor filer_pb.Entry and filer.Entry to use GetChunks()chrislu1-1/+1
for later locking on reading chunks
2022-11-14Lazy loading (#3958)Guo Lei4-3/+8
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-04[filer.backup] add retention_duration (#3941)zemul1-0/+15
2022-10-28[fix] add param for ignore error (#3918)Konstantin Lebedev1-2/+13
2022-10-23remove volume server tcp clientchrislu1-24/+1
2022-10-12default hasSlowRead to truechrislu1-1/+1
2022-10-12volume server:set the default value of "hasSlowRead" to true (#3710)famosss1-1/+1
* simplify a bit * feat: volume: add "readBufSize" option to customize read optimization * refactor : redbufSIze -> readBufferSize * simplify a bit * simplify a bit * volume server:set the default value of "hasSlowRead" to true
2022-10-12master fix interruption through ctrl+c (#3834)Konstantin Lebedev1-1/+1
2022-10-08Fix `mount -t weed` with extra options (#3807)BakerBunker1-1/+4
fuse: Ignore "-o" command
2022-10-06master server graceful stop (#3797)Konstantin Lebedev1-0/+8
2022-10-01fix delete key panic of remote sync dir (#3770)Konstantin Lebedev1-4/+9
2022-09-30better fix for option formatchrislu1-1/+5
2022-09-30mount: fix extra option formatchrislu1-1/+1
2022-09-30mount: accept all extra mount optionschrislu3-1/+4
fix https://github.com/seaweedfs/seaweedfs/issues/3767
2022-09-28[volume] Add new volumes to HUP(reload) signal (#3755)Konstantin Lebedev1-0/+2
Add new volumes to HUP(reload) signal