aboutsummaryrefslogtreecommitdiff
path: root/weed/command
AgeCommit message (Collapse)AuthorFilesLines
2023-02-05adding support for B2 region (#4177)Muhammad Hallaj bin Subery1-0/+1
Co-authored-by: Muhammad Hallaj bin Subery <hallaj@tuta.io>
2023-01-20grpc connection to filer add sw-client-id headerchrislu9-14/+16
2023-01-15adjust help messagechrislu1-2/+2
2023-01-08add missing options for webdavchrislu2-0/+2
2023-01-03add mount log (#4101)zemul1-1/+2
* filer.backup use replication.source.filer * add mount log * Revert "filer.backup use replication.source.filer" This reverts commit 07bf6f956c67b19ceed0f62e7d01e8ef1fdf6454. * fix Co-authored-by: zemul <zhouzemiao@ihuman.com>
2023-01-02more solid weed mount (#4089)Chris Lu1-4/+4
* compare chunks by timestamp * fix slab clearing error * fix test compilation * move oldest chunk to sealed, instead of by fullness * lock on fh.entryViewCache * remove verbose logs * revert slat clearing * less logs * less logs * track write and read by timestamp * remove useless logic * add entry lock on file handle release * use mem chunk only, swap file chunk has problems * comment out code that maybe used later * add debug mode to compare data read and write * more efficient readResolvedChunks with linked list * small optimization * fix test compilation * minor fix on writer * add SeparateGarbageChunks * group chunks into sections * turn off debug mode * fix tests * fix tests * tmp enable swap file chunk * Revert "tmp enable swap file chunk" This reverts commit 985137ec472924e4815f258189f6ca9f2168a0a7. * simple refactoring * simple refactoring * do not re-use swap file chunk. Sealed chunks should not be re-used. * comment out debugging facilities * either mem chunk or swap file chunk is fine now * remove orderedMutex as *semaphore.Weighted not found impactful * optimize size calculation for changing large files * optimize performance to avoid going through the long list of chunks * still problems with swap file chunk * rename * tiny optimization * swap file chunk save only successfully read data * fix * enable both mem and swap file chunk * resolve chunks with range * rename * fix chunk interval list * also change file handle chunk group when adding chunks * pick in-active chunk with time-decayed counter * fix compilation * avoid nil with empty fh.entry * refactoring * rename * rename * refactor visible intervals to *list.List * refactor chunkViews to *list.List * add IntervalList for generic interval list * change visible interval to use IntervalList in generics * cahnge chunkViews to *IntervalList[*ChunkView] * use NewFileChunkSection to create * rename variables * refactor * fix renaming leftover * renaming * renaming * add insert interval * interval list adds lock * incrementally add chunks to readers Fixes: 1. set start and stop offset for the value object 2. clone the value object 3. use pointer instead of copy-by-value when passing to interval.Value 4. use insert interval since adding chunk could be out of order * fix tests compilation * fix tests compilation
2023-01-01filer.store.mysql: Use utf8mb4 instead of 3 byte UTF8 (#4094)CommanderRoot1-13/+13
2023-01-01filer.store.mysql: Replace deprecated upsert syntax (#4096)CommanderRoot1-2/+2
2022-12-19Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-1/+4
2022-12-17add -filer.path to webdav command (#4061)lfhy1-1/+4
2022-12-17more detailed logschrislu1-3/+15
2022-11-24[metrics] Add the ability to control bind ip (#4012)Jiffs Maverick6-6/+8
2022-11-15refactor filer_pb.Entry and filer.Entry to use GetChunks()chrislu1-1/+1
for later locking on reading chunks
2022-11-14Lazy loading (#3958)Guo Lei4-3/+8
* types packages is imported more than onece * lazy-loading * fix bugs * fix bugs * fix unit tests * fix test error * rename function * unload ldb after initial startup * Don't load ldb when starting volume server if ldbtimeout is set. * remove uncessary unloadldb * Update weed/command/server.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * Update weed/command/volume.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: guol-fnst <goul-fnst@fujitsu.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-04[filer.backup] add retention_duration (#3941)zemul1-0/+15
2022-10-28[fix] add param for ignore error (#3918)Konstantin Lebedev1-2/+13
2022-10-23remove volume server tcp clientchrislu1-24/+1
2022-10-12default hasSlowRead to truechrislu1-1/+1
2022-10-12volume server:set the default value of "hasSlowRead" to true (#3710)famosss1-1/+1
* simplify a bit * feat: volume: add "readBufSize" option to customize read optimization * refactor : redbufSIze -> readBufferSize * simplify a bit * simplify a bit * volume server:set the default value of "hasSlowRead" to true
2022-10-12master fix interruption through ctrl+c (#3834)Konstantin Lebedev1-1/+1
2022-10-08Fix `mount -t weed` with extra options (#3807)BakerBunker1-1/+4
fuse: Ignore "-o" command
2022-10-06master server graceful stop (#3797)Konstantin Lebedev1-0/+8
2022-10-01fix delete key panic of remote sync dir (#3770)Konstantin Lebedev1-4/+9
2022-09-30better fix for option formatchrislu1-1/+5
2022-09-30mount: fix extra option formatchrislu1-1/+1
2022-09-30mount: accept all extra mount optionschrislu3-1/+4
fix https://github.com/seaweedfs/seaweedfs/issues/3767
2022-09-28[volume] Add new volumes to HUP(reload) signal (#3755)Konstantin Lebedev1-0/+2
Add new volumes to HUP(reload) signal
2022-09-27fix set master options for single server (#3708)Konstantin Lebedev1-4/+5
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-09-17volume server: rename readBufferSize to readBufferSizeMBchrislu2-4/+4
2022-09-16volume: add "readBufSize" option to customize read optimization (#3702)famosss2-0/+4
* simplify a bit * feat: volume: add "readBufSize" option to customize read optimization * refactor : redbufSIze -> readBufferSize * simplify a bit * simplify a bit
2022-09-15mark "hasSlowRead" as experimentalchrislu2-2/+2
2022-09-15Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu3-3/+3
2022-09-15volume: add "hasSlowRead" option to customize read optimizationchrislu2-0/+4
2022-09-15docs(command): readability fixes (#3686)Ryan Russell3-3/+3
Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14go fmtchrislu4-16/+16
2022-09-14refactor(various): `Listner` -> `Listener` readability improvements (#3672)Ryan Russell4-14/+14
* refactor(net_timeout): `listner` -> `listener` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(s3): `s3ApiLocalListner` -> `s3ApiLocalListener` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(filer): `localPublicListner` -> `localPublicListener` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(command): `masterLocalListner` -> `masterLocalListener` Signed-off-by: Ryan Russell <git@ryanrussell.org> * refactor(net_timeout): `ipListner` -> `ipListener` Signed-off-by: Ryan Russell <git@ryanrussell.org> Signed-off-by: Ryan Russell <git@ryanrussell.org>
2022-09-14refactor(socket mount): Update socket mount pattern to `/tmp/seaweedf… (#3662)Ryan Russell2-2/+2
2022-09-14docs: `orignial` -> `original` (#3661)Ryan Russell1-2/+2
2022-09-14fix 'localFilerSocket' nil pointer (#3654)LHHDZ1-0/+1
2022-09-14refactor: `DefaultConcurrencyLimit` var rename (#3658)Ryan Russell1-4/+4
2022-09-14refactor: `concurrentFiles` and `concurrentChunks` var name fix (#3655)Ryan Russell1-7/+7
2022-09-11refactorchrislu2-5/+10
2022-09-10simplify a bitchrislu2-5/+4
2022-09-10[sync] override amz storage class, None to delete (#3639)Konstantin Lebedev3-1/+9
* override amz storage class, None to delete https://github.com/seaweedfs/seaweedfs/issues/3636 * use empty string to delete * without nil check
2022-09-09skip directories under ".uploads" directorychrislu1-1/+7
related to https://github.com/seaweedfs/seaweedfs/issues/3636 skipping all directories under ".uploads" directory.
2022-09-08purge tcp implementationchrislu2-27/+0
2022-09-06avoid SIGSEGV on localFilerSocket (#3609)Konstantin Lebedev1-2/+5
https://github.com/seaweedfs/seaweedfs/issues/3607
2022-09-02new 'concurrency' parameter for filer.sync (#3579)bernardx1-6/+16
Co-authored-by: XIAOYQ <xiaoyq@eudic.net>
2022-09-01avoid DATA RACE on S3Options.localFilerSocket (#3571)Konstantin Lebedev2-7/+8
* avoid DATA RACE on S3Options.localFilerSocket https://github.com/seaweedfs/seaweedfs/issues/3552 * copy localSocket
2022-08-31add more logschrislu2-1/+5