aboutsummaryrefslogtreecommitdiff
path: root/weed/filer
AgeCommit message (Collapse)AuthorFilesLines
2024-09-16improve worm support (#5983)Guang Jiong Lou1-2/+4
* improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>
2024-09-16fix invalid file read (#6024)Guang Jiong Lou1-0/+4
2024-09-14fix file read crash (#6021)Bruce2-2/+4
2024-09-13changing FindEntry error handling in cassandra store (#6015)Aleksey Kosov1-5/+3
2024-09-11Feature limit caching to prescribed number of bytes per file (#6009)Eugeniy E. Mikhailov3-2/+15
* feature: we can check if a fileId is already in the cache We using this to protect cache from adding the same needle to the cache over and over. * fuse mount: Do not start dowloader if needle is already in the cache * added maxFilePartSizeInCache property to ChunkCache If file very large only first maxFilePartSizeInCache bytes are going to be put to the cache (subject to the needle size constrains). * feature: for large files put in cache no more than prescribed number of bytes Before this patch only the first needle of a large file was intended for caching. This patch uses maximum prescribed amount of bytes to be put in cache. This allows to bypass default 2MB maximum for a file part stored in the cache. * added dummy mock methods to satisfy interfaces of ChunkCache
2024-09-10weed mount cachingchrislu1-2/+2
2024-09-10remove unusedchrislu1-2/+0
2024-09-10adjust loggingchrislu1-1/+1
2024-09-09bug fixed to filer store elastic deleteEntry (#5988)zouyixiong1-2/+10
2024-09-04Revert "weed mount, weed dav add option to force cache"chrislu2-6/+3
This reverts commit 7367b976b05bfa69158a60f205dec970c48f50f0.
2024-09-04weed mount, weed dav add option to force cachechrislu2-3/+6
2024-08-01rename functionschrislu1-1/+1
2024-08-01conditional deletechrislu1-1/+4
2024-07-26fix delete chunk failed if volumeSever specified grpc.port (#5820)wyang1-2/+4
Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-07-20get, set and add path confchrislu1-1/+19
2024-07-17refactoringchrislu2-45/+1
2024-07-16Added tls for http clients (#5766)vadimartynov4-7/+15
* Added global http client * Added Do func for global http client * Changed the code to use the global http client * Fix http client in volume uploader * Fixed pkg name * Fixed http util funcs * Fixed http client for bench_filer_upload * Fixed http client for stress_filer_upload * Fixed http client for filer_server_handlers_proxy * Fixed http client for command_fs_merge_volumes * Fixed http client for command_fs_merge_volumes and command_volume_fsck * Fixed http client for s3api_server * Added init global client for main funcs * Rename global_client to client * Changed: - fixed NewHttpClient; - added CheckIsHttpsClientEnabled func - updated security.toml in scaffold * Reduce the visibility of some functions in the util/http/client pkg * Added the loadSecurityConfig function * Use util.LoadSecurityConfiguration() in NewHttpClient func
2024-07-16Fix mmap write fail (#5791)wusong1-1/+4
* [mount] fix GetAttr blocks count Signed-off-by: wang wusong <wangwusong@virtaitech.com> * [mount] fix mmap read Signed-off-by: wang wusong <wangwusong@virtaitech.com> --------- Signed-off-by: wang wusong <wangwusong@virtaitech.com> Co-authored-by: wang wusong <wangwusong@virtaitech.com>
2024-07-11small refactoringchrislu1-2/+2
2024-07-11fix testchrislu1-3/+3
2024-07-11fix heap initchrislu1-8/+10
2024-07-11clean upchrislu1-3/+3
2024-07-11upgrade to github.com/redis/go-redis/v9chrislu25-31/+31
fix https://github.com/seaweedfs/seaweedfs/issues/4532
2024-07-11Squashed commit of the following:chrislu2-90/+372
commit 465b47b8f72668dfc12eaa72befb232513c9e1db Merge: f39272b54 9c440d472 Author: chrislu <chris.lu@gmail.com> Date: Wed Jul 10 23:56:51 2024 -0700 Merge branch 'master' into merged-persisted-logs commit f39272b5416bdd4d1714ce3e99aded0fe62e7d89 Author: chrislu <chris.lu@gmail.com> Date: Wed Jul 10 23:49:26 2024 -0700 merge meta logs from multiple files
2024-07-07skip checking if it is the root directorychrislu1-1/+1
2024-07-01avoid possible nil case during other error caseschrislu1-1/+1
2024-06-28ParallelProcessDirectoryStructurechrislu1-0/+38
need to use this for simpler parallel processing
2024-06-28bootstrap filer from one peerchrislu1-18/+6
2024-06-25optionally open the leveldb in readonly modechrislu2-5/+10
2024-06-25check bucket name in sql backendchrislu1-0/+6
fix https://github.com/seaweedfs/seaweedfs/issues/5710
2024-06-15optionally skip deleting file chunkschrislu2-4/+8
2024-06-15refactorchrislu1-1/+5
2024-06-15refactorchrislu1-0/+4
2024-06-14Added context for the MasterClient's methods to avoid endless loops (#5628)vadimartynov1-6/+6
* Added context for the MasterClient's methods to avoid endless loops * Returned WithClient function. Added WithClientCustomGetMaster function * Hid unused ctx arguments * Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions * Changed the context termination check in the tryConnectToMaster function * Added a child context to the tryConnectToMaster function * Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
2024-06-09simplifychrislu1-36/+7
2024-05-27chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ from 0.2.0 ↵dependabot[bot]1-1/+1
to 0.4.2 (#5621) * chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ Bumps [github.com/ydb-platform/ydb-go-sdk-auth-environ](https://github.com/ydb-platform/ydb-go-sdk-auth-environ) from 0.2.0 to 0.4.2. - [Changelog](https://github.com/ydb-platform/ydb-go-sdk-auth-environ/blob/master/CHANGELOG.md) - [Commits](https://github.com/ydb-platform/ydb-go-sdk-auth-environ/compare/v0.2.0...v0.4.2) --- updated-dependencies: - dependency-name: github.com/ydb-platform/ydb-go-sdk-auth-environ dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * fix compilation --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2024-05-18Feature/mongodb security (#5602)sb1-5/+6
2024-05-18add filer configuration options for username/password and tls (#5601)sb1-11/+60
2024-04-29Merge branch 'master' into mq-subscribechrislu3-24/+21
2024-04-29chore(deps): bump github.com/viant/ptrie from 0.3.1 to 1.0.1 (#5552)dependabot[bot]3-24/+21
* chore(deps): bump github.com/viant/ptrie from 0.3.1 to 1.0.1 Bumps [github.com/viant/ptrie](https://github.com/viant/ptrie) from 0.3.1 to 1.0.1. - [Release notes](https://github.com/viant/ptrie/releases) - [Changelog](https://github.com/viant/ptrie/blob/master/CHANGELOG.md) - [Commits](https://github.com/viant/ptrie/compare/v0.3.1...v1.0.1) --- updated-dependencies: - dependency-name: github.com/viant/ptrie dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * fix compilation --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2024-04-29Merge branch 'master' into mq-subscribechrislu1-2/+2
2024-04-26Move file deletion logging to v2 verbisity (#5538)Nikita Borzykh1-2/+2
2024-04-08Merge branch 'master' into mq-subscribechrislu3-9/+16
2024-04-08fix: filer authenticate with with volume server (#5480)Henco Appel2-8/+15
2024-04-02refactorchrislu2-2/+2
2024-03-30fix: adjust condition in prefixFilterEntries prevent infinite loop (#5440)Nikita Borzykh1-1/+1
2024-03-25print only adapted urlchrislu3-3/+3
fix https://github.com/seaweedfs/seaweedfs/issues/5424
2024-03-24Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta ↵Nikita Borzykh1-5/+5
storage backend (#5416) Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries
2024-03-24Add TLS support, initial etcd connection check, fix key_prefix handling for ↵Nikita Borzykh2-23/+51
etcd backend meta storage (#5403)
2024-03-15log errorschrislu1-0/+3
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-24 14:45:26 +0000