aboutsummaryrefslogtreecommitdiff
path: root/weed/command/upload.go
AgeCommit message (Collapse)AuthorFilesLines
2024-11-04merge current message queue code changes (#6201)Chris Lu1-2/+16
* listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory
2024-07-16Added loadSecurityConfigOnce (#5792)vadimartynov1-1/+1
2024-06-14Added context for the MasterClient's methods to avoid endless loops (#5628)vadimartynov1-2/+2
* Added context for the MasterClient's methods to avoid endless loops * Returned WithClient function. Added WithClientCustomGetMaster function * Hid unused ctx arguments * Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions * Changed the context termination check in the tryConnectToMaster function * Added a child context to the tryConnectToMaster function * Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
2022-08-23remove old raft servers if they don't answer to pings for too long (#3398)askeipx1-3/+4
* remove old raft servers if they don't answer to pings for too long add ping durations as options rename ping fields fix some todos get masters through masterclient raft remove server from leader use raft servers to ping them CheckMastersAlive for hashicorp raft only * prepare blocking ping * pass waitForReady as param * pass waitForReady through all functions * waitForReady works * refactor * remove unneeded params * rollback unneeded changes * fix
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu1-5/+5
2021-12-26use streaming mode for long poll grpc callschrislu1-1/+1
streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.
2021-09-12change server address from string to a typeChris Lu1-4/+4
2021-08-03typoChris Lu1-2/+2
2021-07-01go fmtChris Lu1-1/+1
2021-06-07Return correct exitcode when `wheed upload` failsDaniel Nagy1-2/+11
2021-04-01smaller file chunks are fasterChris Lu1-1/+1
2021-02-22disk type support custom tagsChris Lu1-1/+1
2021-02-17go fmtChris Lu1-2/+2
2021-02-17refactoring to get master function, instead of passing master values directlyChris Lu1-2/+2
this will enable retrying later
2021-02-14disk type only supports hdd and ssd, not ready for random tags yetChris Lu1-1/+1
2021-02-13adjust help messageChris Lu1-1/+1
2021-02-09Merge branch 'master' into support_ssd_volumeChris Lu1-0/+25
2021-01-02upload: add read default collection from masterChris Lu1-0/+25
fix https://github.com/chrislusf/seaweedfs/issues/1724#issuecomment-753576071
2020-12-16go fmtChris Lu1-1/+1
2020-12-13rename parameter name to "disk"Chris Lu1-1/+1
2020-12-13rename from volumeType to diskTypeChris Lu1-4/+4
2020-12-13adding volume typeChris Lu1-2/+4
2020-07-16resolve directories if containing home directoryChris Lu1-1/+1
2020-03-18weed upload: add usePublicUrl optionChris Lu1-14/+12
fix https://github.com/chrislusf/seaweedfs/issues/1236
2020-01-29support env variables to overwrite toml fileChris Lu1-4/+2
2019-06-05periodic scripts exeuction from leader masterChris Lu1-4/+5
2019-04-04default weed filer.copy and weed upload chunk size to 32MBChris Lu1-1/+1
2019-02-18adding grpc mutual tlsChris Lu1-2/+9
2019-02-09cleanup security.SecretChris Lu1-6/+2
2019-02-06fixing of typosSergey1-1/+1
2018-12-22adjust help messageChris Lu1-4/+0
2017-08-10fix typoChris Lu1-1/+1
fix https://github.com/chrislusf/seaweedfs/issues/549
2017-01-09suport uploading files to specific dataCentersparklxb1-2/+4
2017-01-04fix bug: upload big .gz file more than maxMBlixianbin1-1/+1
2016-07-20add "weed copy" command to copy files to filerChris Lu1-5/+5
2016-06-02directory structure change to work with glideChris Lu1-0/+108
glide has its own requirements. My previous workaround caused me some code checkin errors. Need to fix this.