seaweedfs/.git - Unnamed repository; edit this file 'description' to name the repository.

Age	Commit message (Collapse)	Author	Files	Lines
2025-07-16	convert error fromating to %w everywhere (#6995)	Chris Lu	2	-6/+6

2025-07-11	Admin UI: Add message queue to admin UI (#6958)	Chris Lu	3	-5/+170
	* add a menu item "Message Queue" * add a menu item "Message Queue" * move the "brokers" link under it. * add "topics", "subscribers". Add pages for them. * refactor * show topic details * admin display publisher and subscriber info * remove publisher and subscribers from the topic row pull down * collecting more stats from publishers and subscribers * fix layout * fix publisher name * add local listeners for mq broker and agent * render consumer group offsets * remove subscribers from left menu * topic with retention * support editing topic retention * show retention when listing topics * create bucket * Update s3_buckets_templ.go * embed the static assets into the binary fix https://github.com/seaweedfs/seaweedfs/issues/6964
2025-03-09	Accumulated changes for message queue (#6600)	Chris Lu	1	-2/+6
	* rename * set agent address * refactor * add agent sub * pub messages * grpc new client * can publish records via agent * send init message with session id * fmt * check cancelled request while waiting * use sessionId * handle possible nil stream * subscriber process messages * separate debug port * use atomic int64 * less logs * minor * skip io.EOF * rename * remove unused * use saved offsets * do not reuse session, since always session id is new after restart remove last active ts from SessionEntry * simplify printing * purge unused * just proxy the subscription, skipping the session step * adjust offset types * subscribe offset type and possible value * start after the known tsns * avoid wrongly set startPosition * move * remove * refactor * typo * fix * fix changed path
2025-01-20	Add message queue agent (#6463)	Chris Lu	3	-8/+10
	* scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent
2024-12-19	"golang.org/x/exp/slices" => "slices" and go fmt	chrislu	1	-1/+1

2024-11-04	merge current message queue code changes (#6201)	Chris Lu	5	-9/+58
	* listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory
2024-10-03	add helper functions	chrislu	1	-1/+12

2024-08-11	adds locking	chrislu	2	-4/+15

2024-08-10	refactor	chrislu	2	-4/+7

2024-05-20	Merge branch 'master' into mq	chrislu	1	-8/+8

2024-05-20	go fmt	chrislu	1	-8/+8

2024-05-19	persist consumer group offset	chrislu	2	-12/+13
	1. use one follower 2. read write consumer group offset
2024-05-17	rename	chrislu	1	-12/+12

2024-05-14	subscriber receives partitions and dispatch to processors	chrislu	1	-0/+10

2024-04-02	refactor	chrislu	1	-1/+1

2024-04-02	comment out println	chrislu	1	-4/+4

2024-04-01	send flush message to follower before shutting down logBuffer	chrislu	1	-1/+19

2024-04-01	renaming	chrislu	1	-5/+5

2024-03-31	purge old code	chrislu	1	-2/+0

2024-03-31	shutdown follower if no clients, not only publishers	chrislu	1	-3/+1
	to avoid overhead when a publisher repeatedly send one message and close
2024-03-31	add publisher name for debugging	chrislu	1	-1/+8

2024-03-30	simplify	chrislu	3	-17/+4

2024-03-30	logs	chrislu	1	-0/+1

2024-03-27	LocalPartition shutdown	chrislu	1	-18/+18

2024-03-27	simplify	chrislu	2	-17/+4

2024-03-27	change visibility	chrislu	1	-14/+14

2024-03-27	publish and send to follower	chrislu	1	-4/+21

2024-03-27	MaybeShutdownLocalPartition refactor	chrislu	1	-19/+19

2024-03-27	fix	chrislu	1	-1/+1

2024-03-27	refactor	chrislu	1	-0/+50

2024-03-27	refactor	chrislu	1	-0/+18

2024-03-27	separate goroutine to send ack to publisher	chrislu	1	-0/+1

2024-03-26	rename	chrislu	1	-2/+2

2024-03-24	setup follower by publisher	chrislu	1	-0/+4
	* the subscriber would getOrGen a local partition and wait * the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
2024-03-17	logging	chrislu	1	-0/+1

2024-03-16	notify	chrislu	1	-3/+16

2024-03-16	go fmt	chrislu	1	-7/+7

2024-03-15	add size()	chrislu	2	-0/+14

2024-03-10	ask follower to follow	chrislu	2	-6/+13

2024-03-07	change LogBuffer visibility in LocalPartition	chrislu	1	-9/+9

2024-02-29	go fmt	chrislu	2	-2/+3

2024-01-16	passing partition info	chrislu	1	-10/+2

2024-01-16	release local topic partition if no publisher and subscribers	chrislu	2	-0/+15

2024-01-15	reuse local partition	chrislu	1	-2/+2

2024-01-15	read from disk if not in memory	chrislu	1	-16/+38

2024-01-11	lint	chrislu	1	-1/+1

2024-01-10	passing partition generation timestamp	chrislu	1	-1/+1

2024-01-08	flush to disk	chrislu	1	-6/+5
	Need to do: read from disk
2024-01-08	add batch index for each memory buffer	chrislu	1	-2/+14

2023-12-28	subscriber can get assignments	chrislu	1	-0/+9