zeripath and guillep2k
e83daf77ad
Avoid logging []byte in queue failures - convert to string first ( #10865 )
...
Signed-off-by: Andrew Thornton <art27@cantab.net >
Co-authored-by: guillep2k <18600385+guillep2k@users.noreply.github.com >
2020-03-29 15:12:15 +08:00
Lunny Xiao
cf7ece6245
Fix queue log param ( #10733 )
2020-03-16 16:59:21 +08:00
zeripath
88986746d5
Fix Workerpool deadlock ( #10283 )
...
* Prevent deadlock on boost
* Force a boost in testchannelqueue
2020-02-15 18:44:58 +00:00
Lunny Xiao
3d69bbd58f
Fix queue pop error and stat empty repository error ( #10248 )
...
* Fix queue pop error and stat empty repository error
* Fix error
2020-02-12 18:12:27 +08:00
zeripath
2c903383b5
Add Unique Queue infrastructure and move TestPullRequests to this ( #9856 )
...
* Upgrade levelqueue to version 0.2.0
This adds functionality for Unique Queues
* Add UniqueQueue interface and functions to create them
* Add UniqueQueue implementations
* Move TestPullRequests over to use UniqueQueue
* Reduce code duplication
* Add bytefifos
* Ensure invalid types are logged
* Fix close race in PersistableChannelQueue Shutdown
2020-02-02 23:19:58 +00:00
zeripath and Lauris BH
9b9dd19d7d
Fix broken FlushAll ( #10101 )
...
* go function contexting is not what you expect
* Apply suggestions from code review
Co-Authored-By: Lauris BH <lauris@nix.lv >
Co-authored-by: Lauris BH <lauris@nix.lv >
2020-02-01 23:43:50 +00:00
eac5142ac7
Fix leveldb test race ( #10054 )
...
Co-authored-by: Lauris BH <lauris@nix.lv >
Co-authored-by: techknowlogick <techknowlogick@gitea.io >
2020-01-30 11:09:39 -05:00
zeripath and Lauris BH
c01221e70f
Queue: Make WorkerPools and Queues flushable ( #10001 )
...
* Make WorkerPools and Queues flushable
Adds Flush methods to Queues and the WorkerPool
Further abstracts the WorkerPool
Adds a final step to Flush the queues in the defer from PrintCurrentTest
Fixes an issue with Settings inheritance in queues
Signed-off-by: Andrew Thornton <art27@cantab.net >
* Change to for loop
* Add IsEmpty and begin just making the queues composed WorkerPools
* subsume workerpool into the queues and create a flushable interface
* Add manager command
* Move flushall to queue.Manager and add to testlogger
* As per @guillep2k
* as per @guillep2k
* Just make queues all implement flushable and clean up the wrapped queue flushes
* cope with no timeout
Co-authored-by: Lauris BH <lauris@nix.lv >
2020-01-28 20:01:06 -05:00
zeripath and Lunny Xiao
8cb9b2f016
Update queue_redis.go ( #9910 )
...
Co-authored-by: Lunny Xiao <xiaolunwen@gmail.com >
2020-01-21 12:50:27 +00:00
zeripath
960ac36099
Remove unused lock ( #9709 )
2020-01-11 19:06:35 +00:00
zeripath
edd31770aa
Missed q.lock.Unlock() will cause panic ( #9705 )
2020-01-11 17:05:07 +00:00
62eb1b0f25
Graceful Queues: Issue Indexing and Tasks ( #9363 )
...
* Queue: Add generic graceful queues with settings
* Queue & Setting: Add worker pool implementation
* Queue: Add worker settings
* Queue: Make resizing worker pools
* Queue: Add name variable to queues
* Queue: Add monitoring
* Queue: Improve logging
* Issues: Gracefulise the issues indexer
Remove the old now unused specific queues
* Task: Move to generic queue and gracefulise
* Issues: Standardise the issues indexer queue settings
* Fix test
* Queue: Allow Redis to connect to unix
* Prevent deadlock during early shutdown of issue indexer
* Add MaxWorker settings to queues
* Merge branch 'master' into graceful-queues
* Update modules/indexer/issues/indexer.go
Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com >
* Update modules/indexer/issues/indexer.go
Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com >
* Update modules/queue/queue_channel.go
Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com >
* Update modules/queue/queue_disk.go
* Update modules/queue/queue_disk_channel.go
Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com >
* Rename queue.Description to queue.ManagedQueue as per @guillep2k
* Cancel pool workers when removed
* Remove dependency on queue from setting
* Update modules/queue/queue_redis.go
Co-Authored-By: guillep2k <18600385+guillep2k@users.noreply.github.com >
* As per @guillep2k add mutex locks on shutdown/terminate
* move unlocking out of setInternal
* Add warning if number of workers < 0
* Small changes as per @guillep2k
* No redis host specified not found
* Clean up documentation for queues
* Update docs/content/doc/advanced/config-cheat-sheet.en-us.md
* Update modules/indexer/issues/indexer_test.go
* Ensure that persistable channel queue is added to manager
* Rename QUEUE_NAME REDIS_QUEUE_NAME
* Revert "Rename QUEUE_NAME REDIS_QUEUE_NAME"
This reverts commit 1f83b4fc9b9dabda186257b38c265fe7012f90df.
Co-authored-by: guillep2k <18600385+guillep2k@users.noreply.github.com >
Co-authored-by: Lauris BH <lauris@nix.lv >
Co-authored-by: techknowlogick <matti@mdranta.net >
Co-authored-by: Lunny Xiao <xiaolunwen@gmail.com >
2020-01-07 12:23:09 +01:00
zeripathandguillep2k
Lunny Xiao
