Implement throttling for queue processing

ideas
1

We’d like to have an option to specify that the work queue should process “one entry per minute”.

3

New tab on the work queue screen called Throttling

These new fileds from the WorkQueue entity will be edited here:

  • EnableThrottling
    not nullable, default false

  • ThrottlingIntervalSeconds
    not nullable, default 60

  • ThrottlingItemsPerInterval
    not nullable, default 10

Failed attempts will also count to the throttling limit.

Throttling attempts will be recorded in a separate entity WorkQueueState with fields:

  • refWorkQueueId
    not nullable

  • ThrottlingIntervalStart (Date)
    not nullable, default minDate

  • ThrottlingItemsProcessed
    not nullable, default 0

4

Sort WorkQueues by “Code”

5

Throttling interval 5 minutes, 100 items.
=> Process 100 items as fast as possible in 5 minutes. If they are done in the first second, wait for the rest of the interval… There will be no artificial waiting between the item processing

6

I think use case with pause after each item processed should be an option. We are using an 3rd party API, where we can post request once per 10 seconds. Now we are using wait task to achieve this. It would be great , if this could be configured in WQ itself.

8

@washi do you have any objections to making all the new fields non-nullable

9
10
14

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.