Limitations in async queries

[omelhus]

Hey,

I'm banging my head against some limitations with the async queries.

You can only execute a maximum of 10 asynchronous query at a time and you can only start a new one 5 seconds after the previous one has been started. (Note: These numbers may be subject to change.)

Say I need to import an ungodly amount of lines, I'm hitting the max upload size. When I try to split the file into parts and use background jobs I have to wait 5 s between requests for each part of the file? And I can enqueue a max of 10 jobs? What is the rationale behind these limitations?