Yu Hong
Member
Dear all,
I have an orchestrator design that will need to queue the request (considering the orchestrator need to take latest 3 set of F0002 next numbering and perform setup via form requests). This orchestrator will consumes around 15 sec to complete the request.
However, as the 'request queue' getting longer, the request will vary and depends on the queue length. For example
If the queue is too long at the moment (e.g. 30 request are queuing), the client who call this API request will face timeout issue. In this case, what is the alternative 1) to queue the request and 2) prevent long response time until the request is perform in the queue?
or any other workarounds such as:
1) Add an layer of API to accept the request, insert into a customized 'queue' table, and run a scheduled batch program to perform the request on the table. Or
2) Advise client side to perform loop the request if the request timeout?
Thanks in advance!
I have an orchestrator design that will need to queue the request (considering the orchestrator need to take latest 3 set of F0002 next numbering and perform setup via form requests). This orchestrator will consumes around 15 sec to complete the request.
However, as the 'request queue' getting longer, the request will vary and depends on the queue length. For example
Queue No. | Response time |
1 | 15 sec |
2 | 30 sec |
3 | 45 sec |
4 | 60 sec |
5 | 1 min 15 sec |
If the queue is too long at the moment (e.g. 30 request are queuing), the client who call this API request will face timeout issue. In this case, what is the alternative 1) to queue the request and 2) prevent long response time until the request is perform in the queue?
or any other workarounds such as:
1) Add an layer of API to accept the request, insert into a customized 'queue' table, and run a scheduled batch program to perform the request on the table. Or
2) Advise client side to perform loop the request if the request timeout?
Thanks in advance!