Page 1 of 1

batchprocessor solution

PostPosted: Tue Feb 13, 2018 11:47 am
by Harjo
Does someone know, where I can find this demo (batchprocessor) solution used in this presentation?
I have searched everywhere, but I can't find it.

https://www.yumpu.com/en/document/view/ ... all-servoy

Re: batchprocessor solution

PostPosted: Tue Feb 13, 2018 2:10 pm
by mboegem
No, sorry... that seems to be pretty old according to the admin page logo. :-)

I notice this is using cronjob to schedule functions.
Have had trouble with this in the past as certain cronjob could run long time, conflicting with other schedules.

Moved away from that and now simply schedule a single job every x minutes, checking a table with jobs and its due date/time, then just invoke the function of every job that is past its due date/time.
That way you'll trigger every job sequentially, avoiding any conflicts.

Should not take much time to set this up.
Ping me if you're interested, you've got my details ;-)

Re: batchprocessor solution

PostPosted: Tue Feb 13, 2018 3:20 pm
by Harjo
I'm interested! :D

Re: batchprocessor solution

PostPosted: Tue Feb 13, 2018 5:16 pm
by patrick
I have created something similar a while ago, called svyJobManager. It has quite some API to execute adhoc jobs, features headless client "pooling" (assign a number of clients that can run simultaneously), can monitor job execution etc. It uses tables though. I guess I could send that to you when interested.

Re: batchprocessor solution

PostPosted: Tue Feb 13, 2018 7:18 pm
by grahamg
+1 please guys. I've always found BatchProcessors a black-art and am pleasantly surprised when they run as intended -:)

Re: batchprocessor solution

PostPosted: Wed Feb 14, 2018 3:49 pm
by rafig
patrick wrote:I have created something similar a while ago, called svyJobManager. It has quite some API to execute adhoc jobs, features headless client "pooling" (assign a number of clients that can run simultaneously), can monitor job execution etc. It uses tables though. I guess I could send that to you when interested.

+1 for svyJobManager please Patrick

Re: batchprocessor solution

PostPosted: Wed Feb 14, 2018 6:00 pm
by steve1376656734
Also +1 please Patrick.

Many thanks
Steve

Re: batchprocessor solution

PostPosted: Thu Feb 15, 2018 12:53 pm
by Harjo
patrick wrote:I have created something similar a while ago, called svyJobManager. It has quite some API to execute adhoc jobs, features headless client "pooling" (assign a number of clients that can run simultaneously), can monitor job execution etc. It uses tables though. I guess I could send that to you when interested.


Maybe release it as an example project on the Servoy GitHub?

Re: batchprocessor solution

PostPosted: Thu Feb 15, 2018 1:00 pm
by steve1376656734
Or even as a downloadable package on the Servoy Package manager?

Re: batchprocessor solution

PostPosted: Tue Jun 15, 2021 4:22 pm
by Harjo
patrick wrote:I have created something similar a while ago, called svyJobManager. It has quite some API to execute adhoc jobs, features headless client "pooling" (assign a number of clients that can run simultaneously), can monitor job execution etc. It uses tables though. I guess I could send that to you when interested.


Hi patrick, did you ever released that svyJobManager ??

Re: batchprocessor solution

PostPosted: Tue Jun 15, 2021 5:36 pm
by sean
Hi Harjo,

We are probably not going to pursue Job Manager module as a supported extension. Instead we are working to deliver an iPaaS solution for Servoy, which could handle that requirement and more. It's still in the labs, but we hope to announce something later this year.

Can you tell us more about your batch automation requirements?