Headless Client Licensing

If you have an unlimited web client license, does that also give you unlimited headless client licenses? (since they both run server side). Or does the headless client licenses come out of the standard Smart/Web Full client licenses? Doing some tests here, and it seems like they come out of the full client license instead of the web. That makes things a bit difficult given that if you have a unlimited web client license, you can’t use any batch processors, headless client plugin, or JSP pages…

Update: So it seems as though the clients pull from the wrong “pool”/license key. Here is my setup in (Servoy 5.2.7)

1: Unlimited Web License
15: Full/Regular licenses

I have 20 total clients connected. 16 are Web Clients. 4 are Headless Clients.

  • If I try to launch a Smart Client I get the the error dialog “No licenses or trial licenses left. Exiting.”
  • If I try to launch a Headless Client, I receive an error: org.apache.jasper.JasperException: javax.servlet.ServletException: com.servoy.j2db.ApplicationException: No more licenses available
  • If I try to launch a Web Client, it works fine

So, this shows 2 things:

  1. The web clients seem to first take “seats” from the regular license pool instead of the unlimited pool. Once consumed regular licenses, then it uses web client licenses
  2. The Headless Clients only use a full/regular license (which seems like it shouldn’t)

Should I make a case for this?

Scott,

This has just been fixed (for 5.2.9).
When you have an unlimited web license and some regular licences, the registered web clients do not count for the regular license (all non-web-clients).
So you can have the other headless, batch or smart client, regardless of how many web clients are registered.

Headless client does not count as a web client and uses the regular licence set.

Rob

goldcougar:
If you have an unlimited web client license, does that also give you unlimited headless client licenses? (since they both run server side).

It certainly should and would make the unlimited web client license a far more interesting proposition. Effectively this would then put Servoy right into the frame for handing all site data even on sites that do not use the web-client specifically. Worrying about out of license messages in the middle of a public facing web site is not a top choice, neither is webclient the most appropriate choice every time - but a combination is certainly very attractive.

Ideally Servoy (the product) should choose the best worst license when loading:

  • Standard smart client license does everything (headless,smart and web)
  • webclient license only does web and headless
  • headless only does headless connections

The connection should then pre determine which license to request based on the lowest that will satisfy the requirement. Perhaps there could be a parameter that allows the developer to force the solution to use one type of license or another.

I currently have a very typical project where they will need 10-15 smart clients and the very occasional use of the web client. I have another that would be 99% headless client with a single user admin on the smart client, Servoy did not get considered for this due to licensing. From my perspective having an unlimited web/headless client with 15-20 smart client licenses would be a very workable solution. Added to this it would be a lot easier to sell Servoy in general if you could largely fix the costs to the end user - they dont like “if you go over X visitors to your site the cost will be Y but until you do its Z”

HTH
Gordon

rgansevles:
This has just been fixed (for 5.2.9).

Thanks Rob, any guesstimates on the arrival of 5.2.9?

rgansevles:
Headless client does not count as a web client and uses the regular licence set.

Can I ask why the headless client is not counted in the same way as the webclient, surely as Scott says its a server side connection ?

given that its not …

Is there a likelihood that an unlimited headless client could be produced on a similar basis to the webclient ?

Gordon

rgansevles:
Headless client does not count as a web client and uses the regular licence set.

Rob

Thanks for your response Rob. I’d like to ask that you guys revisit this? This means that with an unlimited web client license, you CAN’T :

  • Use the Restful WebService Plugin
  • Use Batch Processors
  • Use JSP Pages
  • Use the Headless Client Plugin

Seems like a lot of restrictions, especially JSP and Restful WebService plugin given that it is a WEB license. Given that Headless Client and Web Client all run server side, shouldn’t an unlimited Web Client License include unlimited Headless Clients? Otherwise your asking people to buy additional Full/Regular licenses for Batch Processors, Web Services, and JSP pages…

goldcougar:
I’d like to ask that you guys revisit this?

We will. Keep an eye on this thread for updates.

Scott, we agree with you. We have unlimited web-client but we have stay back from opportunities because of this restriction
It will benefit Servoy and the development community on the long term by simplifying the license model on the back end; it should just be included by default with any unlimited license.

Javier.Valencia:
Scott, we agree with you. We have unlimited web-client but we have stay back from opportunities because of this restriction
It will benefit Servoy and the development community on the long term by simplifying the license model on the back end; it should just be included by default with any unlimited license.

Absolutely agree …

This gets my vote.

Hi,

Starting from release 5.2.9, an unlimited web client license will also cover headless clients.

Rob

Way to go! Thanks for the speedy response!

That fixed it, but…
Still getting intermittent ‘Client is not registered with the server’ errors. Maybe it’s unrelated.

We are running Servoy 5.2.9 on a WIN 2008 R2 server with MySQL
We have a CPU licence giving unlimited WCs, and a small pool of SC licences which don’t get used much.
We run two HCs, one that runs all the time to trigger CRON jobs and the other which is called ad hoc by the clients to execute background tasks.

Normally it all ticks along nicely. About once a week but sometimes more often, it starts throwing Client is not registered with the server errors whenever a call is made from a client or the CRON HC to open an ad hoc HC. The only way I’ve found to resolve this is to reboot servoy - not ideal with customers logged in.

Looking at the clients page on servoy-admin there are only the CRON HC running plus any number of WCs (which are working as expected). Can anyone suggest what I can do to troubleshoot this?

Here’s a stack dump taken at the time

Current time: Fri Jul 15 19:27:57 EST 2011

Server Information
Servoy version 5.2.9 -build 1020
Port used by RMI Registry: 1099
Repository version 38

Current time: Fri Jul 15 19:27:57 EST 2011

Uptime:  21 hours 38 minutes 30 seconds

JDK Information
java.vm.name=Java HotSpot(TM) Client VM
java.version=1.6.0_24
java.vm.info=mixed mode, sharing
java.vm.vendor=Sun Microsystems Inc.

Operating System Information
os.name=Windows Server 2008 R2
os.version=6.1
os.arch=x86

System Information
Heap memory: allocated=506816K, used=276644K, max=506816K
None Heap memory: allocated=92672K, used=82095K, max=186368K

Thread: Image Fetcher 0, state: TIMED_WAITING, total cpu time: 31.25ms, total user time: 31.25ms
  java.lang.Object.wait(Native Method)
  sun.awt.image.ImageFetcher.nextImage(Unknown Source)
  sun.awt.image.ImageFetcher.fetchloop(Unknown Source)
  sun.awt.image.ImageFetcher.run(Unknown Source)

Thread: pool-4-thread-165, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-79-thread-1, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-78-thread-7, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-4-thread-163, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-68-thread-44, state: WAITING, total cpu time: 187.5ms, total user time: 140.625ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-74-thread-8, state: WAITING, total cpu time: 62.5ms, total user time: 31.25ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: Timer-27, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: Timer-25, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: SocketAccepter[1], state: WAITING, total cpu time: 46.875ms, total user time: 46.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: Timer-23, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: Timer-20, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: pool-58-thread-1, state: WAITING, total cpu time: 46.875ms, total user time: 31.25ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[20], state: WAITING, total cpu time: 296.875ms, total user time: 234.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[19], state: WAITING, total cpu time: 718.75ms, total user time: 500.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-44, state: WAITING, total cpu time: 31.25ms, total user time: 31.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-43, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-42, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-41, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-40, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-39, state: WAITING, total cpu time: 2984.375ms, total user time: 2968.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: RMI RenewClean-[192.168.0.200:3002], state: TIMED_WAITING, total cpu time: 281.25ms, total user time: 265.625ms
  java.lang.Object.wait(Native Method)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: ClientExportNotifyListner[2], state: RUNNABLE, total cpu time: 31.25ms, total user time: 15.625ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  java.io.BufferedInputStream.fill(Unknown Source)
  java.io.BufferedInputStream.read(Unknown Source)
  com.servoy.j2db.rmi.compressing.CompressingInputStream.readIn(CompressingInputStream.java:99)
  com.servoy.j2db.rmi.compressing.CompressingInputStream.read(CompressingInputStream.java:85)
  java.io.DataInputStream.readInt(Unknown Source)
  com.servoy.j2db.rmi.ServerTwoWaySocketFactory$1.run(ServerTwoWaySocketFactory.java:106)

Thread: http-80-36, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-35, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-34, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: pool-46-thread-1, state: WAITING, total cpu time: 78.125ms, total user time: 62.5ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[18], state: WAITING, total cpu time: 1203.125ms, total user time: 984.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-38, state: RUNNABLE, total cpu time: 132515.625ms, total user time: 131828.125ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-37, state: RUNNABLE, total cpu time: 193265.625ms, total user time: 191890.625ms
  sun.management.ThreadImpl.getThreadInfo0(Native Method)
  sun.management.ThreadImpl.getThreadInfo(Unknown Source)
  sun.management.ThreadImpl.getThreadInfo(Unknown Source)
  com.servoy.j2db.server.servlets.ConfigServlet.Zt(ConfigServlet.java:2457)
  com.servoy.j2db.server.servlets.ConfigServlet.service(ConfigServlet.java:3632)
  javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
  org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
  org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
  org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
  org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
  org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
  org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
  org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:567)
  org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
  org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[17], state: WAITING, total cpu time: 1375.0ms, total user time: 1187.5ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-36, state: WAITING, total cpu time: 281.25ms, total user time: 265.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-35, state: WAITING, total cpu time: 172406.25ms, total user time: 170765.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-34, state: WAITING, total cpu time: 92062.5ms, total user time: 91156.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-33, state: WAITING, total cpu time: 11390.625ms, total user time: 11250.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-32, state: WAITING, total cpu time: 16812.5ms, total user time: 16578.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-31, state: WAITING, total cpu time: 38375.0ms, total user time: 37796.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-30, state: WAITING, total cpu time: 26015.625ms, total user time: 25656.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-29, state: WAITING, total cpu time: 125.0ms, total user time: 125.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-28, state: RUNNABLE, total cpu time: 251484.375ms, total user time: 249953.125ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-27, state: WAITING, total cpu time: 84343.75ms, total user time: 83468.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-26, state: RUNNABLE, total cpu time: 66218.75ms, total user time: 65734.375ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-25, state: RUNNABLE, total cpu time: 210140.625ms, total user time: 208734.375ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-24, state: WAITING, total cpu time: 54890.625ms, total user time: 54453.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-23, state: RUNNABLE, total cpu time: 199156.25ms, total user time: 197750.0ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[16], state: WAITING, total cpu time: 750.0ms, total user time: 593.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-33, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-32, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-31, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-30, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-29, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-28, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-27, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-26, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-25, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-24, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-23, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-22, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-21, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-20, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-19, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-18, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-17, state: WAITING, total cpu time: 7968.75ms, total user time: 7953.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-16, state: WAITING, total cpu time: 297906.25ms, total user time: 296515.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-15, state: WAITING, total cpu time: 234.375ms, total user time: 171.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-14, state: WAITING, total cpu time: 31.25ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-13, state: WAITING, total cpu time: 243750.0ms, total user time: 243203.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-12, state: WAITING, total cpu time: 125.0ms, total user time: 93.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-11, state: WAITING, total cpu time: 346312.5ms, total user time: 345984.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: RMI Scheduler(0), state: TIMED_WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: SocketAccepter[0], state: WAITING, total cpu time: 312.5ms, total user time: 265.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-10, state: WAITING, total cpu time: 8515.625ms, total user time: 8421.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-9, state: WAITING, total cpu time: 55609.375ms, total user time: 55328.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[15], state: WAITING, total cpu time: 812.5ms, total user time: 656.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[14], state: WAITING, total cpu time: 593.75ms, total user time: 500.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[13], state: WAITING, total cpu time: 625.0ms, total user time: 531.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[12], state: WAITING, total cpu time: 796.875ms, total user time: 718.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[11], state: WAITING, total cpu time: 859.375ms, total user time: 640.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-22, state: WAITING, total cpu time: 32828.125ms, total user time: 32140.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[10], state: WAITING, total cpu time: 1546.875ms, total user time: 1296.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[9], state: WAITING, total cpu time: 765.625ms, total user time: 671.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[8], state: WAITING, total cpu time: 859.375ms, total user time: 671.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[7], state: WAITING, total cpu time: 687.5ms, total user time: 531.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[6], state: WAITING, total cpu time: 546.875ms, total user time: 390.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-21, state: WAITING, total cpu time: 44468.75ms, total user time: 43812.5ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-20, state: WAITING, total cpu time: 214328.125ms, total user time: 212640.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-19, state: RUNNABLE, total cpu time: 74078.125ms, total user time: 73171.875ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: Lookup ValueList Timer, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: TaskExecuter[5], state: WAITING, total cpu time: 718.75ms, total user time: 625.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[4], state: WAITING, total cpu time: 1234.375ms, total user time: 1078.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TimerQueue, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  javax.swing.TimerQueue.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-18, state: WAITING, total cpu time: 81671.875ms, total user time: 80593.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-17, state: WAITING, total cpu time: 73468.75ms, total user time: 72531.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-16, state: WAITING, total cpu time: 58953.125ms, total user time: 58265.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-15, state: WAITING, total cpu time: 17359.375ms, total user time: 16796.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-14, state: WAITING, total cpu time: 288734.375ms, total user time: 286328.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-13, state: WAITING, total cpu time: 10687.5ms, total user time: 10421.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-12, state: WAITING, total cpu time: 361218.75ms, total user time: 359218.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-11, state: WAITING, total cpu time: 76062.5ms, total user time: 74859.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-10, state: WAITING, total cpu time: 178500.0ms, total user time: 177500.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-9, state: WAITING, total cpu time: 129296.875ms, total user time: 127781.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-8, state: WAITING, total cpu time: 173843.75ms, total user time: 171984.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-7, state: WAITING, total cpu time: 61328.125ms, total user time: 60062.5ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[3], state: WAITING, total cpu time: 1562.5ms, total user time: 1406.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[2], state: WAITING, total cpu time: 1437.5ms, total user time: 1093.75ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[1], state: WAITING, total cpu time: 1562.5ms, total user time: 1359.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-6, state: WAITING, total cpu time: 272359.375ms, total user time: 270078.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-5, state: WAITING, total cpu time: 281015.625ms, total user time: 278031.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-4, state: WAITING, total cpu time: 344453.125ms, total user time: 341015.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-3, state: WAITING, total cpu time: 61312.5ms, total user time: 60203.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-8, state: WAITING, total cpu time: 23703.125ms, total user time: 23546.875ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-7, state: WAITING, total cpu time: 20812.5ms, total user time: 20281.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-2, state: RUNNABLE, total cpu time: 318953.125ms, total user time: 315828.125ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.readFully(Unknown Source)
  com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
  com.sun.net.ssl.internal.ssl.AppInputStream.read(Unknown Source)
  org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
  org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:808)
  org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-1, state: WAITING, total cpu time: 42625.0ms, total user time: 41734.375ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: TaskExecuter[0], state: WAITING, total cpu time: 3250.0ms, total user time: 2828.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.util.TaskExecuter.run(TaskExecuter.java:70)
  java.lang.Thread.run(Unknown Source)

Thread: pool-1-thread-3, state: WAITING, total cpu time: 1656.25ms, total user time: 1265.625ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-1-thread-2, state: WAITING, total cpu time: 1375.0ms, total user time: 1125.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-6, state: WAITING, total cpu time: 70812.5ms, total user time: 70390.625ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-5, state: WAITING, total cpu time: 95968.75ms, total user time: 95250.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-4, state: WAITING, total cpu time: 179609.375ms, total user time: 178328.125ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-3, state: WAITING, total cpu time: 43484.375ms, total user time: 42875.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-2, state: WAITING, total cpu time: 6156.25ms, total user time: 6000.0ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-1, state: WAITING, total cpu time: 30406.25ms, total user time: 29781.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:423)
  org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:449)
  java.lang.Thread.run(Unknown Source)

Thread: http-443-Acceptor-0, state: RUNNABLE, total cpu time: 1218.75ms, total user time: 984.375ms
  java.net.PlainSocketImpl.socketAccept(Native Method)
  java.net.PlainSocketImpl.accept(Unknown Source)
  java.net.ServerSocket.implAccept(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(Unknown Source)
  org.apache.tomcat.util.net.jsse.JSSESocketFactory.acceptSocket(JSSESocketFactory.java:151)
  org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:317)
  java.lang.Thread.run(Unknown Source)

Thread: http-80-Acceptor-0, state: RUNNABLE, total cpu time: 93.75ms, total user time: 62.5ms
  java.net.PlainSocketImpl.socketAccept(Native Method)
  java.net.PlainSocketImpl.accept(Unknown Source)
  java.net.ServerSocket.implAccept(Unknown Source)
  java.net.ServerSocket.accept(Unknown Source)
  org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
  org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:317)
  java.lang.Thread.run(Unknown Source)

Thread: ContainerBackgroundProcessor[StandardEngine[Catalina]], state: TIMED_WAITING, total cpu time: 10734.375ms, total user time: 10062.5ms
  java.lang.Thread.sleep(Native Method)
  org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1579)
  java.lang.Thread.run(Unknown Source)

Thread: Timer-0, state: TIMED_WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.util.TimerThread.mainLoop(Unknown Source)
  java.util.TimerThread.run(Unknown Source)

Thread: scheduler_QuartzSchedulerThread, state: TIMED_WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:411)

Thread: scheduler_Worker-1, state: TIMED_WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  java.lang.Object.wait(Native Method)
  org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:543)

Thread: ModificationWatcher Task, state: TIMED_WAITING, total cpu time: 5765.625ms, total user time: 3546.875ms
  java.lang.Thread.sleep(Native Method)
  org.apache.wicket.util.time.Duration.sleep(Duration.java:445)
  org.apache.wicket.util.thread.Task$1.run(Task.java:130)
  java.lang.Thread.run(Unknown Source)

Thread: AWT-Windows, state: RUNNABLE, total cpu time: 15.625ms, total user time: 15.625ms
  sun.awt.windows.WToolkit.eventLoop(Native Method)
  sun.awt.windows.WToolkit.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: Java2D Disposer, state: WAITING, total cpu time: 125.0ms, total user time: 125.0ms
  java.lang.Object.wait(Native Method)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  sun.java2d.Disposer.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-3-thread-1, state: TIMED_WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: GC Daemon, state: TIMED_WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  sun.misc.GC$Daemon.run(Unknown Source)

Thread: RMI Reaper, state: WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  java.lang.Object.wait(Native Method)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  sun.rmi.transport.ObjectTable$Reaper.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: pool-1-thread-1, state: WAITING, total cpu time: 2140.625ms, total user time: 1718.75ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: RMI TCP Accept-1099, state: WAITING, total cpu time: 15.625ms, total user time: 15.625ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.park(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
  java.util.concurrent.ArrayBlockingQueue.take(Unknown Source)
  com.servoy.j2db.rmi.ServerTwoWaySocketFactory$TwoWayServerSocket.accept(ServerTwoWaySocketFactory.java:578)
  sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(Unknown Source)
  sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: 2 way Server Acceptor, state: RUNNABLE, total cpu time: 93.75ms, total user time: 62.5ms
  java.net.PlainSocketImpl.socketAccept(Native Method)
  java.net.PlainSocketImpl.accept(Unknown Source)
  java.net.ServerSocket.implAccept(Unknown Source)
  com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(Unknown Source)
  com.servoy.j2db.rmi.ServerTwoWaySocketFactory$TwoWayServerSocket.run(ServerTwoWaySocketFactory.java:596)
  java.lang.Thread.run(Unknown Source)

Thread: pool-2-thread-1, state: TIMED_WAITING, total cpu time: 0.0ms, total user time: 0.0ms
  sun.misc.Unsafe.park(Native Method)
  java.util.concurrent.locks.LockSupport.parkNanos(Unknown Source)
  java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
  java.util.concurrent.DelayQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
  java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
  java.lang.Thread.run(Unknown Source)

Thread: PingScanner, state: TIMED_WAITING, total cpu time: 93.75ms, total user time: 78.125ms
  java.lang.Object.wait(Native Method)
  com.servoy.j2db.dataprocessing.Zn.run(Zn.java:38)
  java.lang.Thread.run(Unknown Source)

Thread: MessageScheduler, state: TIMED_WAITING, total cpu time: 2734.375ms, total user time: 2265.625ms
  java.lang.Object.wait(Native Method)
  com.servoy.j2db.dataprocessing.Zp.run(Zp.java:10)
  java.lang.Thread.run(Unknown Source)

Thread: MessagePreHandler, state: WAITING, total cpu time: 2031.25ms, total user time: 1656.25ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  com.servoy.j2db.dataprocessing.ClientMessagePreQueueHandler.run(ClientMessagePreQueueHandler.java:48)
  java.lang.Thread.run(Unknown Source)

Thread: DestroyJavaVM, state: RUNNABLE, total cpu time: 343.75ms, total user time: 296.875ms

Thread: Wrapper-Connection, state: RUNNABLE, total cpu time: 62.5ms, total user time: 62.5ms
  java.net.SocketInputStream.socketRead0(Native Method)
  java.net.SocketInputStream.read(Unknown Source)
  java.net.SocketInputStream.read(Unknown Source)
  java.io.DataInputStream.readByte(Unknown Source)
  org.tanukisoftware.wrapper.WrapperManager.handleSocket(WrapperManager.java:4203)
  org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java:4558)
  java.lang.Thread.run(Unknown Source)

Thread: Wrapper-Control-Event-Monitor, state: TIMED_WAITING, total cpu time: 265.625ms, total user time: 156.25ms
  java.lang.Thread.sleep(Native Method)
  org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:816)

Thread: Attach Listener, state: RUNNABLE, total cpu time: 0.0ms, total user time: 0.0ms

Thread: Signal Dispatcher, state: RUNNABLE, total cpu time: 0.0ms, total user time: 0.0ms

Thread: Finalizer, state: WAITING, total cpu time: 6984.375ms, total user time: 6734.375ms
  java.lang.Object.wait(Native Method)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  java.lang.ref.ReferenceQueue.remove(Unknown Source)
  java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)

Thread: Reference Handler, state: WAITING, total cpu time: 2578.125ms, total user time: 2437.5ms
  java.lang.Object.wait(Native Method)
  java.lang.Object.wait(Object.java:485)
  java.lang.ref.Reference$ReferenceHandler.run(Unknown Source)

that stackdump doesn’t tell anything
Do you have anymore log?

where do you exactly see that error? There are no smartclients here?

Hi Johan, yes that’s the point, I don’t open any smart clients, I have unlimited CPU license for WC, but attempting to open a HC sometimes gives the Can’t register client error, which prior to 5.2.9 was due to the HCs chewing up SC licenses. Now I still see the error intermittently when another client (WC or HC) is attempting to open a new HC.

Here’s the server log of a recent event. A restart of servoy fixes it.

2011-07-15 19:02:08,827 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:02:08,827 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:02:28,380 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:02:28,380 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:05:03,807 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:05:03,807 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:05:11,909 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:05:11,909 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:06:45,639 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:06:45,639 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:06:53,257 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:06:53,257 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:08:13,527 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:08:13,527 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
2011-07-15 19:09:03,961 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Could not load record
2011-07-15 19:09:03,961 ERROR [pool-68-thread-44] com.servoy.j2db.util.Debug - Throwable
com.servoy.j2db.persistence.RepositoryException: Client is not registered with the server.
	at com.servoy.j2db.dataprocessing.Zu.Za(Zu.java:54)
	at com.servoy.j2db.dataprocessing.Zu.performQuery(Zu.java:349)
	at com.servoy.j2db.dataprocessing.RowManager.getRows(RowManager.java:447)
	at com.servoy.j2db.dataprocessing.FoundSet.createRecord(FoundSet.java:2421)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1861)
	at com.servoy.j2db.dataprocessing.FoundSet.getRecord(FoundSet.java:1832)
	at com.servoy.j2db.dataprocessing.FoundSet.loadExternalPKList(FoundSet.java:1543)
	at com.servoy.j2db.dataprocessing.FoundSet.js_loadRecords(FoundSet.java:979)
	at sun.reflect.GeneratedMethodAccessor319.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.mozilla.javascript.MemberBox.invoke(MemberBox.java:179)
	at org.mozilla.javascript.NativeJavaMethod.call(NativeJavaMethod.java:353)
	at org.mozilla.javascript.Interpreter.interpretLoop(Interpreter.java:3666)
	at org.mozilla.javascript.Interpreter.interpret(Interpreter.java:2680)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:166)
	at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:387)
	at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3135)
	at org.mozilla.javascript.InterpretedFunction.call(InterpretedFunction.java:165)
	at com.servoy.j2db.scripting.ScriptEngine.executeFunction(ScriptEngine.java:476)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3977)
	at com.servoy.j2db.FormController.executeFunction(FormController.java:3858)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$MethodExecutor.run(ClientPluginAccessProvider.java:548)
	at com.servoy.j2db.server.headlessclient.SessionClient.invokeAndWait(SessionClient.java:1170)
	at com.servoy.j2db.plugins.ClientPluginAccessProvider$1.run(ClientPluginAccessProvider.java:443)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)

Can you suggest what I should be looking at when it next happens, to better trouble shoot.

how do you get that client?

if you do createClient() and then the call, then that should work just fine.
Because if createClient() returns a client that one is that registered just fine.

Are you reusing old JSClient objects that you just store in a variable or something? Because this really seems that somehow the client is unregistered already at that time.

So are you sure that you get that from new clients?

This is the code, it works most of the time.

var hc = null
hc = plugins.headlessclient.getClient(headlessClientId)
if(!hc || !hc.isValid()){ //client died so make a new one
	globals.AddLog("HC Died, Creating New HC", 0 ,"", 0 , 0 );
	hc = plugins.headlessclient.createClient("mod_remote_jobs", null, null, [false])
	headlessClientId = hc.getClientID()
	forms.rj_solution_global.headless_client_id = headlessClientId
	databaseManager.saveData()
}

then i don’t know how that can happen. a createClient() or getClient() should return valid and registered clients.
So something seems the unregister the client, but it can’t be a destroyed client because then you shouldn’t be able to execute anything…