Embedded Tomcat Load Balanced Replication Problem in OFBiz

[pradeepruhil85]

Hi,
We are running OFBiz in  load balanced mode (Embedded Tomcat 6.0) with session replication.
When we are starting the OFBiz servers in load balanced mode,  then in the console we are getting the following  error :

2010-04-14 11:47:51,078 (main) [             VfsLog.java:122:INFO ] Using "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\vfs_cache" as temporary files store.
2010-04-14 11:48:05,140 (GroupChannel-Heartbeat-1) [       GroupChannel.java:665:ERROR] Unable to send heartbeat through Tribes interceptor stack. Will try to sleep again.
java.util.ConcurrentModificationException
        at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
        at java.util.AbstractList$Itr.next(AbstractList.java:343)
        at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:152)
        at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
class org.webslinger.commons.vfs.flat.FlatFileProvider
2010-04-14 11:48:09,937 (main) [      ChannelSocket.java:387:INFO ] JK: ajp13 listening on /0.0.0.0:8009
2010-04-14 11:48:09,984 (main) [             JkMain.java:344:INFO ] Jk running ID=0 time=16/78  config=null
2010-04-14 11:48:10,125 (main) [     Http11Protocol.java:209:INFO ] Starting Coyote HTTP/1.1 on http-0.0.0.0-8080

When  we are testing 100 concurrent users using JMeter, it is giving following error after  5-10 mins.
0-04-14 09:46:10,703 (GroupChannel-Heartbeat-1) [          BioSender.java:287:WARN ] Unable to read acknowledgement from [/192.168.1.3:1,93
a.net.SocketTimeoutException: Read timed out
     at java.net.SocketInputStream.socketRead0(Native Method)
     at java.net.SocketInputStream.read(SocketInputStream.java:129)
     at java.net.SocketInputStream.read(SocketInputStream.java:182)
     at org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263)
     at org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245)
     at org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:125)
     at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52)
     at org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
     at org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
     at org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216)
     at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175)
     at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89)
     at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253)
     at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793)
     at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153)
     at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
0-04-14 09:46:13,718 (GroupChannel-Heartbeat-1) [AbstractReplicatedMap.java:795:ERROR] Unable to send AbstractReplicatedMap.ping message
.apache.catalina.tribes.ChannelException: java.net.SocketTimeoutException: Read timed out; Faulty members:tcp://{-64, -88, 1, 3}:4001;
     at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:54)
     at org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
     at org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
     at org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73)
     at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
     at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216)
     at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175)
     at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89)
     at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253)
     at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793)
     at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153)
     at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
sed by: java.net.SocketTimeoutException: Read timed out
     at java.net.SocketInputStream.socketRead0(Native Method)
     at java.net.SocketInputStream.read(SocketInputStream.java:129)
     at java.net.SocketInputStream.read(SocketInputStream.java:182)
     at org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263)
     at org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245)
     at org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:134)
     at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52)
     ... 15 more

Please give suggestion /solution  of this load balance problem.


Thanks & Regards
Pradeep Ruhil
L& T Infotech
Mahape, Vashi
Mumbai


________________________________
This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.

______________________________________________________________________