OFBiz performance issue.

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

OFBiz performance issue.

Anil Soni
Dear Users,

I am doing OFBiz performance testing on JBOSS application server. I've done all the performance setting on both side application side and database side.
But still results are very poor then I decided to find the root cause for the problem. For  that I've used Java Profiler to monitor performance and test the time taken to load of ecommerce main page and found that Ofbiz is taking lots of time in screen / form rendering because every time it parse XML (like screens / forms/ and minilang service ) that takes lots of time.

Please refer the below link to check the performance results.

http://www.screencast.com/t/ZGJjM2QxOGY
 I also tried the one thing where I've render the FTL directly in view map instead of rendering it in screen and it saves my 50 % time.

So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked into this issue and what is the solution for that ?

Any suggestions or reply would be highly appreciated.



Regards,
Anil Soni
Tel  : 91-22-6795 4324
Cell : 91 9930302283


________________________________
This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.

______________________________________________________________________
Reply | Threaded
Open this post in threaded view
|

Re: OFBiz performance issue.

David E. Jones-2

You need to remove the cache timeouts. There are caches for all of the XML widgets that cache it objects that are created from the XML files so no more interpretation is needed in order to execute them. If you have the default timeouts still enabled those will be thrown away every 10 seconds, causing HUGE performance problems. These settings are in the cache.properties file, and you can use the WebTools Cache Management pages to check on the cache settings to make sure they are what you expect (ie NO timeouts for the widget and other XML files, including service defs, etc, etc).

Please be sure to read through the sections on caching and logging in the Technical Production Setup Guide that is available on cwiki.apache.org.

-David


On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:

> Dear Users,
>
> I am doing OFBiz performance testing on JBOSS application server. I've done all the performance setting on both side application side and database side.
> But still results are very poor then I decided to find the root cause for the problem. For  that I've used Java Profiler to monitor performance and test the time taken to load of ecommerce main page and found that Ofbiz is taking lots of time in screen / form rendering because every time it parse XML (like screens / forms/ and minilang service ) that takes lots of time.
>
> Please refer the below link to check the performance results.
>
> http://www.screencast.com/t/ZGJjM2QxOGY
> I also tried the one thing where I've render the FTL directly in view map instead of rendering it in screen and it saves my 50 % time.
>
> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked into this issue and what is the solution for that ?
>
> Any suggestions or reply would be highly appreciated.
>
>
>
> Regards,
> Anil Soni
> Tel  : 91-22-6795 4324
> Cell : 91 9930302283
>
>
> ________________________________
> This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.
>
> ______________________________________________________________________

Reply | Threaded
Open this post in threaded view
|

Re: OFBiz performance issue.

Jeroen van der Wal-2
You can find the document here:
http://cwiki.apache.org/confluence/display/OFBTECH/Apache+OFBiz+Technical+Production+Setup+Guide#ApacheOFBizTechnicalProductionSetupGuide-CacheSettings
--
Jeroen

On Fri, Apr 9, 2010 at 6:56 AM, David E Jones <[hidden email]> wrote:

>
> You need to remove the cache timeouts. There are caches for all of the XML widgets that cache it objects that are created from the XML files so no more interpretation is needed in order to execute them. If you have the default timeouts still enabled those will be thrown away every 10 seconds, causing HUGE performance problems. These settings are in the cache.properties file, and you can use the WebTools Cache Management pages to check on the cache settings to make sure they are what you expect (ie NO timeouts for the widget and other XML files, including service defs, etc, etc).
>
> Please be sure to read through the sections on caching and logging in the Technical Production Setup Guide that is available on cwiki.apache.org.
>
> -David
>
>
> On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:
>
>> Dear Users,
>>
>> I am doing OFBiz performance testing on JBOSS application server. I've done all the performance setting on both side application side and database side.
>> But still results are very poor then I decided to find the root cause for the problem. For  that I've used Java Profiler to monitor performance and test the time taken to load of ecommerce main page and found that Ofbiz is taking lots of time in screen / form rendering because every time it parse XML (like screens / forms/ and minilang service ) that takes lots of time.
>>
>> Please refer the below link to check the performance results.
>>
>> http://www.screencast.com/t/ZGJjM2QxOGY
>> I also tried the one thing where I've render the FTL directly in view map instead of rendering it in screen and it saves my 50 % time.
>>
>> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked into this issue and what is the solution for that ?
>>
>> Any suggestions or reply would be highly appreciated.
>>
>>
>>
>> Regards,
>> Anil Soni
>> Tel  : 91-22-6795 4324
>> Cell : 91 9930302283
>>
>>
>> ________________________________
>> This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.
>>
>> ______________________________________________________________________
>
>
Reply | Threaded
Open this post in threaded view
|

RE: OFBiz performance issue.

Anil Soni
In reply to this post by David E. Jones-2
Thanks David for the reply.

I 'had already done all these setting and tried on Jboss but still result are  the same. Now when I am doing testing through Jmeter for concurrent users than it is giving the error related to duplicate key value violates for UserLoginHistory and ServerHit entities. Here is the error logs :


---- exception report ----------------------------------------------------------
Failure in create operation for entity [UserLoginHistory]: org.ofbiz.entity.GenericEntityException: Error while inserting: [Gener
icEntity:UserLoginHistory][createdStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][createdTxStamp,2010-04-13 11:12:50.609(java.
sql.Timestamp)][fromDate,2010-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010-04-13 11:12:50.609(java.sql.Timestamp
)][lastUpdatedTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.String)][successfulLogin,Y(java.lang.S
tring)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] (SQL Exception while executing the following:INSERT
 INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STA
MP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate
key value violates unique constraint "pk_user_login_history")). Rolling back transaction.
Exception: org.ofbiz.entity.GenericEntityException
Message: Error while inserting: [GenericEntity:UserLoginHistory][createdStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][create
dTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][fromDate,2010-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010
-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.
String)][successfulLogin,Y(java.lang.String)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] (SQL Exceptio
n while executing the following:INSERT INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_US
ED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?
, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint "pk_user_login_history"))
---- cause ---------------------------------------------------------------------
Exception: org.ofbiz.entity.GenericDataSourceException
Message: SQL Exception while executing the following:INSERT INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, T
HRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID)
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint "pk_user_login_history")
---- cause ---------------------------------------------------------------------
Exception: org.postgresql.util.PSQLException
Message: ERROR: duplicate key value violates unique constraint "pk_user_login_history"
---- stack trace ---------------------------------------------------------------
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "pk_user_login_history"
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)


Is there any solution for this ?


-----Original Message-----
From: David E Jones [mailto:[hidden email]]
Sent: Friday, April 09, 2010 10:27 AM
To: [hidden email]
Subject: Re: OFBiz performance issue.


You need to remove the cache timeouts. There are caches for all of the XML widgets that cache it objects that are created from the XML files so no more interpretation is needed in order to execute them. If you have the default timeouts still enabled those will be thrown away every 10 seconds, causing HUGE performance problems. These settings are in the cache.properties file, and you can use the WebTools Cache Management pages to check on the cache settings to make sure they are what you expect (ie NO timeouts for the widget and other XML files, including service defs, etc, etc).

Please be sure to read through the sections on caching and logging in the Technical Production Setup Guide that is available on cwiki.apache.org.

-David


On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:

> Dear Users,
>
> I am doing OFBiz performance testing on JBOSS application server. I've done all the performance setting on both side application side and database side.
> But still results are very poor then I decided to find the root cause for the problem. For  that I've used Java Profiler to monitor performance and test the time taken to load of ecommerce main page and found that Ofbiz is taking lots of time in screen / form rendering because every time it parse XML (like screens / forms/ and minilang service ) that takes lots of time.
>
> Please refer the below link to check the performance results.
>
> http://www.screencast.com/t/ZGJjM2QxOGY
> I also tried the one thing where I've render the FTL directly in view map instead of rendering it in screen and it saves my 50 % time.
>
> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked into this issue and what is the solution for that ?
>
> Any suggestions or reply would be highly appreciated.
>
>
>
> Regards,
> Anil Soni
> Tel  : 91-22-6795 4324
> Cell : 91 9930302283
>
>
> ________________________________
> This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.
>
> ______________________________________________________________________


______________________________________________________________________

This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.

______________________________________________________________________
Reply | Threaded
Open this post in threaded view
|

Re: OFBiz performance issue.

David E. Jones-2

If you made the change and results are still the same then the change probably didn't work. Did you check the WebTools cache management page to see if the timeouts were gone?

This isn't rocket science, but be careful when you're doing custom deployments (like with JBoss) because the classpath may not be what you think it is...

-David


On Apr 13, 2010, at 12:55 AM, Anil Soni wrote:

> Thanks David for the reply.
>
> I 'had already done all these setting and tried on Jboss but still result are  the same. Now when I am doing testing through Jmeter for concurrent users than it is giving the error related to duplicate key value violates for UserLoginHistory and ServerHit entities. Here is the error logs :
>
>
> ---- exception report ----------------------------------------------------------
> Failure in create operation for entity [UserLoginHistory]: org.ofbiz.entity.GenericEntityException: Error while inserting: [Gener
> icEntity:UserLoginHistory][createdStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][createdTxStamp,2010-04-13 11:12:50.609(java.
> sql.Timestamp)][fromDate,2010-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010-04-13 11:12:50.609(java.sql.Timestamp
> )][lastUpdatedTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.String)][successfulLogin,Y(java.lang.S
> tring)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] (SQL Exception while executing the following:INSERT
> INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STA
> MP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate
> key value violates unique constraint "pk_user_login_history")). Rolling back transaction.
> Exception: org.ofbiz.entity.GenericEntityException
> Message: Error while inserting: [GenericEntity:UserLoginHistory][createdStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][create
> dTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][fromDate,2010-04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedStamp,2010
> -04-13 11:12:50.609(java.sql.Timestamp)][lastUpdatedTxStamp,2010-04-13 11:12:50.609(java.sql.Timestamp)][partyId,admin(java.lang.
> String)][successfulLogin,Y(java.lang.String)][userLoginId,admin(java.lang.String)][visitId,10049(java.lang.String)] (SQL Exceptio
> n while executing the following:INSERT INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, THRU_DATE, PASSWORD_US
> ED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID) VALUES (?, ?, ?, ?, ?
> , ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint "pk_user_login_history"))
> ---- cause ---------------------------------------------------------------------
> Exception: org.ofbiz.entity.GenericDataSourceException
> Message: SQL Exception while executing the following:INSERT INTO public.USER_LOGIN_HISTORY (USER_LOGIN_ID, VISIT_ID, FROM_DATE, T
> HRU_DATE, PASSWORD_USED, SUCCESSFUL_LOGIN, LAST_UPDATED_STAMP, LAST_UPDATED_TX_STAMP, CREATED_STAMP, CREATED_TX_STAMP, PARTY_ID)
> VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) (ERROR: duplicate key value violates unique constraint "pk_user_login_history")
> ---- cause ---------------------------------------------------------------------
> Exception: org.postgresql.util.PSQLException
> Message: ERROR: duplicate key value violates unique constraint "pk_user_login_history"
> ---- stack trace ---------------------------------------------------------------
> org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "pk_user_login_history"
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
>
>
> Is there any solution for this ?
>
>
> -----Original Message-----
> From: David E Jones [mailto:[hidden email]]
> Sent: Friday, April 09, 2010 10:27 AM
> To: [hidden email]
> Subject: Re: OFBiz performance issue.
>
>
> You need to remove the cache timeouts. There are caches for all of the XML widgets that cache it objects that are created from the XML files so no more interpretation is needed in order to execute them. If you have the default timeouts still enabled those will be thrown away every 10 seconds, causing HUGE performance problems. These settings are in the cache.properties file, and you can use the WebTools Cache Management pages to check on the cache settings to make sure they are what you expect (ie NO timeouts for the widget and other XML files, including service defs, etc, etc).
>
> Please be sure to read through the sections on caching and logging in the Technical Production Setup Guide that is available on cwiki.apache.org.
>
> -David
>
>
> On Apr 8, 2010, at 11:50 PM, Anil Soni wrote:
>
>> Dear Users,
>>
>> I am doing OFBiz performance testing on JBOSS application server. I've done all the performance setting on both side application side and database side.
>> But still results are very poor then I decided to find the root cause for the problem. For  that I've used Java Profiler to monitor performance and test the time taken to load of ecommerce main page and found that Ofbiz is taking lots of time in screen / form rendering because every time it parse XML (like screens / forms/ and minilang service ) that takes lots of time.
>>
>> Please refer the below link to check the performance results.
>>
>> http://www.screencast.com/t/ZGJjM2QxOGY
>> I also tried the one thing where I've render the FTL directly in view map instead of rendering it in screen and it saves my 50 % time.
>>
>> So it seems like OFBiz taking lots of time in XML parsing. Is anyone looked into this issue and what is the solution for that ?
>>
>> Any suggestions or reply would be highly appreciated.
>>
>>
>>
>> Regards,
>> Anil Soni
>> Tel  : 91-22-6795 4324
>> Cell : 91 9930302283
>>
>>
>> ________________________________
>> This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.
>>
>> ______________________________________________________________________
>
>
> ______________________________________________________________________
>
> This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.
>
> ______________________________________________________________________