Obfiz 12.04 way slower than 9.x
Locked
 
|
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
|
|
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls. This has to be a configuration problem. Anyone have a pointer? Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Tuesday, June 25, 2013 5:24 PM To: OfbizUser Subject: Obfiz 12.04 way slower than 9.x I am trying to upgrade to 12.04. On a test machine I finally got it all running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
|
|
I definately had a configuration issue.
My console.log is empty, but I have a gigabytes worth of debug.log.x files after a 45 second run. The contents are mostly XAConnectionFactory.java:DEBUG] XXX and ObjectPool.java:TRACE] xxx I found that this can be turned off by modifying the debug settings in log4j.xml. Now, ofbiz 9.04 is only twice as fast as 12.04. Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Wednesday, June 26, 2013 10:33 AM To: [hidden email] Subject: RE: Obfiz 12.04 way slower than 9.x After some additional testing, 12.04 is an average of 5 times slower than 9.04 across a range of services that use various entity engine calls. This has to be a configuration problem. Anyone have a pointer? Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Tuesday, June 25, 2013 5:24 PM To: OfbizUser Subject: Obfiz 12.04 way slower than 9.x I am trying to upgrade to 12.04. On a test machine I finally got it all running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
|
|
In reply to this post by SkipDever
For any who are interested, this turns out to be a problem using Minerva.
I ran a profiler on both installations (both using Minerva) and a significant part of the time spent in jdbc.ConnectionFactory.getConnection was in org.apache.log4j.Logger.trace even though trace is turned off. This is really funny because the two ofbiz-minerva.jar files, the one from 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz code that calls it is optimized to use DBCP because when I switched from Minerva to DBCP, the execution times became nearly identical. I ran Ofbiz for thousands of hours under Minerva and never had a problem where I had LOTS of problems with DBCP back then (5 years ago). I am only hoping that DBCP has been fixed. I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and have noted that the patch has been applied to the version I have, so I am hopeful. Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Wednesday, June 26, 2013 10:33 AM To: [hidden email] Subject: RE: Obfiz 12.04 way slower than 9.x After some additional testing, 12.04 is an average of 5 times slower than 9.04 across a range of services that use various entity engine calls. This has to be a configuration problem. Anyone have a pointer? Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Tuesday, June 25, 2013 5:24 PM To: OfbizUser Subject: Obfiz 12.04 way slower than 9.x I am trying to upgrade to 12.04. On a test machine I finally got it all running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
|
|
Can you explain how you switched from minerva to dbcp? I also noticed a
drastic reduction in performance so you may have nailed down the cause. Well done! Sent from my BlackBerry® PlayBook™ www.blackberry.com ------------------------------ *From:* "Skip" <[hidden email]> *To:* "[hidden email]" <[hidden email]> *Sent:* June 27, 2013 3:53 PM *Subject:* RE: Obfiz 12.04 way slower than 9.x For any who are interested, this turns out to be a problem using Minerva. I ran a profiler on both installations (both using Minerva) and a significant part of the time spent in jdbc.ConnectionFactory.getConnection was in org.apache.log4j.Logger.trace even though trace is turned off. This is really funny because the two ofbiz-minerva.jar files, the one from 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz code that calls it is optimized to use DBCP because when I switched from Minerva to DBCP, the execution times became nearly identical. I ran Ofbiz for thousands of hours under Minerva and never had a problem where I had LOTS of problems with DBCP back then (5 years ago). I am only hoping that DBCP has been fixed. I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and have noted that the patch has been applied to the version I have, so I am hopeful. Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Wednesday, June 26, 2013 10:33 AM To: [hidden email] Subject: RE: Obfiz 12.04 way slower than 9.x After some additional testing, 12.04 is an average of 5 times slower than 9.04 across a range of services that use various entity engine calls. This has to be a configuration problem. Anyone have a pointer? Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Tuesday, June 25, 2013 5:24 PM To: OfbizUser Subject: Obfiz 12.04 way slower than 9.x I am trying to upgrade to 12.04. On a test machine I finally got it all running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
Re: Obfiz 12.04 way slower than 9.x
Administrator
|
In reply to this post by SkipDever
All known DBCP issues are fixed. You can use it confidently
Jacques From: "Skip" <[hidden email]> > For any who are interested, this turns out to be a problem using Minerva. > > I ran a profiler on both installations (both using Minerva) and a > significant part of the time spent in jdbc.ConnectionFactory.getConnection > was in org.apache.log4j.Logger.trace even though trace is turned off. > > This is really funny because the two ofbiz-minerva.jar files, the one from > 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz > code that calls it is optimized to use DBCP because when I switched from > Minerva to DBCP, the execution times became nearly identical. > > > I ran Ofbiz for thousands of hours under Minerva and never had a problem > where I had LOTS of problems with DBCP back then (5 years ago). I am only > hoping that DBCP has been fixed. > > I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and > have noted that the patch has been applied to the version I have, so I am > hopeful. > > Skip > > -----Original Message----- > From: Skip [mailto:[hidden email]] > Sent: Wednesday, June 26, 2013 10:33 AM > To: [hidden email] > Subject: RE: Obfiz 12.04 way slower than 9.x > > > After some additional testing, 12.04 is an average of 5 times slower than > 9.04 across a range of services that use various entity engine calls. > > This has to be a configuration problem. Anyone have a pointer? > > Skip > > -----Original Message----- > From: Skip [mailto:[hidden email]] > Sent: Tuesday, June 25, 2013 5:24 PM > To: OfbizUser > Subject: Obfiz 12.04 way slower than 9.x > > > I am trying to upgrade to 12.04. On a test machine I finally got it all > running. However, it all seems to drag in 12.04 as compared to version 9.04 > or something. > > When I click on Entity Engine Maintenance, the entity list comes up > instantly in 9.04 and takes 12 seconds to render in 12.04. > > Although this customer does not use it, the home page in ecommerce comes up > instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing > that this is because of the different handling of catagories because part of > the page comes up instantly.) > > > I have this service that processes the inventory with a > findListIteratorByCondition and does a few findByPrimaryKeys on the list, > then writes a text file (no entity engine calls). This service takes 11 > seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times > slower and this is entirely java code with no screen stuff. I also expect > that a significant portion of that time is in the disk io writing the the > text file, so I expect that the entity engine calls are something like 4 > times slower. > > This is on an 8 core machine with 64 gigs of memory and a really fast hard > disk array. > > I have the cache, debug and logging set the same. Both instances are using > the same postgres database except that the 12.04 is using postnew. Neither > instance has anything in the log at the conclusing, and both produce exactly > the same results. > > Both ofbiz instances are running Minerva. > > I am getting ready to run a profiler on this to see where the slowdown is, > but maybe I do not have a setting right for production. > > Am I missing something? > > Skip > > > |
|
|
In reply to this post by Mike Z
Modify entityengine.xml to look like;
<connection-factory class="org.ofbiz.entity.connection.DBCPConnectionFactory"/> <!-- <connection-factory class="org.ofbiz.entity.connection.MinervaConnectionFactory"/> --> -----Original Message----- From: Mike Z [mailto:[hidden email]] Sent: Friday, June 28, 2013 12:07 AM To: [hidden email] Subject: RE: Obfiz 12.04 way slower than 9.x Can you explain how you switched from minerva to dbcp? I also noticed a drastic reduction in performance so you may have nailed down the cause. Well done! Sent from my BlackBerry® PlayBook™ www.blackberry.com ------------------------------ *From:* "Skip" <[hidden email]> *To:* "[hidden email]" <[hidden email]> *Sent:* June 27, 2013 3:53 PM *Subject:* RE: Obfiz 12.04 way slower than 9.x For any who are interested, this turns out to be a problem using Minerva. I ran a profiler on both installations (both using Minerva) and a significant part of the time spent in jdbc.ConnectionFactory.getConnection was in org.apache.log4j.Logger.trace even though trace is turned off. This is really funny because the two ofbiz-minerva.jar files, the one from 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz code that calls it is optimized to use DBCP because when I switched from Minerva to DBCP, the execution times became nearly identical. I ran Ofbiz for thousands of hours under Minerva and never had a problem where I had LOTS of problems with DBCP back then (5 years ago). I am only hoping that DBCP has been fixed. I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and have noted that the patch has been applied to the version I have, so I am hopeful. Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Wednesday, June 26, 2013 10:33 AM To: [hidden email] Subject: RE: Obfiz 12.04 way slower than 9.x After some additional testing, 12.04 is an average of 5 times slower than 9.04 across a range of services that use various entity engine calls. This has to be a configuration problem. Anyone have a pointer? Skip -----Original Message----- From: Skip [mailto:[hidden email]] Sent: Tuesday, June 25, 2013 5:24 PM To: OfbizUser Subject: Obfiz 12.04 way slower than 9.x I am trying to upgrade to 12.04. On a test machine I finally got it all running. However, it all seems to drag in 12.04 as compared to version 9.04 or something. When I click on Entity Engine Maintenance, the entity list comes up instantly in 9.04 and takes 12 seconds to render in 12.04. Although this customer does not use it, the home page in ecommerce comes up instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing that this is because of the different handling of catagories because part of the page comes up instantly.) I have this service that processes the inventory with a findListIteratorByCondition and does a few findByPrimaryKeys on the list, then writes a text file (no entity engine calls). This service takes 11 seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times slower and this is entirely java code with no screen stuff. I also expect that a significant portion of that time is in the disk io writing the the text file, so I expect that the entity engine calls are something like 4 times slower. This is on an 8 core machine with 64 gigs of memory and a really fast hard disk array. I have the cache, debug and logging set the same. Both instances are using the same postgres database except that the 12.04 is using postnew. Neither instance has anything in the log at the conclusing, and both produce exactly the same results. Both ofbiz instances are running Minerva. I am getting ready to run a profiler on this to see where the slowdown is, but maybe I do not have a setting right for production. Am I missing something? Skip |
|
|
Thanks Skip. It turns out my 11.04 already had this set.
On Fri, Jun 28, 2013 at 9:46 AM, Skip <[hidden email]> wrote: > Modify entityengine.xml to look like; > > <connection-factory > class="org.ofbiz.entity.connection.DBCPConnectionFactory"/> > <!-- <connection-factory > class="org.ofbiz.entity.connection.MinervaConnectionFactory"/> --> > > -----Original Message----- > From: Mike Z [mailto:[hidden email]] > Sent: Friday, June 28, 2013 12:07 AM > To: [hidden email] > Subject: RE: Obfiz 12.04 way slower than 9.x > > > Can you explain how you switched from minerva to dbcp? I also noticed a > drastic reduction in performance so you may have nailed down the cause. > Well done! > > Sent from my BlackBerry® PlayBook™ > www.blackberry.com > > ------------------------------ > *From:* "Skip" <[hidden email]> > *To:* "[hidden email]" <[hidden email]> > *Sent:* June 27, 2013 3:53 PM > *Subject:* RE: Obfiz 12.04 way slower than 9.x > > For any who are interested, this turns out to be a problem using Minerva. > > I ran a profiler on both installations (both using Minerva) and a > significant part of the time spent in jdbc.ConnectionFactory.getConnection > was in org.apache.log4j.Logger.trace even though trace is turned off. > > This is really funny because the two ofbiz-minerva.jar files, the one from > 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz > code that calls it is optimized to use DBCP because when I switched from > Minerva to DBCP, the execution times became nearly identical. > > > I ran Ofbiz for thousands of hours under Minerva and never had a problem > where I had LOTS of problems with DBCP back then (5 years ago). I am only > hoping that DBCP has been fixed. > > I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 > and > have noted that the patch has been applied to the version I have, so I am > hopeful. > > Skip > > -----Original Message----- > From: Skip [mailto:[hidden email]] > Sent: Wednesday, June 26, 2013 10:33 AM > To: [hidden email] > Subject: RE: Obfiz 12.04 way slower than 9.x > > > After some additional testing, 12.04 is an average of 5 times slower than > 9.04 across a range of services that use various entity engine calls. > > This has to be a configuration problem. Anyone have a pointer? > > Skip > > -----Original Message----- > From: Skip [mailto:[hidden email]] > Sent: Tuesday, June 25, 2013 5:24 PM > To: OfbizUser > Subject: Obfiz 12.04 way slower than 9.x > > > I am trying to upgrade to 12.04. On a test machine I finally got it all > running. However, it all seems to drag in 12.04 as compared to version > 9.04 > or something. > > When I click on Entity Engine Maintenance, the entity list comes up > instantly in 9.04 and takes 12 seconds to render in 12.04. > > Although this customer does not use it, the home page in ecommerce comes up > instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing > that this is because of the different handling of catagories because part > of > the page comes up instantly.) > > > I have this service that processes the inventory with a > findListIteratorByCondition and does a few findByPrimaryKeys on the list, > then writes a text file (no entity engine calls). This service takes 11 > seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times > slower and this is entirely java code with no screen stuff. I also expect > that a significant portion of that time is in the disk io writing the the > text file, so I expect that the entity engine calls are something like 4 > times slower. > > This is on an 8 core machine with 64 gigs of memory and a really fast hard > disk array. > > I have the cache, debug and logging set the same. Both instances are using > the same postgres database except that the 12.04 is using postnew. Neither > instance has anything in the log at the conclusing, and both produce > exactly > the same results. > > Both ofbiz instances are running Minerva. > > I am getting ready to run a profiler on this to see where the slowdown is, > but maybe I do not have a setting right for production. > > Am I missing something? > > Skip > > |
«
Return to OFBiz - User
|
1 view|%1 views
| Free forum by Nabble | Edit this page |