Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
21 messages Options
12
Reply | Threaded
Open this post in threaded view
|

Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
currently we are helping a customer to upgrade their ofbiz version.
We are using "Apache bench" to test the ecommerce frontend.

We now found that the current trunk is dramatically slower than rev
728596 from about 1.5 years ago.

the test results:
rev 728596:
total time : 34.667 seconds
Requests per second:    14.42 [#/sec]

trunk rev 959845
total time : 152.698 seconds
Requests per second:    3.27 [#/sec]

below the complete test results.

Help appreciated.

Regards,
Hans.


Test results, local compute ubuntu 10.04 java memory allocation max
2048Mb
running in background, cache enabled. (cache.properties)

command line:
ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main


rev 728596
-----------
Server Software:        Apache-Coyote/1.1
Server Hostname:        localhost
Server Port:            8080

Document Path:          /ecommerce/control/main
Document Length:        60531 bytes

Concurrency Level:      50
Time taken for tests:   34.667 seconds
Complete requests:      500
Failed requests:        496
   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
Write errors:           0
Total transferred:      30412908 bytes
HTML transferred:       30262908 bytes
Requests per second:    14.42 [#/sec] (mean)
Time per request:       3466.737 [ms] (mean)
Time per request:       69.335 [ms] (mean, across all concurrent
requests)
Transfer rate:          856.72 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0  198 745.6      0    3000
Processing:  1173 3239 778.2   3228    6287
Waiting:       40  433 318.7    357    1879
Total:       1173 3437 1287.7   3228    9287

rev 959845
===========
Server Software:        Apache-Coyote/1.1
Server Hostname:        localhost
Server Port:            8080

Document Path:          /ecommerce/control/main
Document Length:        65788 bytes

Concurrency Level:      50
Time taken for tests:   152.698 seconds
Complete requests:      500
Failed requests:        499
   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
Write errors:           0
Total transferred:      33189975 bytes
HTML transferred:       33039975 bytes
Requests per second:    3.27 [#/sec] (mean)
Time per request:       15269.837 [ms] (mean)
Time per request:       305.397 [ms] (mean, across all concurrent
requests)
Transfer rate:          212.26 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    2   6.6      0      30
Processing: 11504 15083 1122.0  15065   19496
Waiting:      214 1312 355.2   1294    2751
Total:      11504 15086 1123.5  15065   19497




--
Ofbiz on twitter: http://twitter.com/apache_ofbiz
Myself on twitter: http://twitter.com/hansbak
Antwebsystems.com: Quality services for competitive rates.

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
this problem about the speed is caused in rev: 731487:
Upgrade Freemarker jar from 2.3.10 to 2.3.15

Regards,
Hans

On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:

> currently we are helping a customer to upgrade their ofbiz version.
> We are using "Apache bench" to test the ecommerce frontend.
>
> We now found that the current trunk is dramatically slower than rev
> 728596 from about 1.5 years ago.
>
> the test results:
> rev 728596:
> total time : 34.667 seconds
> Requests per second:    14.42 [#/sec]
>
> trunk rev 959845
> total time : 152.698 seconds
> Requests per second:    3.27 [#/sec]
>
> below the complete test results.
>
> Help appreciated.
>
> Regards,
> Hans.
>
>
> Test results, local compute ubuntu 10.04 java memory allocation max
> 2048Mb
> running in background, cache enabled. (cache.properties)
>
> command line:
> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>
>
> rev 728596
> -----------
> Server Software:        Apache-Coyote/1.1
> Server Hostname:        localhost
> Server Port:            8080
>
> Document Path:          /ecommerce/control/main
> Document Length:        60531 bytes
>
> Concurrency Level:      50
> Time taken for tests:   34.667 seconds
> Complete requests:      500
> Failed requests:        496
>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
> Write errors:           0
> Total transferred:      30412908 bytes
> HTML transferred:       30262908 bytes
> Requests per second:    14.42 [#/sec] (mean)
> Time per request:       3466.737 [ms] (mean)
> Time per request:       69.335 [ms] (mean, across all concurrent
> requests)
> Transfer rate:          856.72 [Kbytes/sec] received
>
> Connection Times (ms)
>               min  mean[+/-sd] median   max
> Connect:        0  198 745.6      0    3000
> Processing:  1173 3239 778.2   3228    6287
> Waiting:       40  433 318.7    357    1879
> Total:       1173 3437 1287.7   3228    9287
>
> rev 959845
> ===========
> Server Software:        Apache-Coyote/1.1
> Server Hostname:        localhost
> Server Port:            8080
>
> Document Path:          /ecommerce/control/main
> Document Length:        65788 bytes
>
> Concurrency Level:      50
> Time taken for tests:   152.698 seconds
> Complete requests:      500
> Failed requests:        499
>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
> Write errors:           0
> Total transferred:      33189975 bytes
> HTML transferred:       33039975 bytes
> Requests per second:    3.27 [#/sec] (mean)
> Time per request:       15269.837 [ms] (mean)
> Time per request:       305.397 [ms] (mean, across all concurrent
> requests)
> Transfer rate:          212.26 [Kbytes/sec] received
>
> Connection Times (ms)
>               min  mean[+/-sd] median   max
> Connect:        0    2   6.6      0      30
> Processing: 11504 15083 1122.0  15065   19496
> Waiting:      214 1312 355.2   1294    2751
> Total:      11504 15086 1123.5  15065   19497
>
>
>
>

--
Ofbiz on twitter: http://twitter.com/apache_ofbiz
Myself on twitter: http://twitter.com/hansbak
Antwebsystems.com: Quality services for competitive rates.

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacques Le Roux
Administrator
I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.

Jacques

Hans Bakker wrote:

> this problem about the speed is caused in rev: 731487:
> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>
> Regards,
> Hans
>
> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>> currently we are helping a customer to upgrade their ofbiz version.
>> We are using "Apache bench" to test the ecommerce frontend.
>>
>> We now found that the current trunk is dramatically slower than rev
>> 728596 from about 1.5 years ago.
>>
>> the test results:
>> rev 728596:
>> total time : 34.667 seconds
>> Requests per second:    14.42 [#/sec]
>>
>> trunk rev 959845
>> total time : 152.698 seconds
>> Requests per second:    3.27 [#/sec]
>>
>> below the complete test results.
>>
>> Help appreciated.
>>
>> Regards,
>> Hans.
>>
>>
>> Test results, local compute ubuntu 10.04 java memory allocation max
>> 2048Mb
>> running in background, cache enabled. (cache.properties)
>>
>> command line:
>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>
>>
>> rev 728596
>> -----------
>> Server Software:        Apache-Coyote/1.1
>> Server Hostname:        localhost
>> Server Port:            8080
>>
>> Document Path:          /ecommerce/control/main
>> Document Length:        60531 bytes
>>
>> Concurrency Level:      50
>> Time taken for tests:   34.667 seconds
>> Complete requests:      500
>> Failed requests:        496
>>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>> Write errors:           0
>> Total transferred:      30412908 bytes
>> HTML transferred:       30262908 bytes
>> Requests per second:    14.42 [#/sec] (mean)
>> Time per request:       3466.737 [ms] (mean)
>> Time per request:       69.335 [ms] (mean, across all concurrent
>> requests)
>> Transfer rate:          856.72 [Kbytes/sec] received
>>
>> Connection Times (ms)
>>               min  mean[+/-sd] median   max
>> Connect:        0  198 745.6      0    3000
>> Processing:  1173 3239 778.2   3228    6287
>> Waiting:       40  433 318.7    357    1879
>> Total:       1173 3437 1287.7   3228    9287
>>
>> rev 959845
>> ===========
>> Server Software:        Apache-Coyote/1.1
>> Server Hostname:        localhost
>> Server Port:            8080
>>
>> Document Path:          /ecommerce/control/main
>> Document Length:        65788 bytes
>>
>> Concurrency Level:      50
>> Time taken for tests:   152.698 seconds
>> Complete requests:      500
>> Failed requests:        499
>>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>> Write errors:           0
>> Total transferred:      33189975 bytes
>> HTML transferred:       33039975 bytes
>> Requests per second:    3.27 [#/sec] (mean)
>> Time per request:       15269.837 [ms] (mean)
>> Time per request:       305.397 [ms] (mean, across all concurrent
>> requests)
>> Transfer rate:          212.26 [Kbytes/sec] received
>>
>> Connection Times (ms)
>>               min  mean[+/-sd] median   max
>> Connect:        0    2   6.6      0      30
>> Processing: 11504 15083 1122.0  15065   19496
>> Waiting:      214 1312 355.2   1294    2751
>> Total:      11504 15086 1123.5  15065   19497

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
We tried the newer version but is also slow.
we are are now looking into moving back to the 2.3.10 version.

Regards,
Hans

On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:

> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>
> Jacques
>
> Hans Bakker wrote:
> > this problem about the speed is caused in rev: 731487:
> > Upgrade Freemarker jar from 2.3.10 to 2.3.15
> >
> > Regards,
> > Hans
> >
> > On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
> >> currently we are helping a customer to upgrade their ofbiz version.
> >> We are using "Apache bench" to test the ecommerce frontend.
> >>
> >> We now found that the current trunk is dramatically slower than rev
> >> 728596 from about 1.5 years ago.
> >>
> >> the test results:
> >> rev 728596:
> >> total time : 34.667 seconds
> >> Requests per second:    14.42 [#/sec]
> >>
> >> trunk rev 959845
> >> total time : 152.698 seconds
> >> Requests per second:    3.27 [#/sec]
> >>
> >> below the complete test results.
> >>
> >> Help appreciated.
> >>
> >> Regards,
> >> Hans.
> >>
> >>
> >> Test results, local compute ubuntu 10.04 java memory allocation max
> >> 2048Mb
> >> running in background, cache enabled. (cache.properties)
> >>
> >> command line:
> >> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
> >>
> >>
> >> rev 728596
> >> -----------
> >> Server Software:        Apache-Coyote/1.1
> >> Server Hostname:        localhost
> >> Server Port:            8080
> >>
> >> Document Path:          /ecommerce/control/main
> >> Document Length:        60531 bytes
> >>
> >> Concurrency Level:      50
> >> Time taken for tests:   34.667 seconds
> >> Complete requests:      500
> >> Failed requests:        496
> >>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
> >> Write errors:           0
> >> Total transferred:      30412908 bytes
> >> HTML transferred:       30262908 bytes
> >> Requests per second:    14.42 [#/sec] (mean)
> >> Time per request:       3466.737 [ms] (mean)
> >> Time per request:       69.335 [ms] (mean, across all concurrent
> >> requests)
> >> Transfer rate:          856.72 [Kbytes/sec] received
> >>
> >> Connection Times (ms)
> >>               min  mean[+/-sd] median   max
> >> Connect:        0  198 745.6      0    3000
> >> Processing:  1173 3239 778.2   3228    6287
> >> Waiting:       40  433 318.7    357    1879
> >> Total:       1173 3437 1287.7   3228    9287
> >>
> >> rev 959845
> >> ===========
> >> Server Software:        Apache-Coyote/1.1
> >> Server Hostname:        localhost
> >> Server Port:            8080
> >>
> >> Document Path:          /ecommerce/control/main
> >> Document Length:        65788 bytes
> >>
> >> Concurrency Level:      50
> >> Time taken for tests:   152.698 seconds
> >> Complete requests:      500
> >> Failed requests:        499
> >>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
> >> Write errors:           0
> >> Total transferred:      33189975 bytes
> >> HTML transferred:       33039975 bytes
> >> Requests per second:    3.27 [#/sec] (mean)
> >> Time per request:       15269.837 [ms] (mean)
> >> Time per request:       305.397 [ms] (mean, across all concurrent
> >> requests)
> >> Transfer rate:          212.26 [Kbytes/sec] received
> >>
> >> Connection Times (ms)
> >>               min  mean[+/-sd] median   max
> >> Connect:        0    2   6.6      0      30
> >> Processing: 11504 15083 1122.0  15065   19496
> >> Waiting:      214 1312 355.2   1294    2751
> >> Total:      11504 15086 1123.5  15065   19497
>

--
Ofbiz on twitter: http://twitter.com/apache_ofbiz
Myself on twitter: http://twitter.com/hansbak
Antwebsystems.com: Quality services for competitive rates.

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Scott Gray-2
Hi Hans,

If you have time it would be great if you could try out some of the versions between 2.3.10 and 2.3.15 in order to help pin down exactly which release is giving us trouble.  If we know which one it is then the problematic changes will be much easier to track down.

Regards
Scott

HotWax Media
http://www.hotwaxmedia.com

On 16/08/2010, at 8:58 PM, Hans Bakker wrote:

> We tried the newer version but is also slow.
> we are are now looking into moving back to the 2.3.10 version.
>
> Regards,
> Hans
>
> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>
>> Jacques
>>
>> Hans Bakker wrote:
>>> this problem about the speed is caused in rev: 731487:
>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>
>>> Regards,
>>> Hans
>>>
>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>
>>>> We now found that the current trunk is dramatically slower than rev
>>>> 728596 from about 1.5 years ago.
>>>>
>>>> the test results:
>>>> rev 728596:
>>>> total time : 34.667 seconds
>>>> Requests per second:    14.42 [#/sec]
>>>>
>>>> trunk rev 959845
>>>> total time : 152.698 seconds
>>>> Requests per second:    3.27 [#/sec]
>>>>
>>>> below the complete test results.
>>>>
>>>> Help appreciated.
>>>>
>>>> Regards,
>>>> Hans.
>>>>
>>>>
>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>> 2048Mb
>>>> running in background, cache enabled. (cache.properties)
>>>>
>>>> command line:
>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>
>>>>
>>>> rev 728596
>>>> -----------
>>>> Server Software:        Apache-Coyote/1.1
>>>> Server Hostname:        localhost
>>>> Server Port:            8080
>>>>
>>>> Document Path:          /ecommerce/control/main
>>>> Document Length:        60531 bytes
>>>>
>>>> Concurrency Level:      50
>>>> Time taken for tests:   34.667 seconds
>>>> Complete requests:      500
>>>> Failed requests:        496
>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>> Write errors:           0
>>>> Total transferred:      30412908 bytes
>>>> HTML transferred:       30262908 bytes
>>>> Requests per second:    14.42 [#/sec] (mean)
>>>> Time per request:       3466.737 [ms] (mean)
>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>> requests)
>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>
>>>> Connection Times (ms)
>>>>              min  mean[+/-sd] median   max
>>>> Connect:        0  198 745.6      0    3000
>>>> Processing:  1173 3239 778.2   3228    6287
>>>> Waiting:       40  433 318.7    357    1879
>>>> Total:       1173 3437 1287.7   3228    9287
>>>>
>>>> rev 959845
>>>> ===========
>>>> Server Software:        Apache-Coyote/1.1
>>>> Server Hostname:        localhost
>>>> Server Port:            8080
>>>>
>>>> Document Path:          /ecommerce/control/main
>>>> Document Length:        65788 bytes
>>>>
>>>> Concurrency Level:      50
>>>> Time taken for tests:   152.698 seconds
>>>> Complete requests:      500
>>>> Failed requests:        499
>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>> Write errors:           0
>>>> Total transferred:      33189975 bytes
>>>> HTML transferred:       33039975 bytes
>>>> Requests per second:    3.27 [#/sec] (mean)
>>>> Time per request:       15269.837 [ms] (mean)
>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>> requests)
>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>
>>>> Connection Times (ms)
>>>>              min  mean[+/-sd] median   max
>>>> Connect:        0    2   6.6      0      30
>>>> Processing: 11504 15083 1122.0  15065   19496
>>>> Waiting:      214 1312 355.2   1294    2751
>>>> Total:      11504 15086 1123.5  15065   19497
>>
>
> --
> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> Myself on twitter: http://twitter.com/hansbak
> Antwebsystems.com: Quality services for competitive rates.
>


smime.p7s (3K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Chatree Srichart
After I tested Freemarker's versions between 2.3.10 and 2.3.15. I got result
like this:

   - For Version 2.3.14, I have to check null value before call
   DeepUnwrap.unwrap() method in CatalogUrlDirective.java. And got " Time taken
   for tests: 176.806 seconds".
   - For Version 2.3.13, I have to check null value before call
   DeepUnwrap.unwrap() method in CatalogUrlDirective.java. And got " Time taken
   for tests: 96.021 :  seconds".
   - For Version 2.3.12 and 2.3.11, Can not compile
component://widget/templates/htmlFormMacroLibrary.ftl
   file. I got error:


  Caused by: freemarker.core.ParseException: Error on line 457, column 30,
in template component://widget/templates/htmlFormMacroLibrary.ftl

Found floor, expecting one of: chunk, is_date, last, root, j_string,
contains, is_hash, long, float, ends_with, namespace, matches, time, values,
seq_last_index_of, uncap_first, byte, substring, is_transform, web_safe,
groups, seq_contains, is_macro, index_of, word_list, int, is_method, eval,
parent, xml, number, capitalize, if_exists, rtf, node_type, double,
is_directive, url, size, default, is_boolean, split, node_name,
is_enumerable, seq_index_of, is_sequence, sort, is_node, sort_by, left_pad,
cap_first, interpret, children, node_namespace, chop_linebreak, date, short,
last_index_of, is_collection, ancestors, length, trim, datetime, is_string,
reverse, c, keys, upper_case, js_string, has_content, right_pad, replace,
is_hash_ex, new, is_number, is_indexable, lower_case, string, exists, html,
first, starts_with

at freemarker.core.BuiltIn.newBuiltIn(BuiltIn.java:196)


Regards,

Chatree Srichart
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Mike Z
In reply to this post by hans_bakker
Any update on this?  Thanks.

On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
<[hidden email]> wrote:

> We tried the newer version but is also slow.
> we are are now looking into moving back to the 2.3.10 version.
>
> Regards,
> Hans
>
> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>
>> Jacques
>>
>> Hans Bakker wrote:
>> > this problem about the speed is caused in rev: 731487:
>> > Upgrade Freemarker jar from 2.3.10 to 2.3.15
>> >
>> > Regards,
>> > Hans
>> >
>> > On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>> >> currently we are helping a customer to upgrade their ofbiz version.
>> >> We are using "Apache bench" to test the ecommerce frontend.
>> >>
>> >> We now found that the current trunk is dramatically slower than rev
>> >> 728596 from about 1.5 years ago.
>> >>
>> >> the test results:
>> >> rev 728596:
>> >> total time : 34.667 seconds
>> >> Requests per second:    14.42 [#/sec]
>> >>
>> >> trunk rev 959845
>> >> total time : 152.698 seconds
>> >> Requests per second:    3.27 [#/sec]
>> >>
>> >> below the complete test results.
>> >>
>> >> Help appreciated.
>> >>
>> >> Regards,
>> >> Hans.
>> >>
>> >>
>> >> Test results, local compute ubuntu 10.04 java memory allocation max
>> >> 2048Mb
>> >> running in background, cache enabled. (cache.properties)
>> >>
>> >> command line:
>> >> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>> >>
>> >>
>> >> rev 728596
>> >> -----------
>> >> Server Software:        Apache-Coyote/1.1
>> >> Server Hostname:        localhost
>> >> Server Port:            8080
>> >>
>> >> Document Path:          /ecommerce/control/main
>> >> Document Length:        60531 bytes
>> >>
>> >> Concurrency Level:      50
>> >> Time taken for tests:   34.667 seconds
>> >> Complete requests:      500
>> >> Failed requests:        496
>> >>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>> >> Write errors:           0
>> >> Total transferred:      30412908 bytes
>> >> HTML transferred:       30262908 bytes
>> >> Requests per second:    14.42 [#/sec] (mean)
>> >> Time per request:       3466.737 [ms] (mean)
>> >> Time per request:       69.335 [ms] (mean, across all concurrent
>> >> requests)
>> >> Transfer rate:          856.72 [Kbytes/sec] received
>> >>
>> >> Connection Times (ms)
>> >>               min  mean[+/-sd] median   max
>> >> Connect:        0  198 745.6      0    3000
>> >> Processing:  1173 3239 778.2   3228    6287
>> >> Waiting:       40  433 318.7    357    1879
>> >> Total:       1173 3437 1287.7   3228    9287
>> >>
>> >> rev 959845
>> >> ===========
>> >> Server Software:        Apache-Coyote/1.1
>> >> Server Hostname:        localhost
>> >> Server Port:            8080
>> >>
>> >> Document Path:          /ecommerce/control/main
>> >> Document Length:        65788 bytes
>> >>
>> >> Concurrency Level:      50
>> >> Time taken for tests:   152.698 seconds
>> >> Complete requests:      500
>> >> Failed requests:        499
>> >>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>> >> Write errors:           0
>> >> Total transferred:      33189975 bytes
>> >> HTML transferred:       33039975 bytes
>> >> Requests per second:    3.27 [#/sec] (mean)
>> >> Time per request:       15269.837 [ms] (mean)
>> >> Time per request:       305.397 [ms] (mean, across all concurrent
>> >> requests)
>> >> Transfer rate:          212.26 [Kbytes/sec] received
>> >>
>> >> Connection Times (ms)
>> >>               min  mean[+/-sd] median   max
>> >> Connect:        0    2   6.6      0      30
>> >> Processing: 11504 15083 1122.0  15065   19496
>> >> Waiting:      214 1312 355.2   1294    2751
>> >> Total:      11504 15086 1123.5  15065   19497
>>
>
> --
> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> Myself on twitter: http://twitter.com/hansbak
> Antwebsystems.com: Quality services for competitive rates.
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacques Le Roux
Administrator
http://svn.apache.org/viewvc?view=revision&revision=986577

Jacques

From: "Mike Z" <[hidden email]>

> Any update on this?  Thanks.
>
> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
> <[hidden email]> wrote:
>> We tried the newer version but is also slow.
>> we are are now looking into moving back to the 2.3.10 version.
>>
>> Regards,
>> Hans
>>
>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>
>>> Jacques
>>>
>>> Hans Bakker wrote:
>>> > this problem about the speed is caused in rev: 731487:
>>> > Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>> >
>>> > Regards,
>>> > Hans
>>> >
>>> > On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>> >> currently we are helping a customer to upgrade their ofbiz version.
>>> >> We are using "Apache bench" to test the ecommerce frontend.
>>> >>
>>> >> We now found that the current trunk is dramatically slower than rev
>>> >> 728596 from about 1.5 years ago.
>>> >>
>>> >> the test results:
>>> >> rev 728596:
>>> >> total time : 34.667 seconds
>>> >> Requests per second: 14.42 [#/sec]
>>> >>
>>> >> trunk rev 959845
>>> >> total time : 152.698 seconds
>>> >> Requests per second: 3.27 [#/sec]
>>> >>
>>> >> below the complete test results.
>>> >>
>>> >> Help appreciated.
>>> >>
>>> >> Regards,
>>> >> Hans.
>>> >>
>>> >>
>>> >> Test results, local compute ubuntu 10.04 java memory allocation max
>>> >> 2048Mb
>>> >> running in background, cache enabled. (cache.properties)
>>> >>
>>> >> command line:
>>> >> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>> >>
>>> >>
>>> >> rev 728596
>>> >> -----------
>>> >> Server Software: Apache-Coyote/1.1
>>> >> Server Hostname: localhost
>>> >> Server Port: 8080
>>> >>
>>> >> Document Path: /ecommerce/control/main
>>> >> Document Length: 60531 bytes
>>> >>
>>> >> Concurrency Level: 50
>>> >> Time taken for tests: 34.667 seconds
>>> >> Complete requests: 500
>>> >> Failed requests: 496
>>> >> (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>> >> Write errors: 0
>>> >> Total transferred: 30412908 bytes
>>> >> HTML transferred: 30262908 bytes
>>> >> Requests per second: 14.42 [#/sec] (mean)
>>> >> Time per request: 3466.737 [ms] (mean)
>>> >> Time per request: 69.335 [ms] (mean, across all concurrent
>>> >> requests)
>>> >> Transfer rate: 856.72 [Kbytes/sec] received
>>> >>
>>> >> Connection Times (ms)
>>> >> min mean[+/-sd] median max
>>> >> Connect: 0 198 745.6 0 3000
>>> >> Processing: 1173 3239 778.2 3228 6287
>>> >> Waiting: 40 433 318.7 357 1879
>>> >> Total: 1173 3437 1287.7 3228 9287
>>> >>
>>> >> rev 959845
>>> >> ===========
>>> >> Server Software: Apache-Coyote/1.1
>>> >> Server Hostname: localhost
>>> >> Server Port: 8080
>>> >>
>>> >> Document Path: /ecommerce/control/main
>>> >> Document Length: 65788 bytes
>>> >>
>>> >> Concurrency Level: 50
>>> >> Time taken for tests: 152.698 seconds
>>> >> Complete requests: 500
>>> >> Failed requests: 499
>>> >> (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>> >> Write errors: 0
>>> >> Total transferred: 33189975 bytes
>>> >> HTML transferred: 33039975 bytes
>>> >> Requests per second: 3.27 [#/sec] (mean)
>>> >> Time per request: 15269.837 [ms] (mean)
>>> >> Time per request: 305.397 [ms] (mean, across all concurrent
>>> >> requests)
>>> >> Transfer rate: 212.26 [Kbytes/sec] received
>>> >>
>>> >> Connection Times (ms)
>>> >> min mean[+/-sd] median max
>>> >> Connect: 0 2 6.6 0 30
>>> >> Processing: 11504 15083 1122.0 15065 19496
>>> >> Waiting: 214 1312 355.2 1294 2751
>>> >> Total: 11504 15086 1123.5 15065 19497
>>>
>>
>> --
>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>> Myself on twitter: http://twitter.com/hansbak
>> Antwebsystems.com: Quality services for competitive rates.
>>
>>
>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
In reply to this post by Mike Z
We are sill working on this to optimize the cache so the newest
freemarker will work again.

Regards
Hans

On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:

> Any update on this?  Thanks.
>
> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
> <[hidden email]> wrote:
> > We tried the newer version but is also slow.
> > we are are now looking into moving back to the 2.3.10 version.
> >
> > Regards,
> > Hans
> >
> > On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
> >> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
> >> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
> >>
> >> Jacques
> >>
> >> Hans Bakker wrote:
> >> > this problem about the speed is caused in rev: 731487:
> >> > Upgrade Freemarker jar from 2.3.10 to 2.3.15
> >> >
> >> > Regards,
> >> > Hans
> >> >
> >> > On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
> >> >> currently we are helping a customer to upgrade their ofbiz version.
> >> >> We are using "Apache bench" to test the ecommerce frontend.
> >> >>
> >> >> We now found that the current trunk is dramatically slower than rev
> >> >> 728596 from about 1.5 years ago.
> >> >>
> >> >> the test results:
> >> >> rev 728596:
> >> >> total time : 34.667 seconds
> >> >> Requests per second:    14.42 [#/sec]
> >> >>
> >> >> trunk rev 959845
> >> >> total time : 152.698 seconds
> >> >> Requests per second:    3.27 [#/sec]
> >> >>
> >> >> below the complete test results.
> >> >>
> >> >> Help appreciated.
> >> >>
> >> >> Regards,
> >> >> Hans.
> >> >>
> >> >>
> >> >> Test results, local compute ubuntu 10.04 java memory allocation max
> >> >> 2048Mb
> >> >> running in background, cache enabled. (cache.properties)
> >> >>
> >> >> command line:
> >> >> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
> >> >>
> >> >>
> >> >> rev 728596
> >> >> -----------
> >> >> Server Software:        Apache-Coyote/1.1
> >> >> Server Hostname:        localhost
> >> >> Server Port:            8080
> >> >>
> >> >> Document Path:          /ecommerce/control/main
> >> >> Document Length:        60531 bytes
> >> >>
> >> >> Concurrency Level:      50
> >> >> Time taken for tests:   34.667 seconds
> >> >> Complete requests:      500
> >> >> Failed requests:        496
> >> >>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
> >> >> Write errors:           0
> >> >> Total transferred:      30412908 bytes
> >> >> HTML transferred:       30262908 bytes
> >> >> Requests per second:    14.42 [#/sec] (mean)
> >> >> Time per request:       3466.737 [ms] (mean)
> >> >> Time per request:       69.335 [ms] (mean, across all concurrent
> >> >> requests)
> >> >> Transfer rate:          856.72 [Kbytes/sec] received
> >> >>
> >> >> Connection Times (ms)
> >> >>               min  mean[+/-sd] median   max
> >> >> Connect:        0  198 745.6      0    3000
> >> >> Processing:  1173 3239 778.2   3228    6287
> >> >> Waiting:       40  433 318.7    357    1879
> >> >> Total:       1173 3437 1287.7   3228    9287
> >> >>
> >> >> rev 959845
> >> >> ===========
> >> >> Server Software:        Apache-Coyote/1.1
> >> >> Server Hostname:        localhost
> >> >> Server Port:            8080
> >> >>
> >> >> Document Path:          /ecommerce/control/main
> >> >> Document Length:        65788 bytes
> >> >>
> >> >> Concurrency Level:      50
> >> >> Time taken for tests:   152.698 seconds
> >> >> Complete requests:      500
> >> >> Failed requests:        499
> >> >>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
> >> >> Write errors:           0
> >> >> Total transferred:      33189975 bytes
> >> >> HTML transferred:       33039975 bytes
> >> >> Requests per second:    3.27 [#/sec] (mean)
> >> >> Time per request:       15269.837 [ms] (mean)
> >> >> Time per request:       305.397 [ms] (mean, across all concurrent
> >> >> requests)
> >> >> Transfer rate:          212.26 [Kbytes/sec] received
> >> >>
> >> >> Connection Times (ms)
> >> >>               min  mean[+/-sd] median   max
> >> >> Connect:        0    2   6.6      0      30
> >> >> Processing: 11504 15083 1122.0  15065   19496
> >> >> Waiting:      214 1312 355.2   1294    2751
> >> >> Total:      11504 15086 1123.5  15065   19497
> >>
> >
> > --
> > Ofbiz on twitter: http://twitter.com/apache_ofbiz
> > Myself on twitter: http://twitter.com/hansbak
> > Antwebsystems.com: Quality services for competitive rates.
> >
> >

--
Ofbiz on twitter: http://twitter.com/apache_ofbiz
Myself on twitter: http://twitter.com/hansbak
Antwebsystems.com: Quality services for competitive rates.

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacopo Cappellato-4
An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:

https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794

Now I am working with them to see if my change can be made official and released.

Jacopo

On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:

> We are sill working on this to optimize the cache so the newest
> freemarker will work again.
>
> Regards
> Hans
>
> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>> Any update on this?  Thanks.
>>
>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>> <[hidden email]> wrote:
>>> We tried the newer version but is also slow.
>>> we are are now looking into moving back to the 2.3.10 version.
>>>
>>> Regards,
>>> Hans
>>>
>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>
>>>> Jacques
>>>>
>>>> Hans Bakker wrote:
>>>>> this problem about the speed is caused in rev: 731487:
>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>
>>>>> Regards,
>>>>> Hans
>>>>>
>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>
>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>> 728596 from about 1.5 years ago.
>>>>>>
>>>>>> the test results:
>>>>>> rev 728596:
>>>>>> total time : 34.667 seconds
>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>
>>>>>> trunk rev 959845
>>>>>> total time : 152.698 seconds
>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>
>>>>>> below the complete test results.
>>>>>>
>>>>>> Help appreciated.
>>>>>>
>>>>>> Regards,
>>>>>> Hans.
>>>>>>
>>>>>>
>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>> 2048Mb
>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>
>>>>>> command line:
>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>
>>>>>>
>>>>>> rev 728596
>>>>>> -----------
>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>> Server Hostname:        localhost
>>>>>> Server Port:            8080
>>>>>>
>>>>>> Document Path:          /ecommerce/control/main
>>>>>> Document Length:        60531 bytes
>>>>>>
>>>>>> Concurrency Level:      50
>>>>>> Time taken for tests:   34.667 seconds
>>>>>> Complete requests:      500
>>>>>> Failed requests:        496
>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>> Write errors:           0
>>>>>> Total transferred:      30412908 bytes
>>>>>> HTML transferred:       30262908 bytes
>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>> requests)
>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>
>>>>>> Connection Times (ms)
>>>>>>              min  mean[+/-sd] median   max
>>>>>> Connect:        0  198 745.6      0    3000
>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>
>>>>>> rev 959845
>>>>>> ===========
>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>> Server Hostname:        localhost
>>>>>> Server Port:            8080
>>>>>>
>>>>>> Document Path:          /ecommerce/control/main
>>>>>> Document Length:        65788 bytes
>>>>>>
>>>>>> Concurrency Level:      50
>>>>>> Time taken for tests:   152.698 seconds
>>>>>> Complete requests:      500
>>>>>> Failed requests:        499
>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>> Write errors:           0
>>>>>> Total transferred:      33189975 bytes
>>>>>> HTML transferred:       33039975 bytes
>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>> requests)
>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>
>>>>>> Connection Times (ms)
>>>>>>              min  mean[+/-sd] median   max
>>>>>> Connect:        0    2   6.6      0      30
>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>
>>>
>>> --
>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>> Myself on twitter: http://twitter.com/hansbak
>>> Antwebsystems.com: Quality services for competitive rates.
>>>
>>>
>
> --
> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> Myself on twitter: http://twitter.com/hansbak
> Antwebsystems.com: Quality services for competitive rates.
>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
Very impressive Jacopo: good Job.

see what the developers of freemarker say.....

Regards,
Hans

On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:

> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>
> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>
> Now I am working with them to see if my change can be made official and released.
>
> Jacopo
>
> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>
>> We are sill working on this to optimize the cache so the newest
>> freemarker will work again.
>>
>> Regards
>> Hans
>>
>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>> Any update on this?  Thanks.
>>>
>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>> <[hidden email]>  wrote:
>>>> We tried the newer version but is also slow.
>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>
>>>> Regards,
>>>> Hans
>>>>
>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>
>>>>> Jacques
>>>>>
>>>>> Hans Bakker wrote:
>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>
>>>>>> Regards,
>>>>>> Hans
>>>>>>
>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>
>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>
>>>>>>> the test results:
>>>>>>> rev 728596:
>>>>>>> total time : 34.667 seconds
>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>
>>>>>>> trunk rev 959845
>>>>>>> total time : 152.698 seconds
>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>
>>>>>>> below the complete test results.
>>>>>>>
>>>>>>> Help appreciated.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Hans.
>>>>>>>
>>>>>>>
>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>> 2048Mb
>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>
>>>>>>> command line:
>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>
>>>>>>>
>>>>>>> rev 728596
>>>>>>> -----------
>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>> Server Hostname:        localhost
>>>>>>> Server Port:            8080
>>>>>>>
>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>> Document Length:        60531 bytes
>>>>>>>
>>>>>>> Concurrency Level:      50
>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>> Complete requests:      500
>>>>>>> Failed requests:        496
>>>>>>>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>> Write errors:           0
>>>>>>> Total transferred:      30412908 bytes
>>>>>>> HTML transferred:       30262908 bytes
>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>> requests)
>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>
>>>>>>> Connection Times (ms)
>>>>>>>               min  mean[+/-sd] median   max
>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>
>>>>>>> rev 959845
>>>>>>> ===========
>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>> Server Hostname:        localhost
>>>>>>> Server Port:            8080
>>>>>>>
>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>> Document Length:        65788 bytes
>>>>>>>
>>>>>>> Concurrency Level:      50
>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>> Complete requests:      500
>>>>>>> Failed requests:        499
>>>>>>>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>> Write errors:           0
>>>>>>> Total transferred:      33189975 bytes
>>>>>>> HTML transferred:       33039975 bytes
>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>> requests)
>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>
>>>>>>> Connection Times (ms)
>>>>>>>               min  mean[+/-sd] median   max
>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>> --
>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>> Myself on twitter: http://twitter.com/hansbak
>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>
>>>>
>> --
>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>> Myself on twitter: http://twitter.com/hansbak
>> Antwebsystems.com: Quality services for competitive rates.
>>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacopo Cappellato-4
Thank you Hans,

I had to actually spend a lot of time to fix it.
But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in freemarker classes.
I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker (2.3.19).
The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times each:

with 2.3.10

Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)

with 2.3.19

Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)

The new version is slightly faster now.

Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we will have to start the migration to directives: having one in place will definitely help.

Thanks,

Jacopo


On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:

> Very impressive Jacopo: good Job.
>
> see what the developers of freemarker say.....
>
> Regards,
> Hans
>
> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>
>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>
>> Now I am working with them to see if my change can be made official and released.
>>
>> Jacopo
>>
>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>
>>> We are sill working on this to optimize the cache so the newest
>>> freemarker will work again.
>>>
>>> Regards
>>> Hans
>>>
>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>> Any update on this?  Thanks.
>>>>
>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>> <[hidden email]>  wrote:
>>>>> We tried the newer version but is also slow.
>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>
>>>>> Regards,
>>>>> Hans
>>>>>
>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>
>>>>>> Jacques
>>>>>>
>>>>>> Hans Bakker wrote:
>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>
>>>>>>> Regards,
>>>>>>> Hans
>>>>>>>
>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>
>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>
>>>>>>>> the test results:
>>>>>>>> rev 728596:
>>>>>>>> total time : 34.667 seconds
>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>
>>>>>>>> trunk rev 959845
>>>>>>>> total time : 152.698 seconds
>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>
>>>>>>>> below the complete test results.
>>>>>>>>
>>>>>>>> Help appreciated.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Hans.
>>>>>>>>
>>>>>>>>
>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>> 2048Mb
>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>
>>>>>>>> command line:
>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>
>>>>>>>>
>>>>>>>> rev 728596
>>>>>>>> -----------
>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>> Server Hostname:        localhost
>>>>>>>> Server Port:            8080
>>>>>>>>
>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>> Document Length:        60531 bytes
>>>>>>>>
>>>>>>>> Concurrency Level:      50
>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>> Complete requests:      500
>>>>>>>> Failed requests:        496
>>>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>> Write errors:           0
>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>> requests)
>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>
>>>>>>>> Connection Times (ms)
>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>
>>>>>>>> rev 959845
>>>>>>>> ===========
>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>> Server Hostname:        localhost
>>>>>>>> Server Port:            8080
>>>>>>>>
>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>> Document Length:        65788 bytes
>>>>>>>>
>>>>>>>> Concurrency Level:      50
>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>> Complete requests:      500
>>>>>>>> Failed requests:        499
>>>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>> Write errors:           0
>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>> requests)
>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>
>>>>>>>> Connection Times (ms)
>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>> --
>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>
>>>>>
>>> --
>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>> Myself on twitter: http://twitter.com/hansbak
>>> Antwebsystems.com: Quality services for competitive rates.
>>>
>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacques Le Roux
Administrator
Well done!

Thanks Jacopo

Jacques

From: "Jacopo Cappellato" <[hidden email]>

> Thank you Hans,
>
> I had to actually spend a lot of time to fix it.
> But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in
> freemarker classes.
> I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker
> (2.3.19).
> The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times
> each:
>
> with 2.3.10
>
> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)
>
> with 2.3.19
>
> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)
>
> The new version is slightly faster now.
>
> Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back
> the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we
> will have to start the migration to directives: having one in place will definitely help.
>
> Thanks,
>
> Jacopo
>
>
> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>
>> Very impressive Jacopo: good Job.
>>
>> see what the developers of freemarker say.....
>>
>> Regards,
>> Hans
>>
>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>>
>>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>
>>> Now I am working with them to see if my change can be made official and released.
>>>
>>> Jacopo
>>>
>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>
>>>> We are sill working on this to optimize the cache so the newest
>>>> freemarker will work again.
>>>>
>>>> Regards
>>>> Hans
>>>>
>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>> Any update on this?  Thanks.
>>>>>
>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>> <[hidden email]>  wrote:
>>>>>> We tried the newer version but is also slow.
>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>
>>>>>> Regards,
>>>>>> Hans
>>>>>>
>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>>
>>>>>>> Jacques
>>>>>>>
>>>>>>> Hans Bakker wrote:
>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Hans
>>>>>>>>
>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>
>>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>
>>>>>>>>> the test results:
>>>>>>>>> rev 728596:
>>>>>>>>> total time : 34.667 seconds
>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>
>>>>>>>>> trunk rev 959845
>>>>>>>>> total time : 152.698 seconds
>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>
>>>>>>>>> below the complete test results.
>>>>>>>>>
>>>>>>>>> Help appreciated.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Hans.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>>> 2048Mb
>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>
>>>>>>>>> command line:
>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> rev 728596
>>>>>>>>> -----------
>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>> Server Hostname:        localhost
>>>>>>>>> Server Port:            8080
>>>>>>>>>
>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>
>>>>>>>>> Concurrency Level:      50
>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>> Complete requests:      500
>>>>>>>>> Failed requests:        496
>>>>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>> Write errors:           0
>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>> requests)
>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>
>>>>>>>>> Connection Times (ms)
>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>
>>>>>>>>> rev 959845
>>>>>>>>> ===========
>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>> Server Hostname:        localhost
>>>>>>>>> Server Port:            8080
>>>>>>>>>
>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>
>>>>>>>>> Concurrency Level:      50
>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>> Complete requests:      500
>>>>>>>>> Failed requests:        499
>>>>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>> Write errors:           0
>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>> requests)
>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>
>>>>>>>>> Connection Times (ms)
>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>> --
>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>
>>>>>>
>>>> --
>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>> Myself on twitter: http://twitter.com/hansbak
>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>
>>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Mike Z
In reply to this post by Jacopo Cappellato-4
Hey Jacopo.   It looks as though the improvement in performance is due
mainly to a logging parameter change.  However, the original post indicated
a 4x performance deficit, which isn't really reflected in the below
statistics.

It's faster, but nowhere near 4x.  Is it possible to downgrade freemarker
to gain back performance?

On Mon, Apr 2, 2012 at 7:16 AM, Jacopo Cappellato <
[hidden email]> wrote:

> Thank you Hans,
>
> I had to actually spend a lot of time to fix it.
> But at the end it was not an issue in Freemarker but instead the problem
> was that we were not disabling debug messages in freemarker classes.
> I have fixed this by adding proper Log4J configuration and then I have
> upgraded to the latest stable release of freemarker (2.3.19).
> The performance looks good; I have executed (using JMeter) the main
> ecommerce screen with 50 threads hitting the page 100 times each:
>
> with 2.3.10
>
> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:
>  74 Max:  9307 Err:     0 (0.00%)
>
> with 2.3.19
>
> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:
>  88 Max:  8483 Err:     0 (0.00%)
>
> The new version is slightly faster now.
>
> Hans, could you now please revert the changes you did when you switched
> back to 2.3.10? I am especially interested in having back the catalog
> Directive (instead of the Transform) because in future versions of
> Freemarker Transforms will not be supported and we will have to start the
> migration to directives: having one in place will definitely help.
>
> Thanks,
>
> Jacopo
>
>
> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>
> > Very impressive Jacopo: good Job.
> >
> > see what the developers of freemarker say.....
> >
> > Regards,
> > Hans
> >
> > On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
> >> An update on this: I have found and resolved the issue that Hans
> reported on Freemarker bug tracker:
> >>
> >>
> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
> >>
> >> Now I am working with them to see if my change can be made official and
> released.
> >>
> >> Jacopo
> >>
> >> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
> >>
> >>> We are sill working on this to optimize the cache so the newest
> >>> freemarker will work again.
> >>>
> >>> Regards
> >>> Hans
> >>>
> >>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
> >>>> Any update on this?  Thanks.
> >>>>
> >>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
> >>>> <[hidden email]>  wrote:
> >>>>> We tried the newer version but is also slow.
> >>>>> we are are now looking into moving back to the 2.3.10 version.
> >>>>>
> >>>>> Regards,
> >>>>> Hans
> >>>>>
> >>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
> >>>>>> I found only that
> http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So
> nothing special.
> >>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem
> to bring much and 2.4 is not ready yet.
> >>>>>>
> >>>>>> Jacques
> >>>>>>
> >>>>>> Hans Bakker wrote:
> >>>>>>> this problem about the speed is caused in rev: 731487:
> >>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
> >>>>>>>
> >>>>>>> Regards,
> >>>>>>> Hans
> >>>>>>>
> >>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
> >>>>>>>> currently we are helping a customer to upgrade their ofbiz
> version.
> >>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
> >>>>>>>>
> >>>>>>>> We now found that the current trunk is dramatically slower than
> rev
> >>>>>>>> 728596 from about 1.5 years ago.
> >>>>>>>>
> >>>>>>>> the test results:
> >>>>>>>> rev 728596:
> >>>>>>>> total time : 34.667 seconds
> >>>>>>>> Requests per second:    14.42 [#/sec]
> >>>>>>>>
> >>>>>>>> trunk rev 959845
> >>>>>>>> total time : 152.698 seconds
> >>>>>>>> Requests per second:    3.27 [#/sec]
> >>>>>>>>
> >>>>>>>> below the complete test results.
> >>>>>>>>
> >>>>>>>> Help appreciated.
> >>>>>>>>
> >>>>>>>> Regards,
> >>>>>>>> Hans.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation
> max
> >>>>>>>> 2048Mb
> >>>>>>>> running in background, cache enabled. (cache.properties)
> >>>>>>>>
> >>>>>>>> command line:
> >>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> rev 728596
> >>>>>>>> -----------
> >>>>>>>> Server Software:        Apache-Coyote/1.1
> >>>>>>>> Server Hostname:        localhost
> >>>>>>>> Server Port:            8080
> >>>>>>>>
> >>>>>>>> Document Path:          /ecommerce/control/main
> >>>>>>>> Document Length:        60531 bytes
> >>>>>>>>
> >>>>>>>> Concurrency Level:      50
> >>>>>>>> Time taken for tests:   34.667 seconds
> >>>>>>>> Complete requests:      500
> >>>>>>>> Failed requests:        496
> >>>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
> >>>>>>>> Write errors:           0
> >>>>>>>> Total transferred:      30412908 bytes
> >>>>>>>> HTML transferred:       30262908 bytes
> >>>>>>>> Requests per second:    14.42 [#/sec] (mean)
> >>>>>>>> Time per request:       3466.737 [ms] (mean)
> >>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
> >>>>>>>> requests)
> >>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
> >>>>>>>>
> >>>>>>>> Connection Times (ms)
> >>>>>>>>              min  mean[+/-sd] median   max
> >>>>>>>> Connect:        0  198 745.6      0    3000
> >>>>>>>> Processing:  1173 3239 778.2   3228    6287
> >>>>>>>> Waiting:       40  433 318.7    357    1879
> >>>>>>>> Total:       1173 3437 1287.7   3228    9287
> >>>>>>>>
> >>>>>>>> rev 959845
> >>>>>>>> ===========
> >>>>>>>> Server Software:        Apache-Coyote/1.1
> >>>>>>>> Server Hostname:        localhost
> >>>>>>>> Server Port:            8080
> >>>>>>>>
> >>>>>>>> Document Path:          /ecommerce/control/main
> >>>>>>>> Document Length:        65788 bytes
> >>>>>>>>
> >>>>>>>> Concurrency Level:      50
> >>>>>>>> Time taken for tests:   152.698 seconds
> >>>>>>>> Complete requests:      500
> >>>>>>>> Failed requests:        499
> >>>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
> >>>>>>>> Write errors:           0
> >>>>>>>> Total transferred:      33189975 bytes
> >>>>>>>> HTML transferred:       33039975 bytes
> >>>>>>>> Requests per second:    3.27 [#/sec] (mean)
> >>>>>>>> Time per request:       15269.837 [ms] (mean)
> >>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
> >>>>>>>> requests)
> >>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
> >>>>>>>>
> >>>>>>>> Connection Times (ms)
> >>>>>>>>              min  mean[+/-sd] median   max
> >>>>>>>> Connect:        0    2   6.6      0      30
> >>>>>>>> Processing: 11504 15083 1122.0  15065   19496
> >>>>>>>> Waiting:      214 1312 355.2   1294    2751
> >>>>>>>> Total:      11504 15086 1123.5  15065   19497
> >>>>> --
> >>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> >>>>> Myself on twitter: http://twitter.com/hansbak
> >>>>> Antwebsystems.com: Quality services for competitive rates.
> >>>>>
> >>>>>
> >>> --
> >>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> >>> Myself on twitter: http://twitter.com/hansbak
> >>> Antwebsystems.com: Quality services for competitive rates.
> >>>
> >
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacopo Cappellato-4
Sorry, I don't understand

Jacopo

On Apr 2, 2012, at 7:14 PM, Mike wrote:

> Hey Jacopo.   It looks as though the improvement in performance is due
> mainly to a logging parameter change.  However, the original post indicated
> a 4x performance deficit, which isn't really reflected in the below
> statistics.
>
> It's faster, but nowhere near 4x.  Is it possible to downgrade freemarker
> to gain back performance?
>
> On Mon, Apr 2, 2012 at 7:16 AM, Jacopo Cappellato <
> [hidden email]> wrote:
>
>> Thank you Hans,
>>
>> I had to actually spend a lot of time to fix it.
>> But at the end it was not an issue in Freemarker but instead the problem
>> was that we were not disabling debug messages in freemarker classes.
>> I have fixed this by adding proper Log4J configuration and then I have
>> upgraded to the latest stable release of freemarker (2.3.19).
>> The performance looks good; I have executed (using JMeter) the main
>> ecommerce screen with 50 threads hitting the page 100 times each:
>>
>> with 2.3.10
>>
>> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:
>> 74 Max:  9307 Err:     0 (0.00%)
>>
>> with 2.3.19
>>
>> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:
>> 88 Max:  8483 Err:     0 (0.00%)
>>
>> The new version is slightly faster now.
>>
>> Hans, could you now please revert the changes you did when you switched
>> back to 2.3.10? I am especially interested in having back the catalog
>> Directive (instead of the Transform) because in future versions of
>> Freemarker Transforms will not be supported and we will have to start the
>> migration to directives: having one in place will definitely help.
>>
>> Thanks,
>>
>> Jacopo
>>
>>
>> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>>
>>> Very impressive Jacopo: good Job.
>>>
>>> see what the developers of freemarker say.....
>>>
>>> Regards,
>>> Hans
>>>
>>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>>> An update on this: I have found and resolved the issue that Hans
>> reported on Freemarker bug tracker:
>>>>
>>>>
>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>>
>>>> Now I am working with them to see if my change can be made official and
>> released.
>>>>
>>>> Jacopo
>>>>
>>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>>
>>>>> We are sill working on this to optimize the cache so the newest
>>>>> freemarker will work again.
>>>>>
>>>>> Regards
>>>>> Hans
>>>>>
>>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>>> Any update on this?  Thanks.
>>>>>>
>>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>>> <[hidden email]>  wrote:
>>>>>>> We tried the newer version but is also slow.
>>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Hans
>>>>>>>
>>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>>> I found only that
>> http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So
>> nothing special.
>>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem
>> to bring much and 2.4 is not ready yet.
>>>>>>>>
>>>>>>>> Jacques
>>>>>>>>
>>>>>>>> Hans Bakker wrote:
>>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Hans
>>>>>>>>>
>>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>>> currently we are helping a customer to upgrade their ofbiz
>> version.
>>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>>
>>>>>>>>>> We now found that the current trunk is dramatically slower than
>> rev
>>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>>
>>>>>>>>>> the test results:
>>>>>>>>>> rev 728596:
>>>>>>>>>> total time : 34.667 seconds
>>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>>
>>>>>>>>>> trunk rev 959845
>>>>>>>>>> total time : 152.698 seconds
>>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>>
>>>>>>>>>> below the complete test results.
>>>>>>>>>>
>>>>>>>>>> Help appreciated.
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Hans.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation
>> max
>>>>>>>>>> 2048Mb
>>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>>
>>>>>>>>>> command line:
>>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> rev 728596
>>>>>>>>>> -----------
>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>> Server Port:            8080
>>>>>>>>>>
>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>>
>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>>> Complete requests:      500
>>>>>>>>>> Failed requests:        496
>>>>>>>>>>  (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>>> Write errors:           0
>>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>>> requests)
>>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>>
>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>             min  mean[+/-sd] median   max
>>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>>
>>>>>>>>>> rev 959845
>>>>>>>>>> ===========
>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>> Server Port:            8080
>>>>>>>>>>
>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>>
>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>>> Complete requests:      500
>>>>>>>>>> Failed requests:        499
>>>>>>>>>>  (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>>> Write errors:           0
>>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>>> requests)
>>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>>
>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>             min  mean[+/-sd] median   max
>>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>>> --
>>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>>
>>>>>>>
>>>>> --
>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>
>>>
>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
In reply to this post by Jacopo Cappellato-4
Hi Jacopo,

it is just a single commit: r986577

now the footer has a problem in the trunk, and the speed problems seems
still a problem,
lets first wait until that is fixed?


Regards,
Hans

On 04/02/2012 09:16 PM, Jacopo Cappellato wrote:

> Thank you Hans,
>
> I had to actually spend a lot of time to fix it.
> But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in freemarker classes.
> I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker (2.3.19).
> The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times each:
>
> with 2.3.10
>
> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)
>
> with 2.3.19
>
> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)
>
> The new version is slightly faster now.
>
> Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we will have to start the migration to directives: having one in place will definitely help.
>
> Thanks,
>
> Jacopo
>
>
> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>
>> Very impressive Jacopo: good Job.
>>
>> see what the developers of freemarker say.....
>>
>> Regards,
>> Hans
>>
>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>>
>>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>
>>> Now I am working with them to see if my change can be made official and released.
>>>
>>> Jacopo
>>>
>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>
>>>> We are sill working on this to optimize the cache so the newest
>>>> freemarker will work again.
>>>>
>>>> Regards
>>>> Hans
>>>>
>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>> Any update on this?  Thanks.
>>>>>
>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>> <[hidden email]>   wrote:
>>>>>> We tried the newer version but is also slow.
>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>
>>>>>> Regards,
>>>>>> Hans
>>>>>>
>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>>
>>>>>>> Jacques
>>>>>>>
>>>>>>> Hans Bakker wrote:
>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Hans
>>>>>>>>
>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>
>>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>
>>>>>>>>> the test results:
>>>>>>>>> rev 728596:
>>>>>>>>> total time : 34.667 seconds
>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>
>>>>>>>>> trunk rev 959845
>>>>>>>>> total time : 152.698 seconds
>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>
>>>>>>>>> below the complete test results.
>>>>>>>>>
>>>>>>>>> Help appreciated.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Hans.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>>> 2048Mb
>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>
>>>>>>>>> command line:
>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> rev 728596
>>>>>>>>> -----------
>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>> Server Hostname:        localhost
>>>>>>>>> Server Port:            8080
>>>>>>>>>
>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>
>>>>>>>>> Concurrency Level:      50
>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>> Complete requests:      500
>>>>>>>>> Failed requests:        496
>>>>>>>>>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>> Write errors:           0
>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>> requests)
>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>
>>>>>>>>> Connection Times (ms)
>>>>>>>>>               min  mean[+/-sd] median   max
>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>
>>>>>>>>> rev 959845
>>>>>>>>> ===========
>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>> Server Hostname:        localhost
>>>>>>>>> Server Port:            8080
>>>>>>>>>
>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>
>>>>>>>>> Concurrency Level:      50
>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>> Complete requests:      500
>>>>>>>>> Failed requests:        499
>>>>>>>>>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>> Write errors:           0
>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>> requests)
>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>
>>>>>>>>> Connection Times (ms)
>>>>>>>>>               min  mean[+/-sd] median   max
>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>> --
>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>
>>>>>>
>>>> --
>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>> Myself on twitter: http://twitter.com/hansbak
>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Mike Z
In reply to this post by Jacopo Cappellato-4
Sorry Jacopo.  I misread your posted stats.  The numbers actually look
pretty good.

On Mon, Apr 2, 2012 at 10:20 AM, Jacopo Cappellato <
[hidden email]> wrote:

> Sorry, I don't understand
>
> Jacopo
>
> On Apr 2, 2012, at 7:14 PM, Mike wrote:
>
> > Hey Jacopo.   It looks as though the improvement in performance is due
> > mainly to a logging parameter change.  However, the original post
> indicated
> > a 4x performance deficit, which isn't really reflected in the below
> > statistics.
> >
> > It's faster, but nowhere near 4x.  Is it possible to downgrade freemarker
> > to gain back performance?
> >
> > On Mon, Apr 2, 2012 at 7:16 AM, Jacopo Cappellato <
> > [hidden email]> wrote:
> >
> >> Thank you Hans,
> >>
> >> I had to actually spend a lot of time to fix it.
> >> But at the end it was not an issue in Freemarker but instead the problem
> >> was that we were not disabling debug messages in freemarker classes.
> >> I have fixed this by adding proper Log4J configuration and then I have
> >> upgraded to the latest stable release of freemarker (2.3.19).
> >> The performance looks good; I have executed (using JMeter) the main
> >> ecommerce screen with 50 threads hitting the page 100 times each:
> >>
> >> with 2.3.10
> >>
> >> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:
> >> 74 Max:  9307 Err:     0 (0.00%)
> >>
> >> with 2.3.19
> >>
> >> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:
> >> 88 Max:  8483 Err:     0 (0.00%)
> >>
> >> The new version is slightly faster now.
> >>
> >> Hans, could you now please revert the changes you did when you switched
> >> back to 2.3.10? I am especially interested in having back the catalog
> >> Directive (instead of the Transform) because in future versions of
> >> Freemarker Transforms will not be supported and we will have to start
> the
> >> migration to directives: having one in place will definitely help.
> >>
> >> Thanks,
> >>
> >> Jacopo
> >>
> >>
> >> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
> >>
> >>> Very impressive Jacopo: good Job.
> >>>
> >>> see what the developers of freemarker say.....
> >>>
> >>> Regards,
> >>> Hans
> >>>
> >>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
> >>>> An update on this: I have found and resolved the issue that Hans
> >> reported on Freemarker bug tracker:
> >>>>
> >>>>
> >>
> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
> >>>>
> >>>> Now I am working with them to see if my change can be made official
> and
> >> released.
> >>>>
> >>>> Jacopo
> >>>>
> >>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
> >>>>
> >>>>> We are sill working on this to optimize the cache so the newest
> >>>>> freemarker will work again.
> >>>>>
> >>>>> Regards
> >>>>> Hans
> >>>>>
> >>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
> >>>>>> Any update on this?  Thanks.
> >>>>>>
> >>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
> >>>>>> <[hidden email]>  wrote:
> >>>>>>> We tried the newer version but is also slow.
> >>>>>>> we are are now looking into moving back to the 2.3.10 version.
> >>>>>>>
> >>>>>>> Regards,
> >>>>>>> Hans
> >>>>>>>
> >>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
> >>>>>>>> I found only that
> >> http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So
> >> nothing special.
> >>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem
> >> to bring much and 2.4 is not ready yet.
> >>>>>>>>
> >>>>>>>> Jacques
> >>>>>>>>
> >>>>>>>> Hans Bakker wrote:
> >>>>>>>>> this problem about the speed is caused in rev: 731487:
> >>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
> >>>>>>>>>
> >>>>>>>>> Regards,
> >>>>>>>>> Hans
> >>>>>>>>>
> >>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
> >>>>>>>>>> currently we are helping a customer to upgrade their ofbiz
> >> version.
> >>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
> >>>>>>>>>>
> >>>>>>>>>> We now found that the current trunk is dramatically slower than
> >> rev
> >>>>>>>>>> 728596 from about 1.5 years ago.
> >>>>>>>>>>
> >>>>>>>>>> the test results:
> >>>>>>>>>> rev 728596:
> >>>>>>>>>> total time : 34.667 seconds
> >>>>>>>>>> Requests per second:    14.42 [#/sec]
> >>>>>>>>>>
> >>>>>>>>>> trunk rev 959845
> >>>>>>>>>> total time : 152.698 seconds
> >>>>>>>>>> Requests per second:    3.27 [#/sec]
> >>>>>>>>>>
> >>>>>>>>>> below the complete test results.
> >>>>>>>>>>
> >>>>>>>>>> Help appreciated.
> >>>>>>>>>>
> >>>>>>>>>> Regards,
> >>>>>>>>>> Hans.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation
> >> max
> >>>>>>>>>> 2048Mb
> >>>>>>>>>> running in background, cache enabled. (cache.properties)
> >>>>>>>>>>
> >>>>>>>>>> command line:
> >>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> rev 728596
> >>>>>>>>>> -----------
> >>>>>>>>>> Server Software:        Apache-Coyote/1.1
> >>>>>>>>>> Server Hostname:        localhost
> >>>>>>>>>> Server Port:            8080
> >>>>>>>>>>
> >>>>>>>>>> Document Path:          /ecommerce/control/main
> >>>>>>>>>> Document Length:        60531 bytes
> >>>>>>>>>>
> >>>>>>>>>> Concurrency Level:      50
> >>>>>>>>>> Time taken for tests:   34.667 seconds
> >>>>>>>>>> Complete requests:      500
> >>>>>>>>>> Failed requests:        496
> >>>>>>>>>>  (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
> >>>>>>>>>> Write errors:           0
> >>>>>>>>>> Total transferred:      30412908 bytes
> >>>>>>>>>> HTML transferred:       30262908 bytes
> >>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
> >>>>>>>>>> Time per request:       3466.737 [ms] (mean)
> >>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
> >>>>>>>>>> requests)
> >>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
> >>>>>>>>>>
> >>>>>>>>>> Connection Times (ms)
> >>>>>>>>>>             min  mean[+/-sd] median   max
> >>>>>>>>>> Connect:        0  198 745.6      0    3000
> >>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
> >>>>>>>>>> Waiting:       40  433 318.7    357    1879
> >>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
> >>>>>>>>>>
> >>>>>>>>>> rev 959845
> >>>>>>>>>> ===========
> >>>>>>>>>> Server Software:        Apache-Coyote/1.1
> >>>>>>>>>> Server Hostname:        localhost
> >>>>>>>>>> Server Port:            8080
> >>>>>>>>>>
> >>>>>>>>>> Document Path:          /ecommerce/control/main
> >>>>>>>>>> Document Length:        65788 bytes
> >>>>>>>>>>
> >>>>>>>>>> Concurrency Level:      50
> >>>>>>>>>> Time taken for tests:   152.698 seconds
> >>>>>>>>>> Complete requests:      500
> >>>>>>>>>> Failed requests:        499
> >>>>>>>>>>  (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
> >>>>>>>>>> Write errors:           0
> >>>>>>>>>> Total transferred:      33189975 bytes
> >>>>>>>>>> HTML transferred:       33039975 bytes
> >>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
> >>>>>>>>>> Time per request:       15269.837 [ms] (mean)
> >>>>>>>>>> Time per request:       305.397 [ms] (mean, across all
> concurrent
> >>>>>>>>>> requests)
> >>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
> >>>>>>>>>>
> >>>>>>>>>> Connection Times (ms)
> >>>>>>>>>>             min  mean[+/-sd] median   max
> >>>>>>>>>> Connect:        0    2   6.6      0      30
> >>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
> >>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
> >>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
> >>>>>>> --
> >>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> >>>>>>> Myself on twitter: http://twitter.com/hansbak
> >>>>>>> Antwebsystems.com: Quality services for competitive rates.
> >>>>>>>
> >>>>>>>
> >>>>> --
> >>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
> >>>>> Myself on twitter: http://twitter.com/hansbak
> >>>>> Antwebsystems.com: Quality services for competitive rates.
> >>>>>
> >>>
> >>
> >>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacopo Cappellato-4
In reply to this post by hans_bakker
Hi Hans,

yes, please wait until I fix the issue with the include; as regards performance, what is the problem exactly?

Thanks,

Jacopo

On Apr 3, 2012, at 5:57 AM, Hans Bakker wrote:

> Hi Jacopo,
>
> it is just a single commit: r986577
>
> now the footer has a problem in the trunk, and the speed problems seems still a problem,
> lets first wait until that is fixed?
>
>
> Regards,
> Hans
>
> On 04/02/2012 09:16 PM, Jacopo Cappellato wrote:
>> Thank you Hans,
>>
>> I had to actually spend a lot of time to fix it.
>> But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in freemarker classes.
>> I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker (2.3.19).
>> The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times each:
>>
>> with 2.3.10
>>
>> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)
>>
>> with 2.3.19
>>
>> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)
>>
>> The new version is slightly faster now.
>>
>> Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we will have to start the migration to directives: having one in place will definitely help.
>>
>> Thanks,
>>
>> Jacopo
>>
>>
>> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>>
>>> Very impressive Jacopo: good Job.
>>>
>>> see what the developers of freemarker say.....
>>>
>>> Regards,
>>> Hans
>>>
>>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>>>
>>>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>>
>>>> Now I am working with them to see if my change can be made official and released.
>>>>
>>>> Jacopo
>>>>
>>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>>
>>>>> We are sill working on this to optimize the cache so the newest
>>>>> freemarker will work again.
>>>>>
>>>>> Regards
>>>>> Hans
>>>>>
>>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>>> Any update on this?  Thanks.
>>>>>>
>>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>>> <[hidden email]>   wrote:
>>>>>>> We tried the newer version but is also slow.
>>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Hans
>>>>>>>
>>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>>>
>>>>>>>> Jacques
>>>>>>>>
>>>>>>>> Hans Bakker wrote:
>>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Hans
>>>>>>>>>
>>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>>
>>>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>>
>>>>>>>>>> the test results:
>>>>>>>>>> rev 728596:
>>>>>>>>>> total time : 34.667 seconds
>>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>>
>>>>>>>>>> trunk rev 959845
>>>>>>>>>> total time : 152.698 seconds
>>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>>
>>>>>>>>>> below the complete test results.
>>>>>>>>>>
>>>>>>>>>> Help appreciated.
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Hans.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>>>> 2048Mb
>>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>>
>>>>>>>>>> command line:
>>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> rev 728596
>>>>>>>>>> -----------
>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>> Server Port:            8080
>>>>>>>>>>
>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>>
>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>>> Complete requests:      500
>>>>>>>>>> Failed requests:        496
>>>>>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>>> Write errors:           0
>>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>>> requests)
>>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>>
>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>>
>>>>>>>>>> rev 959845
>>>>>>>>>> ===========
>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>> Server Port:            8080
>>>>>>>>>>
>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>>
>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>>> Complete requests:      500
>>>>>>>>>> Failed requests:        499
>>>>>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>>> Write errors:           0
>>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>>> requests)
>>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>>
>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>>> --
>>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>>
>>>>>>>
>>>>> --
>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>
>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

hans_bakker
Mike had some concerns....and seemed to be resolved now.....

On 04/03/2012 12:52 PM, Jacopo Cappellato wrote:

> Hi Hans,
>
> yes, please wait until I fix the issue with the include; as regards performance, what is the problem exactly?
>
> Thanks,
>
> Jacopo
>
> On Apr 3, 2012, at 5:57 AM, Hans Bakker wrote:
>
>> Hi Jacopo,
>>
>> it is just a single commit: r986577
>>
>> now the footer has a problem in the trunk, and the speed problems seems still a problem,
>> lets first wait until that is fixed?
>>
>>
>> Regards,
>> Hans
>>
>> On 04/02/2012 09:16 PM, Jacopo Cappellato wrote:
>>> Thank you Hans,
>>>
>>> I had to actually spend a lot of time to fix it.
>>> But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in freemarker classes.
>>> I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker (2.3.19).
>>> The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times each:
>>>
>>> with 2.3.10
>>>
>>> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)
>>>
>>> with 2.3.19
>>>
>>> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)
>>>
>>> The new version is slightly faster now.
>>>
>>> Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we will have to start the migration to directives: having one in place will definitely help.
>>>
>>> Thanks,
>>>
>>> Jacopo
>>>
>>>
>>> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>>>
>>>> Very impressive Jacopo: good Job.
>>>>
>>>> see what the developers of freemarker say.....
>>>>
>>>> Regards,
>>>> Hans
>>>>
>>>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>>>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>>>>
>>>>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>>>
>>>>> Now I am working with them to see if my change can be made official and released.
>>>>>
>>>>> Jacopo
>>>>>
>>>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>>>
>>>>>> We are sill working on this to optimize the cache so the newest
>>>>>> freemarker will work again.
>>>>>>
>>>>>> Regards
>>>>>> Hans
>>>>>>
>>>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>>>> Any update on this?  Thanks.
>>>>>>>
>>>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>>>> <[hidden email]>    wrote:
>>>>>>>> We tried the newer version but is also slow.
>>>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Hans
>>>>>>>>
>>>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>>>>
>>>>>>>>> Jacques
>>>>>>>>>
>>>>>>>>> Hans Bakker wrote:
>>>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Hans
>>>>>>>>>>
>>>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>>>
>>>>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>>>
>>>>>>>>>>> the test results:
>>>>>>>>>>> rev 728596:
>>>>>>>>>>> total time : 34.667 seconds
>>>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>>>
>>>>>>>>>>> trunk rev 959845
>>>>>>>>>>> total time : 152.698 seconds
>>>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>>>
>>>>>>>>>>> below the complete test results.
>>>>>>>>>>>
>>>>>>>>>>> Help appreciated.
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Hans.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>>>>> 2048Mb
>>>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>>>
>>>>>>>>>>> command line:
>>>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> rev 728596
>>>>>>>>>>> -----------
>>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>>> Server Port:            8080
>>>>>>>>>>>
>>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>>>
>>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>>>> Complete requests:      500
>>>>>>>>>>> Failed requests:        496
>>>>>>>>>>>    (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>>>> Write errors:           0
>>>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>>>> requests)
>>>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>>>
>>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>>               min  mean[+/-sd] median   max
>>>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>>>
>>>>>>>>>>> rev 959845
>>>>>>>>>>> ===========
>>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>>> Server Port:            8080
>>>>>>>>>>>
>>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>>>
>>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>>>> Complete requests:      500
>>>>>>>>>>> Failed requests:        499
>>>>>>>>>>>    (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>>>> Write errors:           0
>>>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>>>> requests)
>>>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>>>
>>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>>               min  mean[+/-sd] median   max
>>>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>>>> --
>>>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>>>
>>>>>>>>
>>>>>> --
>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>

Reply | Threaded
Open this post in threaded view
|

Re: Trunk ecommerce main screen 4 times slower then 1.5 year ago.

Jacopo Cappellato-4
Ah yes,

I think that Mike misunderstand my first post (that was probably not very clear): the slight performance improvement we have with this last version is versus the fastest freemarker jar (2.3.10), the one that your tests shown to be 4 times faster.

Jacopo

On Apr 3, 2012, at 8:00 AM, Hans Bakker wrote:

> Mike had some concerns....and seemed to be resolved now.....
>
> On 04/03/2012 12:52 PM, Jacopo Cappellato wrote:
>> Hi Hans,
>>
>> yes, please wait until I fix the issue with the include; as regards performance, what is the problem exactly?
>>
>> Thanks,
>>
>> Jacopo
>>
>> On Apr 3, 2012, at 5:57 AM, Hans Bakker wrote:
>>
>>> Hi Jacopo,
>>>
>>> it is just a single commit: r986577
>>>
>>> now the footer has a problem in the trunk, and the speed problems seems still a problem,
>>> lets first wait until that is fixed?
>>>
>>>
>>> Regards,
>>> Hans
>>>
>>> On 04/02/2012 09:16 PM, Jacopo Cappellato wrote:
>>>> Thank you Hans,
>>>>
>>>> I had to actually spend a lot of time to fix it.
>>>> But at the end it was not an issue in Freemarker but instead the problem was that we were not disabling debug messages in freemarker classes.
>>>> I have fixed this by adding proper Log4J configuration and then I have upgraded to the latest stable release of freemarker (2.3.19).
>>>> The performance looks good; I have executed (using JMeter) the main ecommerce screen with 50 threads hitting the page 100 times each:
>>>>
>>>> with 2.3.10
>>>>
>>>> Generate Summary Results =  5000 in 195.2s =   25.6/s Avg:  1925 Min:    74 Max:  9307 Err:     0 (0.00%)
>>>>
>>>> with 2.3.19
>>>>
>>>> Generate Summary Results =  5000 in 187.6s =   26.6/s Avg:  1842 Min:    88 Max:  8483 Err:     0 (0.00%)
>>>>
>>>> The new version is slightly faster now.
>>>>
>>>> Hans, could you now please revert the changes you did when you switched back to 2.3.10? I am especially interested in having back the catalog Directive (instead of the Transform) because in future versions of Freemarker Transforms will not be supported and we will have to start the migration to directives: having one in place will definitely help.
>>>>
>>>> Thanks,
>>>>
>>>> Jacopo
>>>>
>>>>
>>>> On Apr 2, 2012, at 9:49 AM, Hans Bakker wrote:
>>>>
>>>>> Very impressive Jacopo: good Job.
>>>>>
>>>>> see what the developers of freemarker say.....
>>>>>
>>>>> Regards,
>>>>> Hans
>>>>>
>>>>> On 04/02/2012 02:43 PM, Jacopo Cappellato wrote:
>>>>>> An update on this: I have found and resolved the issue that Hans reported on Freemarker bug tracker:
>>>>>>
>>>>>> https://sourceforge.net/tracker/index.php?func=detail&aid=3046069&group_id=794&atid=100794
>>>>>>
>>>>>> Now I am working with them to see if my change can be made official and released.
>>>>>>
>>>>>> Jacopo
>>>>>>
>>>>>> On Aug 22, 2010, at 2:52 PM, Hans Bakker wrote:
>>>>>>
>>>>>>> We are sill working on this to optimize the cache so the newest
>>>>>>> freemarker will work again.
>>>>>>>
>>>>>>> Regards
>>>>>>> Hans
>>>>>>>
>>>>>>> On Sun, 2010-08-22 at 02:38 -0700, Mike Z wrote:
>>>>>>>> Any update on this?  Thanks.
>>>>>>>>
>>>>>>>> On Mon, Aug 16, 2010 at 1:58 AM, Hans Bakker
>>>>>>>> <[hidden email]>    wrote:
>>>>>>>>> We tried the newer version but is also slow.
>>>>>>>>> we are are now looking into moving back to the 2.3.10 version.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Hans
>>>>>>>>>
>>>>>>>>> On Mon, 2010-08-16 at 09:22 +0200, Jacques Le Roux wrote:
>>>>>>>>>> I found only that http://freemarker.sourceforge.net/docs/app_faq.html#faq_question_25 So nothing special.
>>>>>>>>>> We could try to upgrade to newer versions but 2.3.16 does not seem to bring much and 2.4 is not ready yet.
>>>>>>>>>>
>>>>>>>>>> Jacques
>>>>>>>>>>
>>>>>>>>>> Hans Bakker wrote:
>>>>>>>>>>> this problem about the speed is caused in rev: 731487:
>>>>>>>>>>> Upgrade Freemarker jar from 2.3.10 to 2.3.15
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> Hans
>>>>>>>>>>>
>>>>>>>>>>> On Sun, 2010-08-15 at 08:45 +0700, Hans Bakker wrote:
>>>>>>>>>>>> currently we are helping a customer to upgrade their ofbiz version.
>>>>>>>>>>>> We are using "Apache bench" to test the ecommerce frontend.
>>>>>>>>>>>>
>>>>>>>>>>>> We now found that the current trunk is dramatically slower than rev
>>>>>>>>>>>> 728596 from about 1.5 years ago.
>>>>>>>>>>>>
>>>>>>>>>>>> the test results:
>>>>>>>>>>>> rev 728596:
>>>>>>>>>>>> total time : 34.667 seconds
>>>>>>>>>>>> Requests per second:    14.42 [#/sec]
>>>>>>>>>>>>
>>>>>>>>>>>> trunk rev 959845
>>>>>>>>>>>> total time : 152.698 seconds
>>>>>>>>>>>> Requests per second:    3.27 [#/sec]
>>>>>>>>>>>>
>>>>>>>>>>>> below the complete test results.
>>>>>>>>>>>>
>>>>>>>>>>>> Help appreciated.
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> Hans.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Test results, local compute ubuntu 10.04 java memory allocation max
>>>>>>>>>>>> 2048Mb
>>>>>>>>>>>> running in background, cache enabled. (cache.properties)
>>>>>>>>>>>>
>>>>>>>>>>>> command line:
>>>>>>>>>>>> ab -n 500 -c 50 http://localhost:8080/ecommerce/control/main
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> rev 728596
>>>>>>>>>>>> -----------
>>>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>>>> Server Port:            8080
>>>>>>>>>>>>
>>>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>>>> Document Length:        60531 bytes
>>>>>>>>>>>>
>>>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>>>> Time taken for tests:   34.667 seconds
>>>>>>>>>>>> Complete requests:      500
>>>>>>>>>>>> Failed requests:        496
>>>>>>>>>>>>   (Connect: 0, Receive: 0, Length: 496, Exceptions: 0)
>>>>>>>>>>>> Write errors:           0
>>>>>>>>>>>> Total transferred:      30412908 bytes
>>>>>>>>>>>> HTML transferred:       30262908 bytes
>>>>>>>>>>>> Requests per second:    14.42 [#/sec] (mean)
>>>>>>>>>>>> Time per request:       3466.737 [ms] (mean)
>>>>>>>>>>>> Time per request:       69.335 [ms] (mean, across all concurrent
>>>>>>>>>>>> requests)
>>>>>>>>>>>> Transfer rate:          856.72 [Kbytes/sec] received
>>>>>>>>>>>>
>>>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>>>>> Connect:        0  198 745.6      0    3000
>>>>>>>>>>>> Processing:  1173 3239 778.2   3228    6287
>>>>>>>>>>>> Waiting:       40  433 318.7    357    1879
>>>>>>>>>>>> Total:       1173 3437 1287.7   3228    9287
>>>>>>>>>>>>
>>>>>>>>>>>> rev 959845
>>>>>>>>>>>> ===========
>>>>>>>>>>>> Server Software:        Apache-Coyote/1.1
>>>>>>>>>>>> Server Hostname:        localhost
>>>>>>>>>>>> Server Port:            8080
>>>>>>>>>>>>
>>>>>>>>>>>> Document Path:          /ecommerce/control/main
>>>>>>>>>>>> Document Length:        65788 bytes
>>>>>>>>>>>>
>>>>>>>>>>>> Concurrency Level:      50
>>>>>>>>>>>> Time taken for tests:   152.698 seconds
>>>>>>>>>>>> Complete requests:      500
>>>>>>>>>>>> Failed requests:        499
>>>>>>>>>>>>   (Connect: 0, Receive: 0, Length: 499, Exceptions: 0)
>>>>>>>>>>>> Write errors:           0
>>>>>>>>>>>> Total transferred:      33189975 bytes
>>>>>>>>>>>> HTML transferred:       33039975 bytes
>>>>>>>>>>>> Requests per second:    3.27 [#/sec] (mean)
>>>>>>>>>>>> Time per request:       15269.837 [ms] (mean)
>>>>>>>>>>>> Time per request:       305.397 [ms] (mean, across all concurrent
>>>>>>>>>>>> requests)
>>>>>>>>>>>> Transfer rate:          212.26 [Kbytes/sec] received
>>>>>>>>>>>>
>>>>>>>>>>>> Connection Times (ms)
>>>>>>>>>>>>              min  mean[+/-sd] median   max
>>>>>>>>>>>> Connect:        0    2   6.6      0      30
>>>>>>>>>>>> Processing: 11504 15083 1122.0  15065   19496
>>>>>>>>>>>> Waiting:      214 1312 355.2   1294    2751
>>>>>>>>>>>> Total:      11504 15086 1123.5  15065   19497
>>>>>>>>> --
>>>>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>>>>
>>>>>>>>>
>>>>>>> --
>>>>>>> Ofbiz on twitter: http://twitter.com/apache_ofbiz
>>>>>>> Myself on twitter: http://twitter.com/hansbak
>>>>>>> Antwebsystems.com: Quality services for competitive rates.
>>>>>>>
>

12