Multi page listing mechanism

[Foo Shyn Chung]

Hi guys,

Would like to ask what is the mechanism used in Ofbiz for multi page
listing?

Currently we have a live site whereby the listing would resulted in a few
thousands rows being returned and displayed on multiple page on the screen.
We found that once the data amount hit a certain amount, the performance of
that page will become very slow.

For listing, is Ofbiz will load up all the results in the memory, then only
segregate them into multiple page? or they only will load the data when the
user is viewing the page (i.e. when the user click next page, then the data
for the next page is loaded).

Not sure whether anyone has encountered this before?

Thank you
FooShyn

[Bilgin Ibryam-2]

On Thu, Oct 6, 2011 at 8:48 AM, Foo Shyn Chung <[hidden email]> wrote:
> Hi guys,

Hi FooShyn,

>
> Would like to ask what is the mechanism used in Ofbiz for multi page
> listing?

have a look at java.sql.ResultSet.EntityListIterator class

>
> Currently we have a live site whereby the listing would resulted in a few
> thousands rows being returned and displayed on multiple page on the screen.
> We found that once the data amount hit a certain amount, the performance of
> that page will become very slow.
>
> For listing, is Ofbiz will load up all the results in the memory, then only
> segregate them into multiple page? or they only will load the data when the
> user is viewing the page (i.e. when the user click next page, then the data
> for the next page is loaded).

the latter


HTH
Bilgin


>
> Not sure whether anyone has encountered this before?
>
> Thank you
> FooShyn
>

[Foo Shyn Chung]

Thank Bilgin,

Sorry, forgot to mention. The version i'm trying out is ofbiz 10.4

I'm looking at *org.ofbiz.entity.util.EntityListIterator*in ofbiz source,
this is the class used throughout the whole ofbiz entity engine to pull
results for listing page?

Thanx
FooShyn

On Thu, Oct 6, 2011 at 4:54 PM, Bilgin Ibryam <[hidden email]> wrote:

> On Thu, Oct 6, 2011 at 8:48 AM, Foo Shyn Chung <[hidden email]> wrote:
> > Hi guys,
>
> Hi FooShyn,
>
> >
> > Would like to ask what is the mechanism used in Ofbiz for multi page
> > listing?
>
> have a look at java.sql.ResultSet.EntityListIterator class
>
> >
> > Currently we have a live site whereby the listing would resulted in a few
> > thousands rows being returned and displayed on multiple page on the
> screen.
> > We found that once the data amount hit a certain amount, the performance
> of
> > that page will become very slow.
> >
> > For listing, is Ofbiz will load up all the results in the memory, then
> only
> > segregate them into multiple page? or they only will load the data when
> the
> > user is viewing the page (i.e. when the user click next page, then the
> data
> > for the next page is loaded).
>
> the latter
>
>
> HTH
> Bilgin
>
>
> >
> > Not sure whether anyone has encountered this before?
> >
> > Thank you
> > FooShyn
> >
>

[BJ Freeman]

are you using an entity OTTB?
Some DB will not handle Cursors.

Foo Shyn Chung sent the following on 10/6/2011 12:48 AM:

> Hi guys,
>
> Would like to ask what is the mechanism used in Ofbiz for multi page
> listing?
>
> Currently we have a live site whereby the listing would resulted in a few
> thousands rows being returned and displayed on multiple page on the screen.
> We found that once the data amount hit a certain amount, the performance of
> that page will become very slow.
>
> For listing, is Ofbiz will load up all the results in the memory, then only
> segregate them into multiple page? or they only will load the data when the
> user is viewing the page (i.e. when the user click next page, then the data
> for the next page is loaded).
>
> Not sure whether anyone has encountered this before?
>
> Thank you
> FooShyn
>

[Foo Shyn Chung]

I'm using Postgres as the database, i think it should support cursor fine.
Anyway the reason i'm asking this is that the client is facing load time
issue when they try to search out large amount of data. Although the result
is segregated by paging, it seems like it is still affecting the memory
usage. Hence i'm trying to figure out what's the problem.

A lot of thanks for any comments or advice.

Thank you
FooShyn

On Wed, Oct 12, 2011 at 12:18 AM, BJ Freeman <[hidden email]> wrote:

> are you using an entity OTTB?
> Some DB will not handle Cursors.
>
> Foo Shyn Chung sent the following on 10/6/2011 12:48 AM:
> > Hi guys,
> >
> > Would like to ask what is the mechanism used in Ofbiz for multi page
> > listing?
> >
> > Currently we have a live site whereby the listing would resulted in a few
> > thousands rows being returned and displayed on multiple page on the
> screen.
> > We found that once the data amount hit a certain amount, the performance
> of
> > that page will become very slow.
> >
> > For listing, is Ofbiz will load up all the results in the memory, then
> only
> > segregate them into multiple page? or they only will load the data when
> the
> > user is viewing the page (i.e. when the user click next page, then the
> data
> > for the next page is loaded).
> >
> > Not sure whether anyone has encountered this before?
> >
> > Thank you
> > FooShyn
> >
>

[BJ Freeman]

You have two issues, the caching in Postgres which is memory based and
ofbiz caching of the recordset that is returned.
I suggest you look at the number of instances of Postgres for the
instance of ofbiz and the total memory available on the bos you are
running on.
also look at the indexing of the data you are searching on.

Foo Shyn Chung sent the following on 10/24/2011 3:39 AM:

> I'm using Postgres as the database, i think it should support cursor fine.
> Anyway the reason i'm asking this is that the client is facing load time
> issue when they try to search out large amount of data. Although the result
> is segregated by paging, it seems like it is still affecting the memory
> usage. Hence i'm trying to figure out what's the problem.
>
> A lot of thanks for any comments or advice.
>
> Thank you
> FooShyn
>
> On Wed, Oct 12, 2011 at 12:18 AM, BJ Freeman <[hidden email]> wrote:
>
>> are you using an entity OTTB?
>> Some DB will not handle Cursors.
>>
>> Foo Shyn Chung sent the following on 10/6/2011 12:48 AM:
>>> Hi guys,
>>>
>>> Would like to ask what is the mechanism used in Ofbiz for multi page
>>> listing?
>>>
>>> Currently we have a live site whereby the listing would resulted in a few
>>> thousands rows being returned and displayed on multiple page on the
>> screen.
>>> We found that once the data amount hit a certain amount, the performance
>> of
>>> that page will become very slow.
>>>
>>> For listing, is Ofbiz will load up all the results in the memory, then
>> only
>>> segregate them into multiple page? or they only will load the data when
>> the
>>> user is viewing the page (i.e. when the user click next page, then the
>> data
>>> for the next page is loaded).
>>>
>>> Not sure whether anyone has encountered this before?
>>>
>>> Thank you
>>> FooShyn
>>>
>>
>

[Anne Jessel]

Also check whether you are sorting by a field that makes postgres load
all the data and sort it in memory before it can page anything.

Cheers,
Anne.

On 25 October 2011 05:01, BJ Freeman <[hidden email]> wrote:

> You have two issues, the caching in Postgres which is memory based and
> ofbiz caching of the recordset that is returned.
> I suggest you look at the number of instances of Postgres for the
> instance of ofbiz and the total memory available on the bos you are
> running on.
> also look at the indexing of the data you are searching on.
>
> Foo Shyn Chung sent the following on 10/24/2011 3:39 AM:
>> I'm using Postgres as the database, i think it should support cursor fine.
>> Anyway the reason i'm asking this is that the client is facing load time
>> issue when they try to search out large amount of data. Although the result
>> is segregated by paging, it seems like it is still affecting the memory
>> usage. Hence i'm trying to figure out what's the problem.
>>
>> A lot of thanks for any comments or advice.
>>
>> Thank you
>> FooShyn
>>
>> On Wed, Oct 12, 2011 at 12:18 AM, BJ Freeman <[hidden email]> wrote:
>>
>>> are you using an entity OTTB?
>>> Some DB will not handle Cursors.
>>>
>>> Foo Shyn Chung sent the following on 10/6/2011 12:48 AM:
>>>> Hi guys,
>>>>
>>>> Would like to ask what is the mechanism used in Ofbiz for multi page
>>>> listing?
>>>>
>>>> Currently we have a live site whereby the listing would resulted in a few
>>>> thousands rows being returned and displayed on multiple page on the
>>> screen.
>>>> We found that once the data amount hit a certain amount, the performance
>>> of
>>>> that page will become very slow.
>>>>
>>>> For listing, is Ofbiz will load up all the results in the memory, then
>>> only
>>>> segregate them into multiple page? or they only will load the data when
>>> the
>>>> user is viewing the page (i.e. when the user click next page, then the
>>> data
>>>> for the next page is loaded).
>>>>
>>>> Not sure whether anyone has encountered this before?
>>>>
>>>> Thank you
>>>> FooShyn
>>>>
>>>
>>
>

--
Coherent Software Australia Pty Ltd
PO Box 2773
Cheltenham Vic 3192
Phone: [phone]
Fax: [phone]
Web: http://www.cohsoft.com.au/
Email: [hidden email]

Bonsai ERP, the all-inclusive ERP system
http://www.bonsaierp.com.au/