Re: Demo server

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Jacques Le Roux
Administrator
I have rebooted the demo server again this morning and asked infra for more memory and got 2560MB, thanks Gavin!
Note that before I got caught and was even unable to kill the OFBiz java process :/

We have also available now
demo-stable.ofbiz.apache.org = 140.211.11.50
demo-trunk.ofbiz.apache.org = 140.211.11.51

If future proves that we are unable to run both instances in this memory, 2 solutions:
* Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will not be easy)
* block the processes which eat too much memory (this morning someone did an export all). Not an easy one :(

Jacques

From: "Jacques Le Roux" <[hidden email]>
> Hi,
>
> I have just updated and rebooted the demo server
>
> Jacques
>

Reply | Threaded
Open this post in threaded view
|

Re: Demo server

samhamilton
Hi Jacques,

Couldn't only running the trunk on the demo machine be a third solution
if you can't get more RAM out of infra?

Sam


On 10/03/2010 16:24, Jacques Le Roux wrote:

> I have rebooted the demo server again this morning and asked infra for
> more memory and got 2560MB, thanks Gavin!
> Note that before I got caught and was even unable to kill the OFBiz java
> process :/
>
> We have also available now
> demo-stable.ofbiz.apache.org = 140.211.11.50 demo-trunk.ofbiz.apache.org
> = 140.211.11.51
> If future proves that we are unable to run both instances in this
> memory, 2 solutions:
> * Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will
> not be easy)
> * block the processes which eat too much memory (this morning someone
> did an export all). Not an easy one :(
>
> Jacques
>
> From: "Jacques Le Roux" <[hidden email]>
>> Hi,
>>
>> I have just updated and rebooted the demo server
>>
>> Jacques
>>
>

Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Jacques Le Roux
Administrator
Hi Sam,

From: "Sam Hamilton" <[hidden email]>
> Hi Jacques,
>
> Couldn't only running the trunk on the demo machine be a third solution
> if you can't get more RAM out of infra?

It's already what we are doing, but we would like to run a stable instance also.
Hopefully it will run smoothly with 2.5GB though. Because we will increase the PermGen space (which is where the current issue is)
for both while remaining memory will be shared.
Anyway we will see, and they did not say "stop" about more memory. Also we have to do an effort for the official Apache release (and
we - PMC - are currently discussing on the strategy/process) and I think this will help us, if needed, to ask for more memory. Else
we may create roles for demo and cut any process proven to use too much memory (export all being already a candidate...)

Jacques

> Sam
>
>
> On 10/03/2010 16:24, Jacques Le Roux wrote:
>> I have rebooted the demo server again this morning and asked infra for
>> more memory and got 2560MB, thanks Gavin!
>> Note that before I got caught and was even unable to kill the OFBiz java
>> process :/
>>
>> We have also available now
>> demo-stable.ofbiz.apache.org = 140.211.11.50 demo-trunk.ofbiz.apache.org
>> = 140.211.11.51
>> If future proves that we are unable to run both instances in this
>> memory, 2 solutions:
>> * Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will
>> not be easy)
>> * block the processes which eat too much memory (this morning someone
>> did an export all). Not an easy one :(
>>
>> Jacques
>>
>> From: "Jacques Le Roux" <[hidden email]>
>>> Hi,
>>>
>>> I have just updated and rebooted the demo server
>>>
>>> Jacques
>>>
>>
>


Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Jacques Le Roux
Administrator
The server was blocked again, I rebooted an increased the memory again to -Xmx768M -XX:MaxPermSize=512m. This is the max we should
use for an instance with our current configuration...

Jacques

From: "Jacques Le Roux" <[hidden email]>

> Hi Sam,
>
> From: "Sam Hamilton" <[hidden email]>
>> Hi Jacques,
>>
>> Couldn't only running the trunk on the demo machine be a third solution
>> if you can't get more RAM out of infra?
>
> It's already what we are doing, but we would like to run a stable instance also.
> Hopefully it will run smoothly with 2.5GB though. Because we will increase the PermGen space (which is where the current issue is)
> for both while remaining memory will be shared.
> Anyway we will see, and they did not say "stop" about more memory. Also we have to do an effort for the official Apache release
> (and we - PMC - are currently discussing on the strategy/process) and I think this will help us, if needed, to ask for more
> memory. Else we may create roles for demo and cut any process proven to use too much memory (export all being already a
> candidate...)
>
> Jacques
>
>> Sam
>>
>>
>> On 10/03/2010 16:24, Jacques Le Roux wrote:
>>> I have rebooted the demo server again this morning and asked infra for
>>> more memory and got 2560MB, thanks Gavin!
>>> Note that before I got caught and was even unable to kill the OFBiz java
>>> process :/
>>>
>>> We have also available now
>>> demo-stable.ofbiz.apache.org = 140.211.11.50 demo-trunk.ofbiz.apache.org
>>> = 140.211.11.51
>>> If future proves that we are unable to run both instances in this
>>> memory, 2 solutions:
>>> * Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will
>>> not be easy)
>>> * block the processes which eat too much memory (this morning someone
>>> did an export all). Not an easy one :(
>>>
>>> Jacques
>>>
>>> From: "Jacques Le Roux" <[hidden email]>
>>>> Hi,
>>>>
>>>> I have just updated and rebooted the demo server
>>>>
>>>> Jacques
>>>>
>>>
>>
>
>


Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Tim Ruppert
Let's fix the problem.  When at Contegix we ran 3 demos concurrently, and multiple versions of the Confluence server which eats memory - so the problem is in the setup.  With 2.5 GB we should be able to run both the demo and stable release branch successfully - but we've got to find this permGen issue ....

Cheers,
Ruppert

On Mar 10, 2010, at 5:33 AM, Jacques Le Roux wrote:

> The server was blocked again, I rebooted an increased the memory again to -Xmx768M -XX:MaxPermSize=512m. This is the max we should use for an instance with our current configuration...
>
> Jacques
>
> From: "Jacques Le Roux" <[hidden email]>
>> Hi Sam,
>>
>> From: "Sam Hamilton" <[hidden email]>
>>> Hi Jacques,
>>>
>>> Couldn't only running the trunk on the demo machine be a third solution
>>> if you can't get more RAM out of infra?
>>
>> It's already what we are doing, but we would like to run a stable instance also.
>> Hopefully it will run smoothly with 2.5GB though. Because we will increase the PermGen space (which is where the current issue is)
>> for both while remaining memory will be shared.
>> Anyway we will see, and they did not say "stop" about more memory. Also we have to do an effort for the official Apache release
>> (and we - PMC - are currently discussing on the strategy/process) and I think this will help us, if needed, to ask for more
>> memory. Else we may create roles for demo and cut any process proven to use too much memory (export all being already a
>> candidate...)
>>
>> Jacques
>>
>>> Sam
>>>
>>>
>>> On 10/03/2010 16:24, Jacques Le Roux wrote:
>>>> I have rebooted the demo server again this morning and asked infra for
>>>> more memory and got 2560MB, thanks Gavin!
>>>> Note that before I got caught and was even unable to kill the OFBiz java
>>>> process :/
>>>>
>>>> We have also available now
>>>> demo-stable.ofbiz.apache.org = 140.211.11.50 demo-trunk.ofbiz.apache.org
>>>> = 140.211.11.51
>>>> If future proves that we are unable to run both instances in this
>>>> memory, 2 solutions:
>>>> * Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will
>>>> not be easy)
>>>> * block the processes which eat too much memory (this morning someone
>>>> did an export all). Not an easy one :(
>>>>
>>>> Jacques
>>>>
>>>> From: "Jacques Le Roux" <[hidden email]>
>>>>> Hi,
>>>>>
>>>>> I have just updated and rebooted the demo server
>>>>>
>>>>> Jacques
>>>>>
>>>>
>>>
>>
>>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Jacques Le Roux
Administrator
I found this link, not read yet
http://blogs.sun.com/fkieviet/entry/classloader_leaks_the_dreaded_java

Jacques

From: "Tim Ruppert" <[hidden email]>

> Let's fix the problem.  When at Contegix we ran 3 demos concurrently, and multiple versions of the Confluence server which eats
> memory - so the problem is in the setup.  With 2.5 GB we should be able to run both the demo and stable release branch
> successfully - but we've got to find this permGen issue ....
>
> Cheers,
> Ruppert
>
> On Mar 10, 2010, at 5:33 AM, Jacques Le Roux wrote:
>
>> The server was blocked again, I rebooted an increased the memory again to -Xmx768M -XX:MaxPermSize=512m. This is the max we
>> should use for an instance with our current configuration...
>>
>> Jacques
>>
>> From: "Jacques Le Roux" <[hidden email]>
>>> Hi Sam,
>>>
>>> From: "Sam Hamilton" <[hidden email]>
>>>> Hi Jacques,
>>>>
>>>> Couldn't only running the trunk on the demo machine be a third solution
>>>> if you can't get more RAM out of infra?
>>>
>>> It's already what we are doing, but we would like to run a stable instance also.
>>> Hopefully it will run smoothly with 2.5GB though. Because we will increase the PermGen space (which is where the current issue
>>> is)
>>> for both while remaining memory will be shared.
>>> Anyway we will see, and they did not say "stop" about more memory. Also we have to do an effort for the official Apache release
>>> (and we - PMC - are currently discussing on the strategy/process) and I think this will help us, if needed, to ask for more
>>> memory. Else we may create roles for demo and cut any process proven to use too much memory (export all being already a
>>> candidate...)
>>>
>>> Jacques
>>>
>>>> Sam
>>>>
>>>>
>>>> On 10/03/2010 16:24, Jacques Le Roux wrote:
>>>>> I have rebooted the demo server again this morning and asked infra for
>>>>> more memory and got 2560MB, thanks Gavin!
>>>>> Note that before I got caught and was even unable to kill the OFBiz java
>>>>> process :/
>>>>>
>>>>> We have also available now
>>>>> demo-stable.ofbiz.apache.org = 140.211.11.50 demo-trunk.ofbiz.apache.org
>>>>> = 140.211.11.51
>>>>> If future proves that we are unable to run both instances in this
>>>>> memory, 2 solutions:
>>>>> * Ask for more memory (obviously as I asked for 3 GB and got 2.5GB, will
>>>>> not be easy)
>>>>> * block the processes which eat too much memory (this morning someone
>>>>> did an export all). Not an easy one :(
>>>>>
>>>>> Jacques
>>>>>
>>>>> From: "Jacques Le Roux" <[hidden email]>
>>>>>> Hi,
>>>>>>
>>>>>> I have just updated and rebooted the demo server
>>>>>>
>>>>>> Jacques
>>>>>>
>>>>>
>>>>
>>>
>>>
>>
>>
>
>


Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Adam Heath-2
Jacques Le Roux wrote:
> I found this link, not read yet
> http://blogs.sun.com/fkieviet/entry/classloader_leaks_the_dreaded_java

While I haven't read that link before today(I just did right now), I
am aware of such classes of problems.

There was a similiar one ages ago in commons-dbcp.

The basic crux of the problem is a static object that maintains a
reference to anything created by a dynamically loaded method.  This
may not be a direct reference, but could be buried deep inside some
nested collections-type structure.

However, ofbiz doesn't redeploy it's things.

Just because you run out of PermGen space, doesn't mean you have a
memleak.

You also have to consider whether the host is 32-bit or 64-bit.
64-bit hosts have larger permgen spaces.  If you are explicitly
setting the size, you might be missing out on the auto-sizing at
startup of the vm.

It's also just possible that ofbiz requires more permgen.  I don't
consider this a 'leak'.  A leak of memory is a bug, wherein it's not
ever possible to free the memory.

Now, it may be we need to optimize, to reduce permgen usage, but over
time, ofbiz will require more resources.  It's just the nature of the
game.
Reply | Threaded
Open this post in threaded view
|

Re: Demo server

Jacques Le Roux
Administrator
From: "Adam Heath" <[hidden email]>

> Jacques Le Roux wrote:
>> I found this link, not read yet
>> http://blogs.sun.com/fkieviet/entry/classloader_leaks_the_dreaded_java
>
> While I haven't read that link before today(I just did right now), I
> am aware of such classes of problems.
>
> There was a similiar one ages ago in commons-dbcp.
>
> The basic crux of the problem is a static object that maintains a
> reference to anything created by a dynamically loaded method.  This
> may not be a direct reference, but could be buried deep inside some
> nested collections-type structure.
>
> However, ofbiz doesn't redeploy it's things.
>
> Just because you run out of PermGen space, doesn't mean you have a
> memleak.
>
> You also have to consider whether the host is 32-bit or 64-bit.
> 64-bit hosts have larger permgen spaces.  If you are explicitly
> setting the size, you might be missing out on the auto-sizing at
> startup of the vm.

Yes I just checked, it's 64bits. Hopefully my setting will be ok, even for 2 instances (we will have to use the same on the stable
version...). Anyway right now we can't physically do
better.

Jacques

> It's also just possible that ofbiz requires more permgen.  I don't
> consider this a 'leak'.  A leak of memory is a bug, wherein it's not
> ever possible to free the memory.
>
> Now, it may be we need to optimize, to reduce permgen usage, but over
> time, ofbiz will require more resources.  It's just the nature of the
> game.
>