OFBiz demos all down
Locked
12
12
 
Administrator
|
BTW they had to power cycle the VM, so it was really "fucked up" indeed, crossing fingers...
Jacques Le 24/11/2015 16:33, Jacques Le Roux a écrit : > This time, as said someone of the infra team "the issue is the underlying host looks fucked." > > All demos are now restarting, sorry for the delay > > Jacques > > Le 18/11/2015 11:30, Jacques Le Roux a écrit : >> FYI: We got another old demo (R12.04) crash yesterday. So it seems Java 8 is not the issue. I'll wait a bit and put it back, it seems using nice >> and ionice commands helps >> >> You can now see in the footer which Java version has been used to compile a running instance (using ant svninfo or gitinfo) >> >> Jacques >> >> Le 14/11/2015 12:15, Jacques Le Roux a écrit : >>> Despite running under Java 7 with a longer time w/o VM crashing we got another crash today. So at least Java 8 was not the only reason. I still >>> keep Java 7, since we had no issues before switching to 8, but it seems there is another issue. >>> >>> ||The cron job, which runs nightly to restart the demos, will now use "nice -n 19 ionice -c2 -n7" which is as nice as possible. We will see if >>> that helps. >>> >>> The demos restart (nicely), stay tuned... >>> >>> Jacques >>> >>> Le 05/11/2015 13:44, Jacques Le Roux a écrit : >>>> All demos now run under Java 7 >>>> >>>> Jacques >>>> >>>> Le 05/11/2015 09:29, Jacques Le Roux a écrit : >>>>> OK, my last thought: no needs to revert in trunk I will simply revert on the VM and will make Java 7 our default version on VM >>>>> >>>>> Waiting for infra (they are bored with my request I guess :D) >>>>> >>>>> Jacques >>>>> >>>>> Le 05/11/2015 09:24, Jacques Le Roux a écrit : >>>>>> OK it seems we have an issue on the OFBIZ-VM since I replaced Java 7 by Java 8 there. >>>>>> The the OFBIZ-VM is down again and we know that arises because one (our?) demos suck/s all the VM power (100% CPU too long) >>>>>> >>>>>> Since we have no Java 8 features yet in trunk, I'd like to temporary revert the changes related with >>>>>> https://issues.apache.org/jira/browse/OFBIZ-6458 to test the hypothesis >>>>>> Opinions? >>>>>> >>>>>> In the meantime I will ask to reboot the VM again and will restart the demos >>>>>> >>>>>> Jacques >>>>>> >>>>>> >>>>>> Le 04/11/2015 12:47, Jacques Le Roux a écrit : >>>>>>> Infra just restarted the VM, I'm restarting the demos >>>>>>> >>>>>>> Jacques >>>>>>> >>>>>>> Le 04/11/2015 11:06, Jacques Le Roux a écrit : >>>>>>>> Nope it's the VM see http://status.apache.org/ >>>>>>>> >>>>>>>> Jacques >>>>>>>> >>>>>>>> Le 04/11/2015 10:57, Taher Alkhateeb a écrit : >>>>>>>>> Hi Jacques, >>>>>>>>> >>>>>>>>> Is OFBiz the reason for this or is it the infrastructure itself? Perhaps we need to check the logs for memory leaks. >>>>>>>>> >>>>>>>>> Taher Alkhateeb >>>>>>>>> >>>>>>>>> ----- Original Message ----- >>>>>>>>> >>>>>>>>> From: "Jacques Le Roux" <[hidden email]> >>>>>>>>> To: [hidden email] >>>>>>>>> Sent: Wednesday, 4 November, 2015 12:33:26 PM >>>>>>>>> Subject: Re: OFBiz demos all down >>>>>>>>> >>>>>>>>> The VM is down again since this morning, infra on it... >>>>>>>>> >>>>>>>>> Jacques >>>>>>>>> >>>>>>>>> Le 02/11/2015 22:53, Jacques Le Roux a écrit : >>>>>>>>>> This time trunk demo crashed, it was maybe due to OFBIZ-6707, it's restarting >>>>>>>>>> >>>>>>>>>> Jacques >>>>>>>>>> >>>>>>>>>> Le 30/10/2015 11:18, Jacques Le Roux a écrit : >>>>>>>>>>> Demos should all be back soon >>>>>>>>>>> >>>>>>>>>>> Enjoy :) >>>>>>>>>>> >>>>>>>>>>> Jacques >>>>>>>>>>> >>>>>>>>>>> Le 30/10/2015 09:58, Jacques Le Roux a écrit : >>>>>>>>>>>> The VM is down again since yesterday evening, checking with infra... >>>>>>>>>>>> >>>>>>>>>>>> Jacques >>>>>>>>>>>> >>>>>>>>>>>> Le 26/10/2015 14:56, Jacques Le Roux a écrit : >>>>>>>>>>>>> The VM is back, I'm restarting the demos >>>>>>>>>>>>> >>>>>>>>>>>>> Jacques >>>>>>>>>>>>> >>>>>>>>>>>>> Le 26/10/2015 08:47, Jacques Le Roux a écrit : >>>>>>>>>>>>>> FYI: All OFBiz demos are down, this is not due to OFBiz itself but the OFBIZ-VM the ASF infra team provides us for the demos. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >> > |
|
In reply to this post by Jacques Le Roux
Hi Jacques,
So does this now exclude Java 8? Taher Alkhateeb On Tue, Nov 24, 2015 at 6:33 PM, Jacques Le Roux < [hidden email]> wrote: > This time, as said someone of the infra team "the issue is the underlying > host looks fucked." > > All demos are now restarting, sorry for the delay > > Jacques > > Le 18/11/2015 11:30, Jacques Le Roux a écrit : > >> FYI: We got another old demo (R12.04) crash yesterday. So it seems Java 8 >> is not the issue. I'll wait a bit and put it back, it seems using nice and >> ionice commands helps >> >> You can now see in the footer which Java version has been used to compile >> a running instance (using ant svninfo or gitinfo) >> >> Jacques >> >> Le 14/11/2015 12:15, Jacques Le Roux a écrit : >> >>> Despite running under Java 7 with a longer time w/o VM crashing we got >>> another crash today. So at least Java 8 was not the only reason. I still >>> keep Java 7, since we had no issues before switching to 8, but it seems >>> there is another issue. >>> >>> ||The cron job, which runs nightly to restart the demos, will now use >>> "nice -n 19 ionice -c2 -n7" which is as nice as possible. We will see if >>> that helps. >>> >>> The demos restart (nicely), stay tuned... >>> >>> Jacques >>> >>> Le 05/11/2015 13:44, Jacques Le Roux a écrit : >>> >>>> All demos now run under Java 7 >>>> >>>> Jacques >>>> >>>> Le 05/11/2015 09:29, Jacques Le Roux a écrit : >>>> >>>>> OK, my last thought: no needs to revert in trunk I will simply revert >>>>> on the VM and will make Java 7 our default version on VM >>>>> >>>>> Waiting for infra (they are bored with my request I guess :D) >>>>> >>>>> Jacques >>>>> >>>>> Le 05/11/2015 09:24, Jacques Le Roux a écrit : >>>>> >>>>>> OK it seems we have an issue on the OFBIZ-VM since I replaced Java 7 >>>>>> by Java 8 there. >>>>>> The the OFBIZ-VM is down again and we know that arises because one >>>>>> (our?) demos suck/s all the VM power (100% CPU too long) >>>>>> >>>>>> Since we have no Java 8 features yet in trunk, I'd like to temporary >>>>>> revert the changes related with >>>>>> https://issues.apache.org/jira/browse/OFBIZ-6458 to test the >>>>>> hypothesis >>>>>> Opinions? >>>>>> >>>>>> In the meantime I will ask to reboot the VM again and will restart >>>>>> the demos >>>>>> >>>>>> Jacques >>>>>> >>>>>> >>>>>> Le 04/11/2015 12:47, Jacques Le Roux a écrit : >>>>>> >>>>>>> Infra just restarted the VM, I'm restarting the demos >>>>>>> >>>>>>> Jacques >>>>>>> >>>>>>> Le 04/11/2015 11:06, Jacques Le Roux a écrit : >>>>>>> >>>>>>>> Nope it's the VM see http://status.apache.org/ >>>>>>>> >>>>>>>> Jacques >>>>>>>> >>>>>>>> Le 04/11/2015 10:57, Taher Alkhateeb a écrit : >>>>>>>> >>>>>>>>> Hi Jacques, >>>>>>>>> >>>>>>>>> Is OFBiz the reason for this or is it the infrastructure itself? >>>>>>>>> Perhaps we need to check the logs for memory leaks. >>>>>>>>> >>>>>>>>> Taher Alkhateeb >>>>>>>>> >>>>>>>>> ----- Original Message ----- >>>>>>>>> >>>>>>>>> From: "Jacques Le Roux" <[hidden email]> >>>>>>>>> To: [hidden email] >>>>>>>>> Sent: Wednesday, 4 November, 2015 12:33:26 PM >>>>>>>>> Subject: Re: OFBiz demos all down >>>>>>>>> >>>>>>>>> The VM is down again since this morning, infra on it... >>>>>>>>> >>>>>>>>> Jacques >>>>>>>>> >>>>>>>>> Le 02/11/2015 22:53, Jacques Le Roux a écrit : >>>>>>>>> >>>>>>>>>> This time trunk demo crashed, it was maybe due to OFBIZ-6707, >>>>>>>>>> it's restarting >>>>>>>>>> >>>>>>>>>> Jacques >>>>>>>>>> >>>>>>>>>> Le 30/10/2015 11:18, Jacques Le Roux a écrit : >>>>>>>>>> >>>>>>>>>>> Demos should all be back soon >>>>>>>>>>> >>>>>>>>>>> Enjoy :) >>>>>>>>>>> >>>>>>>>>>> Jacques >>>>>>>>>>> >>>>>>>>>>> Le 30/10/2015 09:58, Jacques Le Roux a écrit : >>>>>>>>>>> >>>>>>>>>>>> The VM is down again since yesterday evening, checking with >>>>>>>>>>>> infra... >>>>>>>>>>>> >>>>>>>>>>>> Jacques >>>>>>>>>>>> >>>>>>>>>>>> Le 26/10/2015 14:56, Jacques Le Roux a écrit : >>>>>>>>>>>> >>>>>>>>>>>>> The VM is back, I'm restarting the demos >>>>>>>>>>>>> >>>>>>>>>>>>> Jacques >>>>>>>>>>>>> >>>>>>>>>>>>> Le 26/10/2015 08:47, Jacques Le Roux a écrit : >>>>>>>>>>>>> >>>>>>>>>>>>>> FYI: All OFBiz demos are down, this is not due to OFBiz >>>>>>>>>>>>>> itself but the OFBIZ-VM the ASF infra team provides us for the demos. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >> |
|
Administrator
|
Sincerely I have no sure ideas, I tried to look at the OFBiz and system logs but found anything.
But I believe Java 8 is not part of the problem indeed, because the same appears with Java 7. Could be that the machine really needed a power restart, let's see... Jacques Le 24/11/2015 19:00, Taher Alkhateeb a écrit : > Hi Jacques, > > So does this now exclude Java 8? > > Taher Alkhateeb > > On Tue, Nov 24, 2015 at 6:33 PM, Jacques Le Roux < > [hidden email]> wrote: > >> This time, as said someone of the infra team "the issue is the underlying >> host looks fucked." >> >> All demos are now restarting, sorry for the delay >> >> Jacques >> >> Le 18/11/2015 11:30, Jacques Le Roux a écrit : >> >>> FYI: We got another old demo (R12.04) crash yesterday. So it seems Java 8 >>> is not the issue. I'll wait a bit and put it back, it seems using nice and >>> ionice commands helps >>> >>> You can now see in the footer which Java version has been used to compile >>> a running instance (using ant svninfo or gitinfo) >>> >>> Jacques >>> >>> Le 14/11/2015 12:15, Jacques Le Roux a écrit : >>> >>>> Despite running under Java 7 with a longer time w/o VM crashing we got >>>> another crash today. So at least Java 8 was not the only reason. I still >>>> keep Java 7, since we had no issues before switching to 8, but it seems >>>> there is another issue. >>>> >>>> ||The cron job, which runs nightly to restart the demos, will now use >>>> "nice -n 19 ionice -c2 -n7" which is as nice as possible. We will see if >>>> that helps. >>>> >>>> The demos restart (nicely), stay tuned... >>>> >>>> Jacques >>>> >>>> Le 05/11/2015 13:44, Jacques Le Roux a écrit : >>>> >>>>> All demos now run under Java 7 >>>>> >>>>> Jacques >>>>> >>>>> Le 05/11/2015 09:29, Jacques Le Roux a écrit : >>>>> >>>>>> OK, my last thought: no needs to revert in trunk I will simply revert >>>>>> on the VM and will make Java 7 our default version on VM >>>>>> >>>>>> Waiting for infra (they are bored with my request I guess :D) >>>>>> >>>>>> Jacques >>>>>> >>>>>> Le 05/11/2015 09:24, Jacques Le Roux a écrit : >>>>>> >>>>>>> OK it seems we have an issue on the OFBIZ-VM since I replaced Java 7 >>>>>>> by Java 8 there. >>>>>>> The the OFBIZ-VM is down again and we know that arises because one >>>>>>> (our?) demos suck/s all the VM power (100% CPU too long) >>>>>>> >>>>>>> Since we have no Java 8 features yet in trunk, I'd like to temporary >>>>>>> revert the changes related with >>>>>>> https://issues.apache.org/jira/browse/OFBIZ-6458 to test the >>>>>>> hypothesis >>>>>>> Opinions? >>>>>>> >>>>>>> In the meantime I will ask to reboot the VM again and will restart >>>>>>> the demos >>>>>>> >>>>>>> Jacques >>>>>>> >>>>>>> >>>>>>> Le 04/11/2015 12:47, Jacques Le Roux a écrit : >>>>>>> >>>>>>>> Infra just restarted the VM, I'm restarting the demos >>>>>>>> >>>>>>>> Jacques >>>>>>>> >>>>>>>> Le 04/11/2015 11:06, Jacques Le Roux a écrit : >>>>>>>> >>>>>>>>> Nope it's the VM see http://status.apache.org/ >>>>>>>>> >>>>>>>>> Jacques >>>>>>>>> >>>>>>>>> Le 04/11/2015 10:57, Taher Alkhateeb a écrit : >>>>>>>>> >>>>>>>>>> Hi Jacques, >>>>>>>>>> >>>>>>>>>> Is OFBiz the reason for this or is it the infrastructure itself? >>>>>>>>>> Perhaps we need to check the logs for memory leaks. >>>>>>>>>> >>>>>>>>>> Taher Alkhateeb >>>>>>>>>> >>>>>>>>>> ----- Original Message ----- >>>>>>>>>> >>>>>>>>>> From: "Jacques Le Roux" <[hidden email]> >>>>>>>>>> To: [hidden email] >>>>>>>>>> Sent: Wednesday, 4 November, 2015 12:33:26 PM >>>>>>>>>> Subject: Re: OFBiz demos all down >>>>>>>>>> >>>>>>>>>> The VM is down again since this morning, infra on it... >>>>>>>>>> >>>>>>>>>> Jacques >>>>>>>>>> >>>>>>>>>> Le 02/11/2015 22:53, Jacques Le Roux a écrit : >>>>>>>>>> >>>>>>>>>>> This time trunk demo crashed, it was maybe due to OFBIZ-6707, >>>>>>>>>>> it's restarting >>>>>>>>>>> >>>>>>>>>>> Jacques >>>>>>>>>>> >>>>>>>>>>> Le 30/10/2015 11:18, Jacques Le Roux a écrit : >>>>>>>>>>> >>>>>>>>>>>> Demos should all be back soon >>>>>>>>>>>> >>>>>>>>>>>> Enjoy :) >>>>>>>>>>>> >>>>>>>>>>>> Jacques >>>>>>>>>>>> >>>>>>>>>>>> Le 30/10/2015 09:58, Jacques Le Roux a écrit : >>>>>>>>>>>> >>>>>>>>>>>>> The VM is down again since yesterday evening, checking with >>>>>>>>>>>>> infra... >>>>>>>>>>>>> >>>>>>>>>>>>> Jacques >>>>>>>>>>>>> >>>>>>>>>>>>> Le 26/10/2015 14:56, Jacques Le Roux a écrit : >>>>>>>>>>>>> >>>>>>>>>>>>>> The VM is back, I'm restarting the demos >>>>>>>>>>>>>> >>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>> >>>>>>>>>>>>>> Le 26/10/2015 08:47, Jacques Le Roux a écrit : >>>>>>>>>>>>>> >>>>>>>>>>>>>>> FYI: All OFBiz demos are down, this is not due to OFBiz >>>>>>>>>>>>>>> itself but the OFBIZ-VM the ASF infra team provides us for the demos. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>> |
|
Administrator
|
In reply to this post by Jacques Le Roux
The VM got another issue last night. The infra team just restarted it, I'm restarting the demos...
The infra team had already planned to move the OFBIZ-VM to another machine (currently nyx: http://www.apache.org/dev/machines.html). Since we have a lot of issues, they now prioritised it For now we hopefully should have less issues, Gavin "moved it to the High Resource Pool area so it can grab extra resources if necessary" Have a good weekend Jacques Le 24/11/2015 16:39, Jacques Le Roux a écrit : > BTW they had to power cycle the VM, so it was really "fucked up" indeed, crossing fingers... > > Jacques > > Le 24/11/2015 16:33, Jacques Le Roux a écrit : >> This time, as said someone of the infra team "the issue is the underlying host looks fucked." >> >> All demos are now restarting, sorry for the delay >> >> Jacques >> >> Le 18/11/2015 11:30, Jacques Le Roux a écrit : >>> FYI: We got another old demo (R12.04) crash yesterday. So it seems Java 8 is not the issue. I'll wait a bit and put it back, it seems using nice >>> and ionice commands helps >>> >>> You can now see in the footer which Java version has been used to compile a running instance (using ant svninfo or gitinfo) >>> >>> Jacques >>> >>> Le 14/11/2015 12:15, Jacques Le Roux a écrit : >>>> Despite running under Java 7 with a longer time w/o VM crashing we got another crash today. So at least Java 8 was not the only reason. I still >>>> keep Java 7, since we had no issues before switching to 8, but it seems there is another issue. >>>> >>>> ||The cron job, which runs nightly to restart the demos, will now use "nice -n 19 ionice -c2 -n7" which is as nice as possible. We will see if >>>> that helps. >>>> >>>> The demos restart (nicely), stay tuned... >>>> >>>> Jacques >>>> >>>> Le 05/11/2015 13:44, Jacques Le Roux a écrit : >>>>> All demos now run under Java 7 >>>>> >>>>> Jacques >>>>> >>>>> Le 05/11/2015 09:29, Jacques Le Roux a écrit : >>>>>> OK, my last thought: no needs to revert in trunk I will simply revert on the VM and will make Java 7 our default version on VM >>>>>> >>>>>> Waiting for infra (they are bored with my request I guess :D) >>>>>> >>>>>> Jacques >>>>>> >>>>>> Le 05/11/2015 09:24, Jacques Le Roux a écrit : >>>>>>> OK it seems we have an issue on the OFBIZ-VM since I replaced Java 7 by Java 8 there. >>>>>>> The the OFBIZ-VM is down again and we know that arises because one (our?) demos suck/s all the VM power (100% CPU too long) >>>>>>> >>>>>>> Since we have no Java 8 features yet in trunk, I'd like to temporary revert the changes related with >>>>>>> https://issues.apache.org/jira/browse/OFBIZ-6458 to test the hypothesis >>>>>>> Opinions? >>>>>>> >>>>>>> In the meantime I will ask to reboot the VM again and will restart the demos >>>>>>> >>>>>>> Jacques >>>>>>> >>>>>>> >>>>>>> Le 04/11/2015 12:47, Jacques Le Roux a écrit : >>>>>>>> Infra just restarted the VM, I'm restarting the demos >>>>>>>> >>>>>>>> Jacques >>>>>>>> >>>>>>>> Le 04/11/2015 11:06, Jacques Le Roux a écrit : >>>>>>>>> Nope it's the VM see http://status.apache.org/ >>>>>>>>> >>>>>>>>> Jacques >>>>>>>>> >>>>>>>>> Le 04/11/2015 10:57, Taher Alkhateeb a écrit : >>>>>>>>>> Hi Jacques, >>>>>>>>>> >>>>>>>>>> Is OFBiz the reason for this or is it the infrastructure itself? Perhaps we need to check the logs for memory leaks. >>>>>>>>>> >>>>>>>>>> Taher Alkhateeb >>>>>>>>>> >>>>>>>>>> ----- Original Message ----- >>>>>>>>>> >>>>>>>>>> From: "Jacques Le Roux" <[hidden email]> >>>>>>>>>> To: [hidden email] >>>>>>>>>> Sent: Wednesday, 4 November, 2015 12:33:26 PM >>>>>>>>>> Subject: Re: OFBiz demos all down >>>>>>>>>> >>>>>>>>>> The VM is down again since this morning, infra on it... >>>>>>>>>> >>>>>>>>>> Jacques >>>>>>>>>> >>>>>>>>>> Le 02/11/2015 22:53, Jacques Le Roux a écrit : >>>>>>>>>>> This time trunk demo crashed, it was maybe due to OFBIZ-6707, it's restarting >>>>>>>>>>> >>>>>>>>>>> Jacques >>>>>>>>>>> >>>>>>>>>>> Le 30/10/2015 11:18, Jacques Le Roux a écrit : >>>>>>>>>>>> Demos should all be back soon >>>>>>>>>>>> >>>>>>>>>>>> Enjoy :) >>>>>>>>>>>> >>>>>>>>>>>> Jacques >>>>>>>>>>>> >>>>>>>>>>>> Le 30/10/2015 09:58, Jacques Le Roux a écrit : >>>>>>>>>>>>> The VM is down again since yesterday evening, checking with infra... >>>>>>>>>>>>> >>>>>>>>>>>>> Jacques >>>>>>>>>>>>> >>>>>>>>>>>>> Le 26/10/2015 14:56, Jacques Le Roux a écrit : >>>>>>>>>>>>>> The VM is back, I'm restarting the demos >>>>>>>>>>>>>> >>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>> >>>>>>>>>>>>>> Le 26/10/2015 08:47, Jacques Le Roux a écrit : >>>>>>>>>>>>>>> FYI: All OFBiz demos are down, this is not due to OFBiz itself but the OFBIZ-VM the ASF infra team provides us for the demos. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Jacques >>>>>>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >>> >> > |
«
Return to OFBiz - User
|
1 view|%1 views
| Free forum by Nabble | Edit this page |