OFBiz › OFBiz - User

Compression on https corrupting jvm frequently

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

5 messages Options

Deepak Agarwal-2

Compression on https corrupting jvm frequently

Hello,

We are experiencing a problem from last few days.

Our jvm is crashing with following within few minutes of the server start.

# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f8325c347e3, pid=3135, tid=140198839834384
#
# JRE version: 6.0_32-b03
# Java VM: Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode
linux-amd64 compressed oops)
# Problematic frame:
# C [libzip.so+0x77e3] char+0xa3
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

After a diagnose we see that this is majorly happening during compressing
the output. Following is a part of hs_err_pid file :

R11=0x00000000000001c8 is an unknown value
R12=0x00000000fffe58f1 is an unknown value
R13=0x00007f82b807c79b is an unknown value
R14=0x00007f82960b9370 is pointing into the stack for thread:
0x00007f830c044000
R15=0x00007f82b8008bf0 is an unknown value

Stack: [0x00007f8295fbd000,0x00007f82960be000], sp=0x00007f82960b91a0,
free space=1008k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
C [libzip.so+0x77e3] char+0xa3

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j java.util.zip.Deflater.deflateBytes(J[BII)I+0
j java.util.zip.Deflater.deflate([BII)I+59
j org.apache.coyote.http11.filters.FlushableGZIPOutputStream.deflate()V+14
j java.util.zip.DeflaterOutputStream.write([BII)V+81
j java.util.zip.GZIPOutputStream.write([BII)V+4
j
org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flushLastByte()V+19
j org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flush()V+26
j org.apache.coyote.http11.filters.GzipOutputFilter.flush()V+32
j org.apache.coyote.http11.AbstractOutputBuffer.flush()V+92
j org.apache.coyote.http11.InternalOutputBuffer.flush()V+1
j
org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+130
j
org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+31
j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+101
j org.apache.catalina.connector.OutputBuffer.flush()V+2
j org.apache.catalina.connector.CoyoteWriter.flush()V+12
j freemarker.core.Environment.process()V+45
j
org.ofbiz.base.util.template.FreeMarkerWorker.renderTemplate(Lfreemarker/template/Template;Ljava/util/Map;Ljava/lang/Appendable;)Lfreemarker/core/Environment;+25
j
org.ofbiz.widget.form.MacroFormRenderer.getEnvironment(Ljava/lang/Appendable;)Lfreemarker/core/Environment;+29
j
org.ofbiz.widget.form.MacroFormRenderer.executeMacro(Ljava/lang/Appendable;Ljava/lang/String;)V+2
j
org.ofbiz.widget.form.MacroFormRenderer.renderNextPrev(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+2151
j
org.ofbiz.widget.form.MacroFormRenderer.renderFormatListWrapperOpen(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+103
j
org.ofbiz.widget.form.ModelForm.renderListFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;I)V+9
j
org.ofbiz.widget.form.ModelForm.renderFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;)V+289
j
org.ofbiz.widget.screen.ModelScreenWidget$Form.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+137
j
org.ofbiz.widget.screen.MacroScreenRenderer.renderScreenletSubWidget(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ModelScreenWidget;Lorg/ofbiz/widget/screen/ModelScreenWidget$Screenlet;)V+168
j
org.ofbiz.widget.screen.ModelScreenWidget$Screenlet.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+138
j org.ofbiz.widget.screen.ModelScr

--
Thanks,
Deepak Agarwal,

Mobile: +91 9501190044

Adrian Crum-3

Re: Compression on https corrupting jvm frequently

"# The crash happened outside the Java Virtual Machine in native code."

Check for a newer version of your JRE.

-Adrian

Quoting Deepak Agarwal <[hidden email]>:

> Hello,
>
> We are experiencing a problem from last few days.
>
> Our jvm is crashing with following within few minutes of the server start.
>
>
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00007f8325c347e3, pid=3135, tid=140198839834384
> #
> # JRE version: 6.0_32-b03
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode
> linux-amd64 compressed oops)
> # Problematic frame:
> # C [libzip.so+0x77e3] char+0xa3
> #
> # If you would like to submit a bug report, please visit:
> # http://java.sun.com/webapps/bugreport/crash.jsp
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
>
> After a diagnose we see that this is majorly happening during compressing
> the output. Following is a part of hs_err_pid file :
>
>
> R11=0x00000000000001c8 is an unknown value
> R12=0x00000000fffe58f1 is an unknown value
> R13=0x00007f82b807c79b is an unknown value
> R14=0x00007f82960b9370 is pointing into the stack for thread:
> 0x00007f830c044000
> R15=0x00007f82b8008bf0 is an unknown value
>
>
> Stack: [0x00007f8295fbd000,0x00007f82960be000], sp=0x00007f82960b91a0,
> free space=1008k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
> code)
> C [libzip.so+0x77e3] char+0xa3
>
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> j java.util.zip.Deflater.deflateBytes(J[BII)I+0
> j java.util.zip.Deflater.deflate([BII)I+59
> j org.apache.coyote.http11.filters.FlushableGZIPOutputStream.deflate()V+14
> j java.util.zip.DeflaterOutputStream.write([BII)V+81
> j java.util.zip.GZIPOutputStream.write([BII)V+4
> j
>
> org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flushLastByte()V+19
> j org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flush()V+26
> j org.apache.coyote.http11.filters.GzipOutputFilter.flush()V+32
> j org.apache.coyote.http11.AbstractOutputBuffer.flush()V+92
> j org.apache.coyote.http11.InternalOutputBuffer.flush()V+1
> j
>
> org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+130
> j
>
> org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+31
> j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+101
> j org.apache.catalina.connector.OutputBuffer.flush()V+2
> j org.apache.catalina.connector.CoyoteWriter.flush()V+12
> j freemarker.core.Environment.process()V+45
> j
>
> org.ofbiz.base.util.template.FreeMarkerWorker.renderTemplate(Lfreemarker/template/Template;Ljava/util/Map;Ljava/lang/Appendable;)Lfreemarker/core/Environment;+25
> j
>
> org.ofbiz.widget.form.MacroFormRenderer.getEnvironment(Ljava/lang/Appendable;)Lfreemarker/core/Environment;+29
> j
>
> org.ofbiz.widget.form.MacroFormRenderer.executeMacro(Ljava/lang/Appendable;Ljava/lang/String;)V+2
> j
>
> org.ofbiz.widget.form.MacroFormRenderer.renderNextPrev(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+2151
> j
>
> org.ofbiz.widget.form.MacroFormRenderer.renderFormatListWrapperOpen(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+103
> j
>
> org.ofbiz.widget.form.ModelForm.renderListFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;I)V+9
> j
>
> org.ofbiz.widget.form.ModelForm.renderFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;)V+289
> j
>
> org.ofbiz.widget.screen.ModelScreenWidget$Form.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+137
> j
>
> org.ofbiz.widget.screen.MacroScreenRenderer.renderScreenletSubWidget(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ModelScreenWidget;Lorg/ofbiz/widget/screen/ModelScreenWidget$Screenlet;)V+168
> j
>
> org.ofbiz.widget.screen.ModelScreenWidget$Screenlet.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+138
> j org.ofbiz.widget.screen.ModelScr
>
> --
> Thanks,
> Deepak Agarwal,
>
> Mobile: +91 9501190044
>

Mike Z

Re: Compression on https corrupting jvm frequently

In reply to this post by Deepak Agarwal-2

Check how many entries you have in your jobs queue:

select count(*) from job_sandbox;

On Fri, Nov 2, 2012 at 3:46 AM, Deepak Agarwal <[hidden email]> wrote:

Deepak Agarwal

Re: Compression on https corrupting jvm frequently

job_sandbox has around 4k enteries. but shopping_list has around 1million
record, most of these entries have null party_id and visitor_id.

After disabling the https compression (ofbiz-containers.xml) the problem is
not occuring but may be it will come again a bit later.

On Fri, Nov 2, 2012 at 11:04 PM, Mike <[hidden email]> wrote:

> Check how many entries you have in your jobs queue:
>
> select count(*) from job_sandbox;
>
> On Fri, Nov 2, 2012 at 3:46 AM, Deepak Agarwal <[hidden email]>
> wrote:
>
> > Hello,
> >
> > We are experiencing a problem from last few days.
> >
> > Our jvm is crashing with following within few minutes of the server
> start.
> >
> >
> > # A fatal error has been detected by the Java Runtime Environment:
> > #
> > # SIGSEGV (0xb) at pc=0x00007f8325c347e3, pid=3135, tid=140198839834384
> > #
> > # JRE version: 6.0_32-b03
> > # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode
> > linux-amd64 compressed oops)
> > # Problematic frame:
> > # C [libzip.so+0x77e3] char+0xa3
> > #
> > # If you would like to submit a bug report, please visit:
> > # http://java.sun.com/webapps/bugreport/crash.jsp
> > # The crash happened outside the Java Virtual Machine in native code.
> > # See problematic frame for where to report the bug.
> > #
> >
> > After a diagnose we see that this is majorly happening during compressing
> > the output. Following is a part of hs_err_pid file :
> >
> >
> > R11=0x00000000000001c8 is an unknown value
> > R12=0x00000000fffe58f1 is an unknown value
> > R13=0x00007f82b807c79b is an unknown value
> > R14=0x00007f82960b9370 is pointing into the stack for thread:
> > 0x00007f830c044000
> > R15=0x00007f82b8008bf0 is an unknown value
> >
> >
> > Stack: [0x00007f8295fbd000,0x00007f82960be000], sp=0x00007f82960b91a0,
> > free space=1008k
> > Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
> > code)
> > C [libzip.so+0x77e3] char+0xa3
> >
> > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> > j java.util.zip.Deflater.deflateBytes(J[BII)I+0
> > j java.util.zip.Deflater.deflate([BII)I+59
> > j
> org.apache.coyote.http11.filters.FlushableGZIPOutputStream.deflate()V+14
> > j java.util.zip.DeflaterOutputStream.write([BII)V+81
> > j java.util.zip.GZIPOutputStream.write([BII)V+4
> > j
> >
> >
> org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flushLastByte()V+19
> > j org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flush()V+26
> > j org.apache.coyote.http11.filters.GzipOutputFilter.flush()V+32
> > j org.apache.coyote.http11.AbstractOutputBuffer.flush()V+92
> > j org.apache.coyote.http11.InternalOutputBuffer.flush()V+1
> > j
> >
> >
> org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+130
> > j
> >
> >
> org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+31
> > j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+101
> > j org.apache.catalina.connector.OutputBuffer.flush()V+2
> > j org.apache.catalina.connector.CoyoteWriter.flush()V+12
> > j freemarker.core.Environment.process()V+45
> > j
> >
> >
> org.ofbiz.base.util.template.FreeMarkerWorker.renderTemplate(Lfreemarker/template/Template;Ljava/util/Map;Ljava/lang/Appendable;)Lfreemarker/core/Environment;+25
> > j
> >
> >
> org.ofbiz.widget.form.MacroFormRenderer.getEnvironment(Ljava/lang/Appendable;)Lfreemarker/core/Environment;+29
> > j
> >
> >
> org.ofbiz.widget.form.MacroFormRenderer.executeMacro(Ljava/lang/Appendable;Ljava/lang/String;)V+2
> > j
> >
> >
> org.ofbiz.widget.form.MacroFormRenderer.renderNextPrev(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+2151
> > j
> >
> >
> org.ofbiz.widget.form.MacroFormRenderer.renderFormatListWrapperOpen(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+103
> > j
> >
> >
> org.ofbiz.widget.form.ModelForm.renderListFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;I)V+9
> > j
> >
> >
> org.ofbiz.widget.form.ModelForm.renderFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;)V+289
> > j
> >
> >
> org.ofbiz.widget.screen.ModelScreenWidget$Form.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+137
> > j
> >
> >
> org.ofbiz.widget.screen.MacroScreenRenderer.renderScreenletSubWidget(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ModelScreenWidget;Lorg/ofbiz/widget/screen/ModelScreenWidget$Screenlet;)V+168
> > j
> >
> >
> org.ofbiz.widget.screen.ModelScreenWidget$Screenlet.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+138
> > j org.ofbiz.widget.screen.ModelScr
> >
> > --
> > Thanks,
> > Deepak Agarwal,
> >
> > Mobile: +91 9501190044
> >
>

--
Thanks,
Deepak Agarwal,

Paxcel Technologies Pvt Ltd.
Hartron Complex, Sector 18, Gurgaon, India.
E-Mail: [hidden email]
Mobile: +91 9501190044

Mike Z

Re: Compression on https corrupting jvm frequently

You may want to check out that million row shopping_list table. Seems
suspicious to me.

On Fri, Nov 2, 2012 at 10:37 AM, Deepak Agarwal
<[hidden email]>wrote:

> job_sandbox has around 4k enteries. but shopping_list has around 1million
> record, most of these entries have null party_id and visitor_id.
>
> After disabling the https compression (ofbiz-containers.xml) the problem is
> not occuring but may be it will come again a bit later.
>
> On Fri, Nov 2, 2012 at 11:04 PM, Mike <[hidden email]> wrote:
>
> > Check how many entries you have in your jobs queue:
> >
> > select count(*) from job_sandbox;
> >
> > On Fri, Nov 2, 2012 at 3:46 AM, Deepak Agarwal <[hidden email]>
> > wrote:
> >
> > > Hello,
> > >
> > > We are experiencing a problem from last few days.
> > >
> > > Our jvm is crashing with following within few minutes of the server
> > start.
> > >
> > >
> > > # A fatal error has been detected by the Java Runtime Environment:
> > > #
> > > # SIGSEGV (0xb) at pc=0x00007f8325c347e3, pid=3135,
> tid=140198839834384
> > > #
> > > # JRE version: 6.0_32-b03
> > > # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode
> > > linux-amd64 compressed oops)
> > > # Problematic frame:
> > > # C [libzip.so+0x77e3] char+0xa3
> > > #
> > > # If you would like to submit a bug report, please visit:
> > > # http://java.sun.com/webapps/bugreport/crash.jsp
> > > # The crash happened outside the Java Virtual Machine in native code.
> > > # See problematic frame for where to report the bug.
> > > #
> > >
> > > After a diagnose we see that this is majorly happening during
> compressing
> > > the output. Following is a part of hs_err_pid file :
> > >
> > >
> > > R11=0x00000000000001c8 is an unknown value
> > > R12=0x00000000fffe58f1 is an unknown value
> > > R13=0x00007f82b807c79b is an unknown value
> > > R14=0x00007f82960b9370 is pointing into the stack for thread:
> > > 0x00007f830c044000
> > > R15=0x00007f82b8008bf0 is an unknown value
> > >
> > >
> > > Stack: [0x00007f8295fbd000,0x00007f82960be000], sp=0x00007f82960b91a0,
> > > free space=1008k
> > > Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
> C=native
> > > code)
> > > C [libzip.so+0x77e3] char+0xa3
> > >
> > > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> > > j java.util.zip.Deflater.deflateBytes(J[BII)I+0
> > > j java.util.zip.Deflater.deflate([BII)I+59
> > > j
> > org.apache.coyote.http11.filters.FlushableGZIPOutputStream.deflate()V+14
> > > j java.util.zip.DeflaterOutputStream.write([BII)V+81
> > > j java.util.zip.GZIPOutputStream.write([BII)V+4
> > > j
> > >
> > >
> >
> org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flushLastByte()V+19
> > > j
> org.apache.coyote.http11.filters.FlushableGZIPOutputStream.flush()V+26
> > > j org.apache.coyote.http11.filters.GzipOutputFilter.flush()V+32
> > > j org.apache.coyote.http11.AbstractOutputBuffer.flush()V+92
> > > j org.apache.coyote.http11.InternalOutputBuffer.flush()V+1
> > > j
> > >
> > >
> >
> org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+130
> > > j
> > >
> > >
> >
> org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V+31
> > > j org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+101
> > > j org.apache.catalina.connector.OutputBuffer.flush()V+2
> > > j org.apache.catalina.connector.CoyoteWriter.flush()V+12
> > > j freemarker.core.Environment.process()V+45
> > > j
> > >
> > >
> >
> org.ofbiz.base.util.template.FreeMarkerWorker.renderTemplate(Lfreemarker/template/Template;Ljava/util/Map;Ljava/lang/Appendable;)Lfreemarker/core/Environment;+25
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.MacroFormRenderer.getEnvironment(Ljava/lang/Appendable;)Lfreemarker/core/Environment;+29
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.MacroFormRenderer.executeMacro(Ljava/lang/Appendable;Ljava/lang/String;)V+2
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.MacroFormRenderer.renderNextPrev(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+2151
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.MacroFormRenderer.renderFormatListWrapperOpen(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/ModelForm;)V+103
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.ModelForm.renderListFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;I)V+9
> > > j
> > >
> > >
> >
> org.ofbiz.widget.form.ModelForm.renderFormString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/form/FormStringRenderer;)V+289
> > > j
> > >
> > >
> >
> org.ofbiz.widget.screen.ModelScreenWidget$Form.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+137
> > > j
> > >
> > >
> >
> org.ofbiz.widget.screen.MacroScreenRenderer.renderScreenletSubWidget(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ModelScreenWidget;Lorg/ofbiz/widget/screen/ModelScreenWidget$Screenlet;)V+168
> > > j
> > >
> > >
> >
> org.ofbiz.widget.screen.ModelScreenWidget$Screenlet.renderWidgetString(Ljava/lang/Appendable;Ljava/util/Map;Lorg/ofbiz/widget/screen/ScreenStringRenderer;)V+138
> > > j org.ofbiz.widget.screen.ModelScr
> > >
> > > --
> > > Thanks,
> > > Deepak Agarwal,
> > >
> > > Mobile: +91 9501190044
> > >
> >
>
>
>
> --
> Thanks,
> Deepak Agarwal,
>
> Paxcel Technologies Pvt Ltd.
> Hartron Complex, Sector 18, Gurgaon, India.
> E-Mail: [hidden email]
> Mobile: +91 9501190044
>