[jira] Created: (OFBIZ-2124) Ofbiz freeze

[Nicolas Malin (Jira)]

Ofbiz freeze
------------

                 Key: OFBIZ-2124
                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
             Project: OFBiz
          Issue Type: Bug
          Components: framework
    Affects Versions: Release Branch 4.0
         Environment: JDK5 1.5.0_15-b04, Linux
            Reporter: Philippe Mouawad
            Priority: Critical


In a certain scenario the application freezes, no more AJP connector thread are available.
I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment: ThreadDumps.zip

4 Thread dumps done after the freeze

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12664165#action_12664165 ]

Philippe Mouawad commented on OFBIZ-2124:
-----------------------------------------

After analysis the lock seems to come from very slow response time in GenericDelegator.clearAllCaches and particularily in CacheLineTable.keySet.

Furthermore, looking at org.ofbiz.base.util.cache.UtilCache, the class seems to have some synchronisation problems:
1) utilCacheTable.put calls are not synchronized
2) findCache synchronizes access to utilCacheTable while only getting an element which has big performance impact since utilCacheTable is static
3) clearExpiredFromAllCaches and clearAllCaches does not synchronize while clearCachesThatStartWith does,  why ?

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment: patch-Freeze-to-Trunk.patch

Here is a patch that synchronizes correctly the access to utilCacheTable

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment: patch-Freeze-to-Trunk.patch

Corrects synchronisation and optimises findCache

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment:     (was: patch-Freeze-to-Trunk.patch)

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment: patch-Freeze-to-Trunk.patch

The correct version

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment: patch-Freeze-to-Trunk.patch

Corrects synchronisation in class

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment:     (was: patch-Freeze-to-Trunk.patch)

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Philippe Mouawad updated OFBIZ-2124:
------------------------------------

    Attachment:     (was: patch-Freeze-to-Trunk.patch)

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666385#action_12666385 ]

Scott Gray commented on OFBIZ-2124:
-----------------------------------

Hi Philippe, just to clarify is this issue and patch for the 4.0 release branch or for the trunk?

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666526#action_12666526 ]

Philippe Mouawad commented on OFBIZ-2124:
-----------------------------------------

A patch on the trunk.
I can path the 4.0 release if you want.

Philippe
http://www.ubik-ingenierie.com

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: Release Branch 4.0
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Scott Gray updated OFBIZ-2124:
------------------------------

    Affects Version/s:     (was: Release Branch 4.0)
                       SVN trunk
        Fix Version/s: SVN trunk

Updated affected version to reflect Philippe's comment

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666988#action_12666988 ]

Jacques Le Roux commented on OFBIZ-2124:
----------------------------------------

Yes this is interesting, please do for R4 as well, Philippe

Thanks

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12673230#action_12673230 ]

Philippe Mouawad commented on OFBIZ-2124:
-----------------------------------------

Hello M. Gray,
Was the patch applied ?
I don't see any SVN commit or change.
Thank you for your answer

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacques Le Roux reassigned OFBIZ-2124:
--------------------------------------

    Assignee: Jacques Le Roux

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Assignee: Jacques Le Roux
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacques Le Roux updated OFBIZ-2124:
-----------------------------------

    Attachment: OFBIZ-2124_Ofbiz_freeze.patch

I have upadated the patch. It was not "mergeable" anymore, so I merged by hand and double-checked. I also replaced Iterators by for loops, ArrayList by FastList and tabs by 4 spaces.

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Assignee: Jacques Le Roux
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: OFBIZ-2124_Ofbiz_freeze.patch, patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

    [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12777938#action_12777938 ]

Philippe Mouawad commented on OFBIZ-2124:
-----------------------------------------

Hello M. Le Roux,
Do you think the patch will be applied soon ?
Philippe Mouawad
http://www.ubik-ingenierie.com

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Assignee: Jacques Le Roux
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: OFBIZ-2124_Ofbiz_freeze.patch, patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacques Le Roux closed OFBIZ-2124.
----------------------------------

    Resolution: Fixed

Hi Philippe,

Actually I wrote an email to the dev ML near than 2 months ago but I did not sent it because I had no time to put in this issue. I will send it now and we will see what the community think...

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Assignee: Jacques Le Roux
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: OFBIZ-2124_Ofbiz_freeze.patch, patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[Nicolas Malin (Jira)]

     [ https://issues.apache.org/jira/browse/OFBIZ-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacques Le Roux reopened OFBIZ-2124:
------------------------------------


Not sure why Scott closed this issue, I reopen

> Ofbiz freeze
> ------------
>
>                 Key: OFBIZ-2124
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-2124
>             Project: OFBiz
>          Issue Type: Bug
>          Components: framework
>    Affects Versions: SVN trunk
>         Environment: JDK5 1.5.0_15-b04, Linux
>            Reporter: Philippe Mouawad
>            Assignee: Jacques Le Roux
>            Priority: Critical
>             Fix For: SVN trunk
>
>         Attachments: OFBIZ-2124_Ofbiz_freeze.patch, patch-Freeze-to-Trunk.patch, ThreadDumps.zip
>
>
> In a certain scenario the application freezes, no more AJP connector thread are available.
> I attach 5 Thread dump done after the freeze

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.