java.lang.OutOfMemoryError - still, please some advice?

[Ruth Hoffman]

Hello All:
Finally had a chance to try a recent version of OFBiz Webtools against
my 14M+ record database. The only thing I'm doing here is selecting the
Entity Reference tool & then selecting the link to "view data". As you
can see, I'm still getting that nasty out of memory error. Here's some
of the log file:

    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2) [            
    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
    is:
    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [    
    ContextFilter.java:183:INFO ] [Request]: /webtools/control/FindGeneric
    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [    
    ControlServlet.java:90 :INFO ] The character encoding of the request
    is: [null]. The character encoding we will use for the request and
    response is: [UTF-8]
    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [    
    ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
    doing setup- total:0.0,since last(Begin):0.0]]
    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [    
    ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):0.0]]
    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4) [          
    UtilXml.java:255:DEBUG] XML Read 0.026s:
    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [  
    ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
    0.0010s
    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [  
    ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [  
    ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
    0.0040s
    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [  
    ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in 0.0010s
    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [    
    RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [    
    RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
    Value for attribute "null" of uri "FindGeneric" not found
    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [    
    RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
    is a view.
    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [    
    RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4) [            
    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
    is:
    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
    jsp threw exception
    java.lang.OutOfMemoryError
    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [    
    JspViewHandler.java:88 :ERROR]
    ---- exception report
    ----------------------------------------------------------
    ServletException rendering JSP view
    Exception: javax.servlet.ServletException
    Message: null
    ---- stack trace
    ---------------------------------------------------------------
    javax.servlet.ServletException
    org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
    org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
    org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
    org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
    org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
    org.apache.catalina.core.ApplicationFilterCha..

To recap:
OFBiz version: 427128 (checked out today - July 31, 2006)
Postgres info from OFBiz log file:
2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]
Database Product Name is PostgreSQL
2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]
Database Product Version is 7.4.7
2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]
Database Driver Name is PostgreSQL Native Driver
2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]
Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]
Database Driver JDBC Version is 3.0

Also, I'm having the same problem when I try to programmatically access
this database and attempt to set the TYPE_SCROLL_INSENSITIVE. The Entity
Engine never returns from a call - just runs out of memory.

Ruth

[Ruth Hoffman]

To be more precise, the table that I am trying to view has: 1,571,094
records.

Ruth Hoffman wrote:

> Hello All:
> Finally had a chance to try a recent version of OFBiz Webtools against
> my 14M+ record database. The only thing I'm doing here is selecting
> the Entity Reference tool & then selecting the link to "view data". As
> you can see, I'm still getting that nasty out of memory error. Here's
> some of the log file:
>
>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2) [            
>    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
>    is:
>    
> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>
>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [        
> ContextFilter.java:183:INFO ] [Request]: /webtools/control/FindGeneric
>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [      
> ControlServlet.java:90 :INFO ] The character encoding of the request
>    is: [null]. The character encoding we will use for the request and
>    response is: [UTF-8]
>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [      
> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
>    doing setup- total:0.0,since last(Begin):0.0]]
>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [      
> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
>    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):0.0]]
>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4) [          
>    UtilXml.java:255:DEBUG] XML Read 0.026s:
>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [      
> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
>    0.0010s
>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [      
> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [      
> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
>    0.0040s
>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [      
> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in 0.0010s
>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [      
> RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [      
> RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
>    Value for attribute "null" of uri "FindGeneric" not found
>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [      
> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
>    is a view.
>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [      
> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4) [            
>    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
>    is:
>    
> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>
>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
>    jsp threw exception
>    java.lang.OutOfMemoryError
>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [      
> JspViewHandler.java:88 :ERROR]
>    ---- exception report
>    ----------------------------------------------------------
>    ServletException rendering JSP view
>    Exception: javax.servlet.ServletException
>    Message: null
>    ---- stack trace
>    ---------------------------------------------------------------
>    javax.servlet.ServletException
>    
> org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>
>    
> org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>
>    
> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>
>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>    
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>
>    
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>    org.apache.catalina.core.ApplicationFilterCha..
>
> To recap:
> OFBiz version: 427128 (checked out today - July 31, 2006)
> Postgres info from OFBiz log file:
> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]
> Database Product Name is PostgreSQL
> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]
> Database Product Version is 7.4.7
> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]
> Database Driver Name is PostgreSQL Native Driver
> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]
> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]
> Database Driver JDBC Version is 3.0
>
> Also, I'm having the same problem when I try to programmatically
> access this database and attempt to set the TYPE_SCROLL_INSENSITIVE.
> The Entity Engine never returns from a call - just runs out of memory.
>
> Ruth
>
>
>

[BJ Freeman]

I am guessing, and david will correct me, that the view has not be set
to use the cursors.
I am not sure if the widgets next and previous are setup to switch to
cursors if the data exceeds a certian amount.
would be a nice feature though.

Th only other options is to increase the Xms to more till you don't get
the out of memory.

if on windows, this will slow down the response, if the max you put in
exceeds real memory.


Ruth Hoffman sent the following on 7/31/2006 12:04 PM:

> To be more precise, the table that I am trying to view has: 1,571,094
> records.
>
> Ruth Hoffman wrote:
>
>> Hello All:
>> Finally had a chance to try a recent version of OFBiz Webtools against
>> my 14M+ record database. The only thing I'm doing here is selecting
>> the Entity Reference tool & then selecting the link to "view data". As
>> you can see, I'm still getting that nasty out of memory error. Here's
>> some of the log file:
>>
>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2) [            
>>    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
>>    is:
>>    
>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>
>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [        
>> ContextFilter.java:183:INFO ] [Request]: /webtools/control/FindGeneric
>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [      
>> ControlServlet.java:90 :INFO ] The character encoding of the request
>>    is: [null]. The character encoding we will use for the request and
>>    response is: [UTF-8]
>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [      
>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
>>    doing setup- total:0.0,since last(Begin):0.0]]
>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [      
>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
>>    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):0.0]]
>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4) [          
>>    UtilXml.java:255:DEBUG] XML Read 0.026s:
>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [      
>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
>>    0.0010s
>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [      
>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [      
>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
>>    0.0040s
>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [      
>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in 0.0010s
>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [      
>> RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [      
>> RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
>>    Value for attribute "null" of uri "FindGeneric" not found
>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [      
>> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
>>    is a view.
>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [      
>> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4) [            
>>    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
>>    is:
>>    
>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>
>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
>>    jsp threw exception
>>    java.lang.OutOfMemoryError
>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [      
>> JspViewHandler.java:88 :ERROR]
>>    ---- exception report
>>    ----------------------------------------------------------
>>    ServletException rendering JSP view
>>    Exception: javax.servlet.ServletException
>>    Message: null
>>    ---- stack trace
>>    ---------------------------------------------------------------
>>    javax.servlet.ServletException
>>    
>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>>
>>    
>> org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>>
>>    
>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>>
>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>    
>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>
>>    
>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>    org.apache.catalina.core.ApplicationFilterCha..
>>
>> To recap:
>> OFBiz version: 427128 (checked out today - July 31, 2006)
>> Postgres info from OFBiz log file:
>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]
>> Database Product Name is PostgreSQL
>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]
>> Database Product Version is 7.4.7
>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]
>> Database Driver Name is PostgreSQL Native Driver
>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]
>> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]
>> Database Driver JDBC Version is 3.0
>>
>> Also, I'm having the same problem when I try to programmatically
>> access this database and attempt to set the TYPE_SCROLL_INSENSITIVE.
>> The Entity Engine never returns from a call - just runs out of memory.
>>
>> Ruth
>>
>>
>>
>

[Ruth Hoffman]

Hi BJ:
Thanks for the quick reply.

In a recent email where I reported the same problem in an older version
of OFBiz, David and several others suggested that this had been fixed or
rather Webtools had been changed to use cursors. I'm here to report that
it does not appear to have any effect. I still get an OutOfMemoryError.

When I set xms (for example: MEMIF="-Xms512M -Xmx512M") I get the
following error (which was the subject of my orginal post - some time
ago - about Geronimo time outs):

006-07-31 14:50:35,443 (http-0.0.0.0-8443-Processor2) [    
RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
2006-07-31 14:50:35,452 (http-0.0.0.0-8443-Processor2) [            
Region.java:107:INFO ] real path for [/templates/main_template.jsp] is:
/Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
2006-07-31 14:52:21,717 (http-0.0.0.0-8443-Processor2)
[InheritableTransactionContext.java:311:ERROR] Unable to roll back
transaction
java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
        at
org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
        at
org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
        at
org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
        at
org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
        at
org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
        at
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
        at
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
        at
org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
        at
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
        at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
        at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
++++++ lots of stuff left out +++++++++
java.lang.Exception: Stack trace
        at java.lang.Thread.dumpStack(Thread.java:1082)
        at
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:194)
        at
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
        at
org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
        at
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
        at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
        at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
+++++ more stuff left out ++++++
java.lang.Thread.run(Thread.java:552)
javax.transaction.RollbackException: Transaction timout
org.apache.geronimo.transaction.manager.TransactionImpl.commit(TransactionImpl.java:236)
org.apache.geronimo.transaction.manager.TransactionManagerImpl.commit(TransactionManagerImpl.java:143)
org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:196)
org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
+++++ and on it goes ++++++


BJ Freeman wrote:

> I am guessing, and david will correct me, that the view has not be set
> to use the cursors.
> I am not sure if the widgets next and previous are setup to switch to
> cursors if the data exceeds a certian amount.
> would be a nice feature though.
>
> Th only other options is to increase the Xms to more till you don't
> get the out of memory.
>
> if on windows, this will slow down the response, if the max you put in
> exceeds real memory.
>
>
> Ruth Hoffman sent the following on 7/31/2006 12:04 PM:
>
>> To be more precise, the table that I am trying to view has: 1,571,094
>> records.
>>
>> Ruth Hoffman wrote:
>>
>>> Hello All:
>>> Finally had a chance to try a recent version of OFBiz Webtools
>>> against my 14M+ record database. The only thing I'm doing here is
>>> selecting the Entity Reference tool & then selecting the link to
>>> "view data". As you can see, I'm still getting that nasty out of
>>> memory error. Here's some of the log file:
>>>
>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)
>>> [               Region.java:107:INFO ] real path for
>>> [/templates/main_template.jsp]
>>>    is:
>>>    
>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>
>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [        
>>> ContextFilter.java:183:INFO ] [Request]: /webtools/control/FindGeneric
>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [      
>>> ControlServlet.java:90 :INFO ] The character encoding of the request
>>>    is: [null]. The character encoding we will use for the request and
>>>    response is: [UTF-8]
>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [      
>>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [      
>>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]
>>> Ser...):0.0]]
>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)
>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [      
>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
>>>    0.0010s
>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [      
>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [      
>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
>>>    0.0040s
>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [      
>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in
>>> 0.0010s
>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [      
>>> RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [      
>>> RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [      
>>> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
>>>    is a view.
>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [      
>>> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)
>>> [               Region.java:107:INFO ] real path for
>>> [/templates/main_template.jsp]
>>>    is:
>>>    
>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>
>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
>>>    jsp threw exception
>>>    java.lang.OutOfMemoryError
>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [      
>>> JspViewHandler.java:88 :ERROR]
>>>    ---- exception report
>>>    ----------------------------------------------------------
>>>    ServletException rendering JSP view
>>>    Exception: javax.servlet.ServletException
>>>    Message: null
>>>    ---- stack trace
>>>    ---------------------------------------------------------------
>>>    javax.servlet.ServletException
>>>    
>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>>>
>>>    
>>> org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>>>
>>>    
>>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>>>
>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>    
>>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>>
>>>    
>>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>>
>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>
>>> To recap:
>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>> Postgres info from OFBiz log file:
>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]
>>> Database Product Name is PostgreSQL
>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]
>>> Database Product Version is 7.4.7
>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]
>>> Database Driver Name is PostgreSQL Native Driver
>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]
>>> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]
>>> Database Driver JDBC Version is 3.0
>>>
>>> Also, I'm having the same problem when I try to programmatically
>>> access this database and attempt to set the TYPE_SCROLL_INSENSITIVE.
>>> The Entity Engine never returns from a call - just runs out of memory.
>>>
>>> Ruth
>>>
>>>
>>>
>>
>

[BJ Freeman]

I think the confusion is the cursors was for Import and Export, in web
tools based on the email dated back in may.

Ruth Hoffman sent the following on 7/31/2006 12:59 PM:

> Hi BJ:
> Thanks for the quick reply.
>
> In a recent email where I reported the same problem in an older version
> of OFBiz, David and several others suggested that this had been fixed or
> rather Webtools had been changed to use cursors. I'm here to report that
> it does not appear to have any effect. I still get an OutOfMemoryError.
>
> When I set xms (for example: MEMIF="-Xms512M -Xmx512M") I get the
> following error (which was the subject of my orginal post - some time
> ago - about Geronimo time outs):
>
> 006-07-31 14:50:35,443 (http-0.0.0.0-8443-Processor2) [    
> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
> 2006-07-31 14:50:35,452 (http-0.0.0.0-8443-Processor2) [            
> Region.java:107:INFO ] real path for [/templates/main_template.jsp] is:
> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>
> 2006-07-31 14:52:21,717 (http-0.0.0.0-8443-Processor2)
> [InheritableTransactionContext.java:311:ERROR] Unable to roll back
> transaction
> java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
>        at
> org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
>
>        at
> org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
>
>        at
> org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
>
>        at
> org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>
>        at
> org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>
>        at
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>
>        at
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>
>        at
> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>        at
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>        at
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>
>        at
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
> ++++++ lots of stuff left out +++++++++
> java.lang.Exception: Stack trace
>        at java.lang.Thread.dumpStack(Thread.java:1082)
>        at
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:194)
>
>        at
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>
>        at
> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>        at
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>        at
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>
>        at
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
> +++++ more stuff left out ++++++
> java.lang.Thread.run(Thread.java:552)
> javax.transaction.RollbackException: Transaction timout
> org.apache.geronimo.transaction.manager.TransactionImpl.commit(TransactionImpl.java:236)
>
> org.apache.geronimo.transaction.manager.TransactionManagerImpl.commit(TransactionManagerImpl.java:143)
>
> org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:196)
>
> org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>
> org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>
> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>
> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
> +++++ and on it goes ++++++
>
>
> BJ Freeman wrote:
>
>> I am guessing, and david will correct me, that the view has not be set
>> to use the cursors.
>> I am not sure if the widgets next and previous are setup to switch to
>> cursors if the data exceeds a certian amount.
>> would be a nice feature though.
>>
>> Th only other options is to increase the Xms to more till you don't
>> get the out of memory.
>>
>> if on windows, this will slow down the response, if the max you put in
>> exceeds real memory.
>>
>>
>> Ruth Hoffman sent the following on 7/31/2006 12:04 PM:
>>
>>> To be more precise, the table that I am trying to view has: 1,571,094
>>> records.
>>>
>>> Ruth Hoffman wrote:
>>>
>>>> Hello All:
>>>> Finally had a chance to try a recent version of OFBiz Webtools
>>>> against my 14M+ record database. The only thing I'm doing here is
>>>> selecting the Entity Reference tool & then selecting the link to
>>>> "view data". As you can see, I'm still getting that nasty out of
>>>> memory error. Here's some of the log file:
>>>>
>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)
>>>> [               Region.java:107:INFO ] real path for
>>>> [/templates/main_template.jsp]
>>>>    is:
>>>>    
>>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>
>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [        
>>>> ContextFilter.java:183:INFO ] [Request]: /webtools/control/FindGeneric
>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [      
>>>> ControlServlet.java:90 :INFO ] The character encoding of the request
>>>>    is: [null]. The character encoding we will use for the request and
>>>>    response is: [UTF-8]
>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [      
>>>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [      
>>>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]
>>>> Ser...):0.0]]
>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)
>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [      
>>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
>>>>    0.0010s
>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [      
>>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [      
>>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
>>>>    0.0040s
>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [      
>>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in
>>>> 0.0010s
>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [      
>>>> RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [      
>>>> RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [      
>>>> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
>>>>    is a view.
>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [      
>>>> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)
>>>> [               Region.java:107:INFO ] real path for
>>>> [/templates/main_template.jsp]
>>>>    is:
>>>>    
>>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>
>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
>>>>    jsp threw exception
>>>>    java.lang.OutOfMemoryError
>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [      
>>>> JspViewHandler.java:88 :ERROR]
>>>>    ---- exception report
>>>>    ----------------------------------------------------------
>>>>    ServletException rendering JSP view
>>>>    Exception: javax.servlet.ServletException
>>>>    Message: null
>>>>    ---- stack trace
>>>>    ---------------------------------------------------------------
>>>>    javax.servlet.ServletException
>>>>    
>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>>>>
>>>>    
>>>> org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>>>>
>>>>    
>>>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>>>>
>>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    
>>>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>>>
>>>>    
>>>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>>>
>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>
>>>> To recap:
>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>> Postgres info from OFBiz log file:
>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]
>>>> Database Product Name is PostgreSQL
>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]
>>>> Database Product Version is 7.4.7
>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]
>>>> Database Driver Name is PostgreSQL Native Driver
>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]
>>>> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]
>>>> Database Driver JDBC Version is 3.0
>>>>
>>>> Also, I'm having the same problem when I try to programmatically
>>>> access this database and attempt to set the TYPE_SCROLL_INSENSITIVE.
>>>> The Entity Engine never returns from a call - just runs out of memory.
>>>>
>>>> Ruth
>>>>
>>>>
>>>>
>>>
>>
>

[Ruth Hoffman]

Hi BJ:
Perhaps there is a misunderstanding and I am mistaken, but it doesn't
work, in this release, for the XML Export tools either :

    late.jsp] is:
    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
    2006-07-31 16:15:03,472 (http-0.0.0.0-8443-Processor3)
    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for servlet
    jsp threw exception
    java.lang.OutOfMemoryError
    2006-07-31 16:15:03,543 (http-0.0.0.0-8443-Processor3) [    
    JspViewHandler.java:88 :ERROR]
    ---- exception report
    ----------------------------------------------------------
    ServletException rendering JSP view
    Exception: javax.servlet.ServletException
    Message: null
    ---- stack trace
    ---------------------------------------------------------------
    javax.servlet.ServletException
    org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
    org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
    org.apache.jsp.entity.xmldsdump_jsp._jspService(xmldsdump_jsp.java:598)
    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)

Thanks
Ruth

BJ Freeman wrote:

> I think the confusion is the cursors was for Import and Export, in web
> tools based on the email dated back in may.
>
> Ruth Hoffman sent the following on 7/31/2006 12:59 PM:
>
>> Hi BJ:
>> Thanks for the quick reply.
>>
>> In a recent email where I reported the same problem in an older
>> version of OFBiz, David and several others suggested that this had
>> been fixed or rather Webtools had been changed to use cursors. I'm
>> here to report that it does not appear to have any effect. I still
>> get an OutOfMemoryError.
>>
>> When I set xms (for example: MEMIF="-Xms512M -Xmx512M") I get the
>> following error (which was the subject of my orginal post - some time
>> ago - about Geronimo time outs):
>>
>> 006-07-31 14:50:35,443 (http-0.0.0.0-8443-Processor2) [    
>> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>> 2006-07-31 14:50:35,452 (http-0.0.0.0-8443-Processor2) [            
>> Region.java:107:INFO ] real path for [/templates/main_template.jsp]
>> is:
>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>
>> 2006-07-31 14:52:21,717 (http-0.0.0.0-8443-Processor2)
>> [InheritableTransactionContext.java:311:ERROR] Unable to roll back
>> transaction
>> java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
>>        at
>> org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
>>
>>        at
>> org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
>>
>>        at
>> org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
>>
>>        at
>> org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>>
>>        at
>> org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>>
>>        at
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>>
>>        at
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>>        at
>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>>
>>        at
>> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>        at
>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>
>>        at
>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>> ++++++ lots of stuff left out +++++++++
>> java.lang.Exception: Stack trace
>>        at java.lang.Thread.dumpStack(Thread.java:1082)
>>        at
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:194)
>>
>>        at
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>>        at
>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>>
>>        at
>> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>        at javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>        at
>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>
>>        at
>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>        at
>> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>> +++++ more stuff left out ++++++
>> java.lang.Thread.run(Thread.java:552)
>> javax.transaction.RollbackException: Transaction timout
>> org.apache.geronimo.transaction.manager.TransactionImpl.commit(TransactionImpl.java:236)
>>
>> org.apache.geronimo.transaction.manager.TransactionManagerImpl.commit(TransactionManagerImpl.java:143)
>>
>> org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:196)
>>
>> org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>>
>> org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>>
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>>
>> org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>>
>> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>> javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>> +++++ and on it goes ++++++
>>
>>
>> BJ Freeman wrote:
>>
>>> I am guessing, and david will correct me, that the view has not be
>>> set to use the cursors.
>>> I am not sure if the widgets next and previous are setup to switch
>>> to cursors if the data exceeds a certian amount.
>>> would be a nice feature though.
>>>
>>> Th only other options is to increase the Xms to more till you don't
>>> get the out of memory.
>>>
>>> if on windows, this will slow down the response, if the max you put
>>> in exceeds real memory.
>>>
>>>
>>> Ruth Hoffman sent the following on 7/31/2006 12:04 PM:
>>>
>>>> To be more precise, the table that I am trying to view has:
>>>> 1,571,094 records.
>>>>
>>>> Ruth Hoffman wrote:
>>>>
>>>>> Hello All:
>>>>> Finally had a chance to try a recent version of OFBiz Webtools
>>>>> against my 14M+ record database. The only thing I'm doing here is
>>>>> selecting the Entity Reference tool & then selecting the link to
>>>>> "view data". As you can see, I'm still getting that nasty out of
>>>>> memory error. Here's some of the log file:
>>>>>
>>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)
>>>>> [               Region.java:107:INFO ] real path for
>>>>> [/templates/main_template.jsp]
>>>>>    is:
>>>>>    
>>>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>>
>>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [        
>>>>> ContextFilter.java:183:INFO ] [Request]:
>>>>> /webtools/control/FindGeneric
>>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [      
>>>>> ControlServlet.java:90 :INFO ] The character encoding of the request
>>>>>    is: [null]. The character encoding we will use for the request and
>>>>>    response is: [UTF-8]
>>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [      
>>>>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
>>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [      
>>>>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
>>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]
>>>>> Ser...):0.0]]
>>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)
>>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [      
>>>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in
>>>>>    0.0010s
>>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [      
>>>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in
>>>>> 0.0s
>>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [      
>>>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
>>>>>    0.0040s
>>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [      
>>>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in
>>>>> 0.0010s
>>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [      
>>>>> RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
>>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [      
>>>>> RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
>>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [      
>>>>> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
>>>>>    is a view.
>>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [      
>>>>> RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
>>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)
>>>>> [               Region.java:107:INFO ] real path for
>>>>> [/templates/main_template.jsp]
>>>>>    is:
>>>>>    
>>>>> /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>>
>>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for
>>>>> servlet
>>>>>    jsp threw exception
>>>>>    java.lang.OutOfMemoryError
>>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [      
>>>>> JspViewHandler.java:88 :ERROR]
>>>>>    ---- exception report
>>>>>    ----------------------------------------------------------
>>>>>    ServletException rendering JSP view
>>>>>    Exception: javax.servlet.ServletException
>>>>>    Message: null
>>>>>    ---- stack trace
>>>>>    ---------------------------------------------------------------
>>>>>    javax.servlet.ServletException
>>>>>    
>>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>>>>>
>>>>>    
>>>>> org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>>>>>
>>>>>    
>>>>> org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>>>>>
>>>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    
>>>>> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>>>>
>>>>>    
>>>>> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>>>>
>>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>>
>>>>> To recap:
>>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>> Postgres info from OFBiz log file:
>>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO
>>>>> ] Database Product Name is PostgreSQL
>>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO
>>>>> ] Database Product Version is 7.4.7
>>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO
>>>>> ] Database Driver Name is PostgreSQL Native Driver
>>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO
>>>>> ] Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build
>>>>> 311)
>>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO
>>>>> ] Database Driver JDBC Version is 3.0
>>>>>
>>>>> Also, I'm having the same problem when I try to programmatically
>>>>> access this database and attempt to set the
>>>>> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a
>>>>> call - just runs out of memory.
>>>>>
>>>>> Ruth
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>

[David E Jones-2]

This doesn't look like anything in OFBiz, there is just an error in  
your database setup.

I'm guessing the problem is that the PG8 drivers don't really work  
with PG7 databases... You MUST have a driver that matches your database.

In this case if you're using PG 7.4.7 you'll have to move down to a 7  
series JDBC driver. Of course, that will cause another problem  
because the 7 series drivers did NOT support paging through result  
sets using a database cursor, so you'll still get the out of memory  
error.

So, the only solution is to upgrade your database to an 8 series,  
preferably the latest stable 8.1 release. And of course update the  
JDBC driver while you're at it... ;)

-David


On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:

> Hello All:
> Finally had a chance to try a recent version of OFBiz Webtools  
> against my 14M+ record database. The only thing I'm doing here is  
> selecting the Entity Reference tool & then selecting the link to  
> "view data". As you can see, I'm still getting that nasty out of  
> memory error. Here's some of the log file:
>
>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
> [               Region.java:107:INFO ] real path for [/templates/
> main_template.jsp]
>    is:
>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/
> webtools/templates/main_template.jsp
>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  
> [        ContextFilter.java:183:INFO ] [Request]: /webtools/control/
> FindGeneric
>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)  
> [       ControlServlet.java:90 :INFO ] The character encoding of  
> the request
>    is: [null]. The character encoding we will use for the request and
>    response is: [UTF-8]
>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)  
> [       ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet  
> Starting,
>    doing setup- total:0.0,since last(Begin):0.0]]
>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)  
> [       ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done,  
> doing
>    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):
> 0.0]]
>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)  
> [      ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)  
> records in
>    0.0010s
>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)  
> [      ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)  
> records in 0.0s
>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)  
> [      ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)  
> records in
>    0.0040s
>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)  
> [      ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)  
> records in 0.0010s
>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)  
> [       RequestHandler.java:203:INFO ] [Processing Request]:  
> FindGeneric
>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)  
> [       RequestManager.java:114:INFO ]  
> [RequestManager.getRequestAttribute]
>    Value for attribute "null" of uri "FindGeneric" not found
>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)  
> [       RequestHandler.java:386:INFO ] [RequestHandler.doRequest]:  
> Response
>    is a view.
>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)  
> [       RequestHandler.java:538:INFO ] servletName=control,  
> view=FindGeneric
>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
> [               Region.java:107:INFO ] real path for [/templates/
> main_template.jsp]
>    is:
>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/
> webtools/templates/main_template.jsp
>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  
> servlet
>    jsp threw exception
>    java.lang.OutOfMemoryError
>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)  
> [       JspViewHandler.java:88 :ERROR]
>    ---- exception report
>    ----------------------------------------------------------
>    ServletException rendering JSP view
>    Exception: javax.servlet.ServletException
>    Message: null
>    ---- stack trace
>    ---------------------------------------------------------------
>    javax.servlet.ServletException
>    org.apache.jasper.runtime.PageContextImpl.doHandlePageException
> (PageContextImpl.java:858)
>    org.apache.jasper.runtime.PageContextImpl.handlePageException
> (PageContextImpl.java:791)
>    org.apache.jsp.entity.FindGeneric_jsp._jspService
> (FindGeneric_jsp.java:838)
>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>    org.apache.jasper.servlet.JspServletWrapper.service
> (JspServletWrapper.java:332)
>    org.apache.jasper.servlet.JspServlet.serviceJspFile
> (JspServlet.java:314)
>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>    org.apache.catalina.core.ApplicationFilterCha..
>
> To recap:
> OFBiz version: 427128 (checked out today - July 31, 2006)
> Postgres info from OFBiz log file:
> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]  
> Database Product Name is PostgreSQL
> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]  
> Database Product Version is 7.4.7
> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]  
> Database Driver Name is PostgreSQL Native Driver
> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]  
> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]  
> Database Driver JDBC Version is 3.0
>
> Also, I'm having the same problem when I try to programmatically  
> access this database and attempt to set the  
> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a  
> call - just runs out of memory.
>
> Ruth
>
>

[Ruth Hoffman]

Hi David:
Excuse my ignorance, I'm a bit confused:
The target database is an 8.x database and the local jar file I'm using is:
postgresql-8.0-311.jdbc3.jar
Where else would any Postgres stuff get configured in OFBiz?

Thanks
Ruth

David E Jones wrote:

>
> This doesn't look like anything in OFBiz, there is just an error in  
> your database setup.
>
> I'm guessing the problem is that the PG8 drivers don't really work  
> with PG7 databases... You MUST have a driver that matches your database.
>
> In this case if you're using PG 7.4.7 you'll have to move down to a 7  
> series JDBC driver. Of course, that will cause another problem  
> because the 7 series drivers did NOT support paging through result  
> sets using a database cursor, so you'll still get the out of memory  
> error.
>
> So, the only solution is to upgrade your database to an 8 series,  
> preferably the latest stable 8.1 release. And of course update the  
> JDBC driver while you're at it... ;)
>
> -David
>
>
> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>
>> Hello All:
>> Finally had a chance to try a recent version of OFBiz Webtools  
>> against my 14M+ record database. The only thing I'm doing here is  
>> selecting the Entity Reference tool & then selecting the link to  
>> "view data". As you can see, I'm still getting that nasty out of  
>> memory error. Here's some of the log file:
>>
>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
>> [               Region.java:107:INFO ] real path for [/templates/
>> main_template.jsp]
>>    is:
>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/
>> webtools/templates/main_template.jsp
>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  [        
>> ContextFilter.java:183:INFO ] [Request]: /webtools/control/ FindGeneric
>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)  [      
>> ControlServlet.java:90 :INFO ] The character encoding of  the request
>>    is: [null]. The character encoding we will use for the request and
>>    response is: [UTF-8]
>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)  [      
>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet  Starting,
>>    doing setup- total:0.0,since last(Begin):0.0]]
>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)  [      
>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done,  doing
>>    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):
>> 0.0]]
>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)  [      
>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)  records in
>>    0.0010s
>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)  [      
>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)  records in 0.0s
>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)  [      
>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)  records in
>>    0.0040s
>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)  [      
>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)  records in
>> 0.0010s
>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)  [      
>> RequestHandler.java:203:INFO ] [Processing Request]:  FindGeneric
>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)  [      
>> RequestManager.java:114:INFO ]  [RequestManager.getRequestAttribute]
>>    Value for attribute "null" of uri "FindGeneric" not found
>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)  [      
>> RequestHandler.java:386:INFO ] [RequestHandler.doRequest]:  Response
>>    is a view.
>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)  [      
>> RequestHandler.java:538:INFO ] servletName=control,  view=FindGeneric
>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
>> [               Region.java:107:INFO ] real path for [/templates/
>> main_template.jsp]
>>    is:
>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/
>> webtools/templates/main_template.jsp
>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  servlet
>>    jsp threw exception
>>    java.lang.OutOfMemoryError
>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)  [      
>> JspViewHandler.java:88 :ERROR]
>>    ---- exception report
>>    ----------------------------------------------------------
>>    ServletException rendering JSP view
>>    Exception: javax.servlet.ServletException
>>    Message: null
>>    ---- stack trace
>>    ---------------------------------------------------------------
>>    javax.servlet.ServletException
>>    org.apache.jasper.runtime.PageContextImpl.doHandlePageException
>> (PageContextImpl.java:858)
>>    org.apache.jasper.runtime.PageContextImpl.handlePageException
>> (PageContextImpl.java:791)
>>    org.apache.jsp.entity.FindGeneric_jsp._jspService
>> (FindGeneric_jsp.java:838)
>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>    org.apache.jasper.servlet.JspServletWrapper.service
>> (JspServletWrapper.java:332)
>>    org.apache.jasper.servlet.JspServlet.serviceJspFile
>> (JspServlet.java:314)
>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>    org.apache.catalina.core.ApplicationFilterCha..
>>
>> To recap:
>> OFBiz version: 427128 (checked out today - July 31, 2006)
>> Postgres info from OFBiz log file:
>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:765:INFO ]  
>> Database Product Name is PostgreSQL
>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:766:INFO ]  
>> Database Product Version is 7.4.7
>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:774:INFO ]  
>> Database Driver Name is PostgreSQL Native Driver
>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:775:INFO ]  
>> Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:776:INFO ]  
>> Database Driver JDBC Version is 3.0
>>
>> Also, I'm having the same problem when I try to programmatically  
>> access this database and attempt to set the  TYPE_SCROLL_INSENSITIVE.
>> The Entity Engine never returns from a  call - just runs out of memory.
>>
>> Ruth
>>
>>
>
>

[David E Jones-2]

The startup snippet you included has the following for the DB info:

>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>> Postgres info from OFBiz log file:
>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:
>>> 765:INFO ]  Database Product Name is PostgreSQL
>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:
>>> 766:INFO ]  Database Product Version is 7.4.7

That's definitely a 7 series version of Postgres...

On a side note, if updating Postgres is not an option, you could try  
the old 7 series JDBC driver that we used to have in SVN which Andy  
had hacked to support cursors... You'll have to dig around to find a  
good revision to pull it from, but it would be on the old server  
before the JDBC driver removal era.

-David


On Jul 31, 2006, at 4:11 PM, Ruth Hoffman wrote:

> Hi David:
> Excuse my ignorance, I'm a bit confused:
> The target database is an 8.x database and the local jar file I'm  
> using is:
> postgresql-8.0-311.jdbc3.jar
> Where else would any Postgres stuff get configured in OFBiz?
>
> Thanks
> Ruth
>
> David E Jones wrote:
>
>>
>> This doesn't look like anything in OFBiz, there is just an error  
>> in  your database setup.
>>
>> I'm guessing the problem is that the PG8 drivers don't really  
>> work  with PG7 databases... You MUST have a driver that matches  
>> your database.
>>
>> In this case if you're using PG 7.4.7 you'll have to move down to  
>> a 7  series JDBC driver. Of course, that will cause another  
>> problem  because the 7 series drivers did NOT support paging  
>> through result  sets using a database cursor, so you'll still get  
>> the out of memory  error.
>>
>> So, the only solution is to upgrade your database to an 8 series,  
>> preferably the latest stable 8.1 release. And of course update  
>> the  JDBC driver while you're at it... ;)
>>
>> -David
>>
>>
>> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>>
>>> Hello All:
>>> Finally had a chance to try a recent version of OFBiz Webtools  
>>> against my 14M+ record database. The only thing I'm doing here  
>>> is  selecting the Entity Reference tool & then selecting the link  
>>> to  "view data". As you can see, I'm still getting that nasty out  
>>> of  memory error. Here's some of the log file:
>>>
>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
>>> [               Region.java:107:INFO ] real path for [/templates/  
>>> main_template.jsp]
>>>    is:
>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>> webtools/templates/main_template.jsp
>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  
>>> [        ContextFilter.java:183:INFO ] [Request]: /webtools/
>>> control/ FindGeneric
>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)  
>>> [       ControlServlet.java:90 :INFO ] The character encoding of  
>>> the request
>>>    is: [null]. The character encoding we will use for the request  
>>> and
>>>    response is: [UTF-8]
>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)  
>>> [       ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet  
>>> Starting,
>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)  
>>> [       ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup  
>>> done,  doing
>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]  
>>> Ser...): 0.0]]
>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)  
>>> [      ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)  
>>> records in
>>>    0.0010s
>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)  
>>> [      ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)  
>>> records in 0.0s
>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)  
>>> [      ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)  
>>> records in
>>>    0.0040s
>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)  
>>> [      ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)  
>>> records in 0.0010s
>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)  
>>> [       RequestHandler.java:203:INFO ] [Processing Request]:  
>>> FindGeneric
>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)  
>>> [       RequestManager.java:114:INFO ]  
>>> [RequestManager.getRequestAttribute]
>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)  
>>> [       RequestHandler.java:386:INFO ]  
>>> [RequestHandler.doRequest]:  Response
>>>    is a view.
>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)  
>>> [       RequestHandler.java:538:INFO ] servletName=control,  
>>> view=FindGeneric
>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
>>> [               Region.java:107:INFO ] real path for [/templates/  
>>> main_template.jsp]
>>>    is:
>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>> webtools/templates/main_template.jsp
>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  
>>> servlet
>>>    jsp threw exception
>>>    java.lang.OutOfMemoryError
>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)  
>>> [       JspViewHandler.java:88 :ERROR]
>>>    ---- exception report
>>>    ----------------------------------------------------------
>>>    ServletException rendering JSP view
>>>    Exception: javax.servlet.ServletException
>>>    Message: null
>>>    ---- stack trace
>>>    ---------------------------------------------------------------
>>>    javax.servlet.ServletException
>>>    
>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException  
>>> (PageContextImpl.java:858)
>>>    org.apache.jasper.runtime.PageContextImpl.handlePageException  
>>> (PageContextImpl.java:791)
>>>    org.apache.jsp.entity.FindGeneric_jsp._jspService  
>>> (FindGeneric_jsp.java:838)
>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:
>>> 97)
>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>    org.apache.jasper.servlet.JspServletWrapper.service  
>>> (JspServletWrapper.java:332)
>>>    org.apache.jasper.servlet.JspServlet.serviceJspFile  
>>> (JspServlet.java:314)
>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>
>>> To recap:
>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>> Postgres info from OFBiz log file:
>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:
>>> 765:INFO ]  Database Product Name is PostgreSQL
>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:
>>> 766:INFO ]  Database Product Version is 7.4.7
>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:
>>> 774:INFO ]  Database Driver Name is PostgreSQL Native Driver
>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:
>>> 775:INFO ]  Database Driver Version is PostgreSQL 8.0 JDBC3 with  
>>> SSL (build 311)
>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:
>>> 776:INFO ]  Database Driver JDBC Version is 3.0
>>>
>>> Also, I'm having the same problem when I try to programmatically  
>>> access this database and attempt to set the  
>>> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a  
>>> call - just runs out of memory.
>>>
>>> Ruth
>>>
>>>
>>
>>

[Ruth Hoffman]

David:

Again, excuse my ignorance, but in the next few lines:
2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java: 775:INFO ]  
Database Driver Version is PostgreSQL 8.0 JDBC3 with  SSL (build 311)
2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java: 776:INFO ]  
Database Driver JDBC Version is 3.0

Where would the first few lines be coming from? What configuration
parameters have I overlooked?

TIA
Ruth

FYI - I can change to whatever version of the DB we need. The targe db
is an 8.x db. I've confirmed this with pgAdmin.



David E Jones wrote:

>
> The startup snippet you included has the following for the DB info:
>
>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>> Postgres info from OFBiz log file:
>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>> ]  Database Product Name is PostgreSQL
>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>> ]  Database Product Version is 7.4.7
>>>
>
> That's definitely a 7 series version of Postgres...
>
> On a side note, if updating Postgres is not an option, you could try  
> the old 7 series JDBC driver that we used to have in SVN which Andy  
> had hacked to support cursors... You'll have to dig around to find a  
> good revision to pull it from, but it would be on the old server  
> before the JDBC driver removal era.
>
> -David
>
>
> On Jul 31, 2006, at 4:11 PM, Ruth Hoffman wrote:
>
>> Hi David:
>> Excuse my ignorance, I'm a bit confused:
>> The target database is an 8.x database and the local jar file I'm  
>> using is:
>> postgresql-8.0-311.jdbc3.jar
>> Where else would any Postgres stuff get configured in OFBiz?
>>
>> Thanks
>> Ruth
>>
>> David E Jones wrote:
>>
>>>
>>> This doesn't look like anything in OFBiz, there is just an error  
>>> in  your database setup.
>>>
>>> I'm guessing the problem is that the PG8 drivers don't really  work  
>>> with PG7 databases... You MUST have a driver that matches  your
>>> database.
>>>
>>> In this case if you're using PG 7.4.7 you'll have to move down to  a
>>> 7  series JDBC driver. Of course, that will cause another  problem  
>>> because the 7 series drivers did NOT support paging  through result  
>>> sets using a database cursor, so you'll still get  the out of
>>> memory  error.
>>>
>>> So, the only solution is to upgrade your database to an 8 series,  
>>> preferably the latest stable 8.1 release. And of course update  the  
>>> JDBC driver while you're at it... ;)
>>>
>>> -David
>>>
>>>
>>> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>>>
>>>> Hello All:
>>>> Finally had a chance to try a recent version of OFBiz Webtools  
>>>> against my 14M+ record database. The only thing I'm doing here  is  
>>>> selecting the Entity Reference tool & then selecting the link  to  
>>>> "view data". As you can see, I'm still getting that nasty out  of  
>>>> memory error. Here's some of the log file:
>>>>
>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>> main_template.jsp]
>>>>    is:
>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>> webtools/templates/main_template.jsp
>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  
>>>> [        ContextFilter.java:183:INFO ] [Request]: /webtools/
>>>> control/ FindGeneric
>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:90 :INFO ] The character encoding of   the request
>>>>    is: [null]. The character encoding we will use for the request  and
>>>>    response is: [UTF-8]
>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet   Starting,
>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup  done,  doing
>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]  
>>>> Ser...): 0.0]]
>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)   records in
>>>>    0.0010s
>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)   records
>>>> in 0.0s
>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)   records in
>>>>    0.0040s
>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)   records in
>>>> 0.0010s
>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:203:INFO ] [Processing Request]:   FindGeneric
>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestManager.java:114:INFO ]   [RequestManager.getRequestAttribute]
>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:386:INFO ]  [RequestHandler.doRequest]:  Response
>>>>    is a view.
>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:538:INFO ] servletName=control,   view=FindGeneric
>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>> main_template.jsp]
>>>>    is:
>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>> webtools/templates/main_template.jsp
>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  
>>>> servlet
>>>>    jsp threw exception
>>>>    java.lang.OutOfMemoryError
>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)   [      
>>>> JspViewHandler.java:88 :ERROR]
>>>>    ---- exception report
>>>>    ----------------------------------------------------------
>>>>    ServletException rendering JSP view
>>>>    Exception: javax.servlet.ServletException
>>>>    Message: null
>>>>    ---- stack trace
>>>>    ---------------------------------------------------------------
>>>>    javax.servlet.ServletException
>>>>    
>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException  
>>>> (PageContextImpl.java:858)
>>>>    org.apache.jasper.runtime.PageContextImpl.handlePageException  
>>>> (PageContextImpl.java:791)
>>>>    org.apache.jsp.entity.FindGeneric_jsp._jspService  
>>>> (FindGeneric_jsp.java:838)
>>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java: 97)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    org.apache.jasper.servlet.JspServletWrapper.service  
>>>> (JspServletWrapper.java:332)
>>>>    org.apache.jasper.servlet.JspServlet.serviceJspFile  
>>>> (JspServlet.java:314)
>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>
>>>> To recap:
>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>> Postgres info from OFBiz log file:
>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>> ]  Database Product Name is PostgreSQL
>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>> ]  Database Product Version is 7.4.7
>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java: 774:INFO
>>>> ]  Database Driver Name is PostgreSQL Native Driver
>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java: 775:INFO
>>>> ]  Database Driver Version is PostgreSQL 8.0 JDBC3 with  SSL (build
>>>> 311)
>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java: 776:INFO
>>>> ]  Database Driver JDBC Version is 3.0
>>>>
>>>> Also, I'm having the same problem when I try to programmatically  
>>>> access this database and attempt to set the  
>>>> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a  
>>>> call - just runs out of memory.
>>>>
>>>> Ruth
>>>>
>>>>
>>>
>>>
>
>

[Ruth Hoffman]

David:
I'm really confused and not sure where I've gone wrong. Here's how
things stand now:

    * I have an external (on another server) Postgres 8.x database that
      I can see and talk to using local clients (psql & pgAdmin).

    * I have one version of OFBiz based on 7759 in which I get the out
      of memory error when I use webtools/entity reference & xml export
      against this same database. This version, BTW, was the same
      version I referenced in my orginal postings asking about Geronimo
      timeouts (early this month). If I look at the log files for this
      version I see:

    Doing database check as requested in entityengine.xml with
    addMissing=false
    119867 (main) [       DatabaseUtil.java:765:INFO ] Database Product
    Name is PostgreSQL
    119870 (main) [       DatabaseUtil.java:766:INFO ] Database Product
    Version is 8.1.4
    119873 (main) [       DatabaseUtil.java:774:INFO ] Database Driver
    Name is PostgreSQL Native Driver
    119887 (main) [       DatabaseUtil.java:775:INFO ] Database Driver
    Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
    119890 (main) [       DatabaseUtil.java:776:INFO ] Database Driver
    JDBC Version is 3.0

    Note - no mention of Postgres 7.4.x

    * I checked out version 427128 today, built it, added the same
      Postgres driver to this classpath (as used above). Copied over my
      entityengine.xml config file and the fieldtype...xml file as well
      as my entitydefs directory to the ecommerce component (I'm just
      using this directory to test) and updated the
      ofbiz-component.xm..and I get this in my log file when I start up:

    2006-07-31 18:28:06,122 (main) [       DatabaseUtil.java:765:INFO ]
    Database Product Name is PostgreSQL
    2006-07-31 18:28:06,124 (main) [       DatabaseUtil.java:766:INFO ]
    Database Product Version is 7.4.7
    2006-07-31 18:28:06,126 (main) [       DatabaseUtil.java:774:INFO ]
    Database Driver Name is PostgreSQL Native Driver
    2006-07-31 18:28:06,127 (main) [       DatabaseUtil.java:775:INFO ]
    Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
    2006-07-31 18:28:06,129 (main) [       DatabaseUtil.java:776:INFO ]
    Database Driver JDBC Version is 3.0
    2006-07-31 18:28:06,131 (main) [       DatabaseUtil.java:786:INFO ]
    Database Setting/Support Information (those with a * should be true):
    2006-07-31 18:28:06,132 (main) [       DatabaseUtil.java:787:INFO ]
    - supports transactions    [true]*

So, where have I gone wrong? I don't really even understand where lines
765-774 are coming from.
Thanks for your patience in helping me work through this.
Ruth

David E Jones wrote:

>
> The startup snippet you included has the following for the DB info:
>
>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>> Postgres info from OFBiz log file:
>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>> ]  Database Product Name is PostgreSQL
>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>> ]  Database Product Version is 7.4.7
>>>
>
> That's definitely a 7 series version of Postgres...
>
> On a side note, if updating Postgres is not an option, you could try  
> the old 7 series JDBC driver that we used to have in SVN which Andy  
> had hacked to support cursors... You'll have to dig around to find a  
> good revision to pull it from, but it would be on the old server  
> before the JDBC driver removal era.
>
> -David
>
>
> On Jul 31, 2006, at 4:11 PM, Ruth Hoffman wrote:
>
>> Hi David:
>> Excuse my ignorance, I'm a bit confused:
>> The target database is an 8.x database and the local jar file I'm  
>> using is:
>> postgresql-8.0-311.jdbc3.jar
>> Where else would any Postgres stuff get configured in OFBiz?
>>
>> Thanks
>> Ruth
>>
>> David E Jones wrote:
>>
>>>
>>> This doesn't look like anything in OFBiz, there is just an error  
>>> in  your database setup.
>>>
>>> I'm guessing the problem is that the PG8 drivers don't really  work  
>>> with PG7 databases... You MUST have a driver that matches  your
>>> database.
>>>
>>> In this case if you're using PG 7.4.7 you'll have to move down to  a
>>> 7  series JDBC driver. Of course, that will cause another  problem  
>>> because the 7 series drivers did NOT support paging  through result  
>>> sets using a database cursor, so you'll still get  the out of
>>> memory  error.
>>>
>>> So, the only solution is to upgrade your database to an 8 series,  
>>> preferably the latest stable 8.1 release. And of course update  the  
>>> JDBC driver while you're at it... ;)
>>>
>>> -David
>>>
>>>
>>> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>>>
>>>> Hello All:
>>>> Finally had a chance to try a recent version of OFBiz Webtools  
>>>> against my 14M+ record database. The only thing I'm doing here  is  
>>>> selecting the Entity Reference tool & then selecting the link  to  
>>>> "view data". As you can see, I'm still getting that nasty out  of  
>>>> memory error. Here's some of the log file:
>>>>
>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>> main_template.jsp]
>>>>    is:
>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>> webtools/templates/main_template.jsp
>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  
>>>> [        ContextFilter.java:183:INFO ] [Request]: /webtools/
>>>> control/ FindGeneric
>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:90 :INFO ] The character encoding of   the request
>>>>    is: [null]. The character encoding we will use for the request  and
>>>>    response is: [UTF-8]
>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet   Starting,
>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)   [      
>>>> ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup  done,  doing
>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]  
>>>> Ser...): 0.0]]
>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)   records in
>>>>    0.0010s
>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)   records
>>>> in 0.0s
>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)   records in
>>>>    0.0040s
>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)   [      
>>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)   records in
>>>> 0.0010s
>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:203:INFO ] [Processing Request]:   FindGeneric
>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestManager.java:114:INFO ]   [RequestManager.getRequestAttribute]
>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:386:INFO ]  [RequestHandler.doRequest]:  Response
>>>>    is a view.
>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)   [      
>>>> RequestHandler.java:538:INFO ] servletName=control,   view=FindGeneric
>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>> main_template.jsp]
>>>>    is:
>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>> webtools/templates/main_template.jsp
>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  
>>>> servlet
>>>>    jsp threw exception
>>>>    java.lang.OutOfMemoryError
>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)   [      
>>>> JspViewHandler.java:88 :ERROR]
>>>>    ---- exception report
>>>>    ----------------------------------------------------------
>>>>    ServletException rendering JSP view
>>>>    Exception: javax.servlet.ServletException
>>>>    Message: null
>>>>    ---- stack trace
>>>>    ---------------------------------------------------------------
>>>>    javax.servlet.ServletException
>>>>    
>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException  
>>>> (PageContextImpl.java:858)
>>>>    org.apache.jasper.runtime.PageContextImpl.handlePageException  
>>>> (PageContextImpl.java:791)
>>>>    org.apache.jsp.entity.FindGeneric_jsp._jspService  
>>>> (FindGeneric_jsp.java:838)
>>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java: 97)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    org.apache.jasper.servlet.JspServletWrapper.service  
>>>> (JspServletWrapper.java:332)
>>>>    org.apache.jasper.servlet.JspServlet.serviceJspFile  
>>>> (JspServlet.java:314)
>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>
>>>> To recap:
>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>> Postgres info from OFBiz log file:
>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>> ]  Database Product Name is PostgreSQL
>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>> ]  Database Product Version is 7.4.7
>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java: 774:INFO
>>>> ]  Database Driver Name is PostgreSQL Native Driver
>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java: 775:INFO
>>>> ]  Database Driver Version is PostgreSQL 8.0 JDBC3 with  SSL (build
>>>> 311)
>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java: 776:INFO
>>>> ]  Database Driver JDBC Version is 3.0
>>>>
>>>> Also, I'm having the same problem when I try to programmatically  
>>>> access this database and attempt to set the  
>>>> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a  
>>>> call - just runs out of memory.
>>>>
>>>> Ruth
>>>>
>>>>
>>>
>>>
>
>

[Ruth Hoffman]

Hi David:

Ok, I now know why I was getting the Postgres 7.4 log messages - when I
copied over my entity configuration over from my previous version, I
also copied an entity def for a local Postgres DB I'm using. I have
taken that out, removed all traces of the local Postgres database, but
it doesn't seem to make any difference.  I'm still getting these error
messages when I try and use Webtools/Entity Reference:

    2006-07-31 19:03:07,989 (http-0.0.0.0-8443-Processor2) [    
    ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet Starting,
    doing setup- total:0.0,since last(Begin):0.0]]
    2006-07-31 19:03:07,991 (http-0.0.0.0-8443-Processor2) [    
    ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done, doing
    Event(s) and View(s)- total:0.0,since last([FindGeneric] Ser...):0.0]]
    2006-07-31 19:03:08,017 (http-0.0.0.0-8443-Processor2) [          
    UtilXml.java:255:DEBUG] XML Read 0.023s:
    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
    2006-07-31 19:03:08,043 (http-0.0.0.0-8443-Processor2) [  
    ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records in 0.022s
    2006-07-31 19:03:08,047 (http-0.0.0.0-8443-Processor2) [  
    ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2) records in 0.0s
    2006-07-31 19:03:08,054 (http-0.0.0.0-8443-Processor2) [  
    ConfigXMLReader.java:294:INFO ] RequestMap Created: (78) records in
    0.0040s
    2006-07-31 19:03:08,057 (http-0.0.0.0-8443-Processor2) [  
    ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records in 0.0010s
    2006-07-31 19:03:08,104 (http-0.0.0.0-8443-Processor2) [    
    RequestHandler.java:203:INFO ] [Processing Request]: FindGeneric
    2006-07-31 19:03:08,150 (http-0.0.0.0-8443-Processor2) [    
    RequestManager.java:114:INFO ] [RequestManager.getRequestAttribute]
    Value for attribute "null" of uri "FindGeneric" not found
    2006-07-31 19:03:08,192 (http-0.0.0.0-8443-Processor2) [    
    RequestHandler.java:386:INFO ] [RequestHandler.doRequest]: Response
    is a view.
    2006-07-31 19:03:08,194 (http-0.0.0.0-8443-Processor2) [    
    RequestHandler.java:538:INFO ] servletName=control, view=FindGeneric
    2006-07-31 19:03:08,229 (http-0.0.0.0-8443-Processor2) [            
    Region.java:107:INFO ] real path for [/templates/main_template.jsp]
    is:
    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
    2006-07-31 19:04:43,140 (http-0.0.0.0-8443-Processor2)
    [InheritableTransactionContext.java:311:ERROR] Unable to roll back
    transaction
    java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
            at
    org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
            at
    org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
            at
    org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
            at
    org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
            at
    org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
            at
    org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
            at
    org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
            at
    org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)

    ++++++++ stuff deleted ++++++

    at
    org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
            at
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
            at java.lang.Thread.run(Thread.java:552)
    javax.transaction.RollbackException: Transaction timout
            at
    org.apache.geronimo.transaction.manager.TransactionImpl.commit(TransactionImpl.java:236)
            at
    org.apache.geronimo.transaction.manager.TransactionManagerImpl.commit(TransactionManagerImpl.java:143)

    +++++++ stuff deleted +++++++

    2006-07-31 19:04:47,726 (http-0.0.0.0-8443-Processor2) [    
    ControlServlet.java:186:ERROR]
    ---- exception report
    ----------------------------------------------------------
    Error in request handler:
    Exception: javax.servlet.ServletException
    Message: javax.servlet.jsp.JspException: Roll back error, could not
    commit transaction, was rolled back instead (Transaction timout)
    ---- stack trace
    ---------------------------------------------------------------
    javax.servlet.ServletException: javax.servlet.jsp.JspException: Roll
    back error, could not commit transaction, was rolled back instead
    (Transaction timout)
    org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:854)

    +++++ Stuff deleted ++++++

Here's the log file snippets from the startup:

2006-07-31 19:01:26,241 (main) [   GenericDelegator.java:193:INFO ]
Doing database check as requested in entityengine.xml with addMissing=false
2006-07-31 19:01:27,456 (main) [       DatabaseUtil.java:765:INFO ]
Database Product Name is PostgreSQL
2006-07-31 19:01:27,458 (main) [       DatabaseUtil.java:766:INFO ]
Database Product Version is 8.1.4
2006-07-31 19:01:27,460 (main) [       DatabaseUtil.java:774:INFO ]
Database Driver Name is PostgreSQL Native Driver
2006-07-31 19:01:27,464 (main) [       DatabaseUtil.java:775:INFO ]
Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
2006-07-31 19:01:27,478 (main) [       DatabaseUtil.java:776:INFO ]
Database Driver JDBC Version is 3.0
2006-07-31 19:01:27,480 (main) [       DatabaseUtil.java:786:INFO ]
Database Setting/Support Information (those with a * should be true):
2006-07-31 19:01:27,482 (main) [       DatabaseUtil.java:787:INFO ] -
supports transactions    [true]*
2006-07-31 19:01:27,496 (main) [       DatabaseUtil.java:788:INFO


Ruth Hoffman wrote:

> David:
> I'm really confused and not sure where I've gone wrong. Here's how
> things stand now:
>
>    * I have an external (on another server) Postgres 8.x database that
>      I can see and talk to using local clients (psql & pgAdmin).
>
>    * I have one version of OFBiz based on 7759 in which I get the out
>      of memory error when I use webtools/entity reference & xml export
>      against this same database. This version, BTW, was the same
>      version I referenced in my orginal postings asking about Geronimo
>      timeouts (early this month). If I look at the log files for this
>      version I see:
>
>    Doing database check as requested in entityengine.xml with
>    addMissing=false
>    119867 (main) [       DatabaseUtil.java:765:INFO ] Database Product
>    Name is PostgreSQL
>    119870 (main) [       DatabaseUtil.java:766:INFO ] Database Product
>    Version is 8.1.4
>    119873 (main) [       DatabaseUtil.java:774:INFO ] Database Driver
>    Name is PostgreSQL Native Driver
>    119887 (main) [       DatabaseUtil.java:775:INFO ] Database Driver
>    Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>    119890 (main) [       DatabaseUtil.java:776:INFO ] Database Driver
>    JDBC Version is 3.0
>
>    Note - no mention of Postgres 7.4.x
>
>    * I checked out version 427128 today, built it, added the same
>      Postgres driver to this classpath (as used above). Copied over my
>      entityengine.xml config file and the fieldtype...xml file as well
>      as my entitydefs directory to the ecommerce component (I'm just
>      using this directory to test) and updated the
>      ofbiz-component.xm..and I get this in my log file when I start up:
>
>    2006-07-31 18:28:06,122 (main) [       DatabaseUtil.java:765:INFO ]
>    Database Product Name is PostgreSQL
>    2006-07-31 18:28:06,124 (main) [       DatabaseUtil.java:766:INFO ]
>    Database Product Version is 7.4.7
>    2006-07-31 18:28:06,126 (main) [       DatabaseUtil.java:774:INFO ]
>    Database Driver Name is PostgreSQL Native Driver
>    2006-07-31 18:28:06,127 (main) [       DatabaseUtil.java:775:INFO ]
>    Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>    2006-07-31 18:28:06,129 (main) [       DatabaseUtil.java:776:INFO ]
>    Database Driver JDBC Version is 3.0
>    2006-07-31 18:28:06,131 (main) [       DatabaseUtil.java:786:INFO ]
>    Database Setting/Support Information (those with a * should be true):
>    2006-07-31 18:28:06,132 (main) [       DatabaseUtil.java:787:INFO ]
>    - supports transactions    [true]*
>
> So, where have I gone wrong? I don't really even understand where
> lines 765-774 are coming from.
> Thanks for your patience in helping me work through this.
> Ruth
>
> David E Jones wrote:
>
>>
>> The startup snippet you included has the following for the DB info:
>>
>>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>> Postgres info from OFBiz log file:
>>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>>> ]  Database Product Name is PostgreSQL
>>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>>> ]  Database Product Version is 7.4.7
>>>>
>>>>
>>
>> That's definitely a 7 series version of Postgres...
>>
>> On a side note, if updating Postgres is not an option, you could try  
>> the old 7 series JDBC driver that we used to have in SVN which Andy  
>> had hacked to support cursors... You'll have to dig around to find a  
>> good revision to pull it from, but it would be on the old server  
>> before the JDBC driver removal era.
>>
>> -David
>>
>>
>> On Jul 31, 2006, at 4:11 PM, Ruth Hoffman wrote:
>>
>>> Hi David:
>>> Excuse my ignorance, I'm a bit confused:
>>> The target database is an 8.x database and the local jar file I'm  
>>> using is:
>>> postgresql-8.0-311.jdbc3.jar
>>> Where else would any Postgres stuff get configured in OFBiz?
>>>
>>> Thanks
>>> Ruth
>>>
>>> David E Jones wrote:
>>>
>>>>
>>>> This doesn't look like anything in OFBiz, there is just an error  
>>>> in  your database setup.
>>>>
>>>> I'm guessing the problem is that the PG8 drivers don't really  
>>>> work  with PG7 databases... You MUST have a driver that matches  
>>>> your database.
>>>>
>>>> In this case if you're using PG 7.4.7 you'll have to move down to  
>>>> a 7  series JDBC driver. Of course, that will cause another  
>>>> problem  because the 7 series drivers did NOT support paging  
>>>> through result  sets using a database cursor, so you'll still get  
>>>> the out of memory  error.
>>>>
>>>> So, the only solution is to upgrade your database to an 8 series,  
>>>> preferably the latest stable 8.1 release. And of course update  
>>>> the  JDBC driver while you're at it... ;)
>>>>
>>>> -David
>>>>
>>>>
>>>> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>>>>
>>>>> Hello All:
>>>>> Finally had a chance to try a recent version of OFBiz Webtools  
>>>>> against my 14M+ record database. The only thing I'm doing here  
>>>>> is  selecting the Entity Reference tool & then selecting the link  
>>>>> to  "view data". As you can see, I'm still getting that nasty out  
>>>>> of  memory error. Here's some of the log file:
>>>>>
>>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)  
>>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>>> main_template.jsp]
>>>>>    is:
>>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>>> webtools/templates/main_template.jsp
>>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)  
>>>>> [        ContextFilter.java:183:INFO ] [Request]: /webtools/
>>>>> control/ FindGeneric
>>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)  
>>>>> [       ControlServlet.java:90 :INFO ] The character encoding of  
>>>>> the request
>>>>>    is: [null]. The character encoding we will use for the request  
>>>>> and
>>>>>    response is: [UTF-8]
>>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)  
>>>>> [       ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet  
>>>>> Starting,
>>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)  
>>>>> [       ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup  
>>>>> done,  doing
>>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]  
>>>>> Ser...): 0.0]]
>>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)  
>>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)   [      
>>>>> ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)   records in
>>>>>    0.0010s
>>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)   [      
>>>>> ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)   records
>>>>> in 0.0s
>>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)   [      
>>>>> ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)   records in
>>>>>    0.0040s
>>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)   [      
>>>>> ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)   records in
>>>>> 0.0010s
>>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)  
>>>>> [       RequestHandler.java:203:INFO ] [Processing Request]:  
>>>>> FindGeneric
>>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)  
>>>>> [       RequestManager.java:114:INFO ]  
>>>>> [RequestManager.getRequestAttribute]
>>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)  
>>>>> [       RequestHandler.java:386:INFO ]  
>>>>> [RequestHandler.doRequest]:  Response
>>>>>    is a view.
>>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)  
>>>>> [       RequestHandler.java:538:INFO ] servletName=control,  
>>>>> view=FindGeneric
>>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)  
>>>>> [               Region.java:107:INFO ] real path for [/templates/  
>>>>> main_template.jsp]
>>>>>    is:
>>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>>> webtools/templates/main_template.jsp
>>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for  
>>>>> servlet
>>>>>    jsp threw exception
>>>>>    java.lang.OutOfMemoryError
>>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)  
>>>>> [       JspViewHandler.java:88 :ERROR]
>>>>>    ---- exception report
>>>>>    ----------------------------------------------------------
>>>>>    ServletException rendering JSP view
>>>>>    Exception: javax.servlet.ServletException
>>>>>    Message: null
>>>>>    ---- stack trace
>>>>>    ---------------------------------------------------------------
>>>>>    javax.servlet.ServletException
>>>>>    
>>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException  
>>>>> (PageContextImpl.java:858)
>>>>>    org.apache.jasper.runtime.PageContextImpl.handlePageException  
>>>>> (PageContextImpl.java:791)
>>>>>    org.apache.jsp.entity.FindGeneric_jsp._jspService  
>>>>> (FindGeneric_jsp.java:838)
>>>>>    org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:
>>>>> 97)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.jasper.servlet.JspServletWrapper.service  
>>>>> (JspServletWrapper.java:332)
>>>>>    org.apache.jasper.servlet.JspServlet.serviceJspFile  
>>>>> (JspServlet.java:314)
>>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>>
>>>>> To recap:
>>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>> Postgres info from OFBiz log file:
>>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java: 765:INFO
>>>>> ]  Database Product Name is PostgreSQL
>>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java: 766:INFO
>>>>> ]  Database Product Version is 7.4.7
>>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java: 774:INFO
>>>>> ]  Database Driver Name is PostgreSQL Native Driver
>>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java: 775:INFO
>>>>> ]  Database Driver Version is PostgreSQL 8.0 JDBC3 with  SSL
>>>>> (build 311)
>>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java: 776:INFO
>>>>> ]  Database Driver JDBC Version is 3.0
>>>>>
>>>>> Also, I'm having the same problem when I try to programmatically  
>>>>> access this database and attempt to set the  
>>>>> TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a  
>>>>> call - just runs out of memory.
>>>>>
>>>>> Ruth
>>>>>
>>>>>
>>>>
>>>>
>>
>>
>

[David E Jones-2]

Ruth,

Here again you may have a JDBC driver version mismatch. I haven't  
looked into this in the pgsql web site, but keep in mind that you  
MUST use the correct version of the JDBC driver for the version of  
the database you are using... That can cause problems like this. In  
fact it was because of seeing so many of these errors popping up that  
we removed the JDBC drivers from SVN, ie so people would have to grab  
the right one to go with their database...

-David


On Jul 31, 2006, at 5:37 PM, Ruth Hoffman wrote:

> David:
> I'm really confused and not sure where I've gone wrong. Here's how  
> things stand now:
>
>    * I have an external (on another server) Postgres 8.x database that
>      I can see and talk to using local clients (psql & pgAdmin).
>
>    * I have one version of OFBiz based on 7759 in which I get the out
>      of memory error when I use webtools/entity reference & xml export
>      against this same database. This version, BTW, was the same
>      version I referenced in my orginal postings asking about Geronimo
>      timeouts (early this month). If I look at the log files for this
>      version I see:
>
>    Doing database check as requested in entityengine.xml with
>    addMissing=false
>    119867 (main) [       DatabaseUtil.java:765:INFO ] Database Product
>    Name is PostgreSQL
>    119870 (main) [       DatabaseUtil.java:766:INFO ] Database Product
>    Version is 8.1.4
>    119873 (main) [       DatabaseUtil.java:774:INFO ] Database Driver
>    Name is PostgreSQL Native Driver
>    119887 (main) [       DatabaseUtil.java:775:INFO ] Database Driver
>    Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)
>    119890 (main) [       DatabaseUtil.java:776:INFO ] Database Driver
>    JDBC Version is 3.0
>
>    Note - no mention of Postgres 7.4.x
>
>    * I checked out version 427128 today, built it, added the same
>      Postgres driver to this classpath (as used above). Copied over my
>      entityengine.xml config file and the fieldtype...xml file as well
>      as my entitydefs directory to the ecommerce component (I'm just
>      using this directory to test) and updated the
>      ofbiz-component.xm..and I get this in my log file when I start  
> up:
>
>    2006-07-31 18:28:06,122 (main) [       DatabaseUtil.java:765:INFO ]
>    Database Product Name is PostgreSQL
>    2006-07-31 18:28:06,124 (main) [       DatabaseUtil.java:766:INFO ]
>    Database Product Version is 7.4.7
>    2006-07-31 18:28:06,126 (main) [       DatabaseUtil.java:774:INFO ]
>    Database Driver Name is PostgreSQL Native Driver
>    2006-07-31 18:28:06,127 (main) [       DatabaseUtil.java:775:INFO ]
>    Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build  
> 311)
>    2006-07-31 18:28:06,129 (main) [       DatabaseUtil.java:776:INFO ]
>    Database Driver JDBC Version is 3.0
>    2006-07-31 18:28:06,131 (main) [       DatabaseUtil.java:786:INFO ]
>    Database Setting/Support Information (those with a * should be  
> true):
>    2006-07-31 18:28:06,132 (main) [       DatabaseUtil.java:787:INFO ]
>    - supports transactions    [true]*
>
> So, where have I gone wrong? I don't really even understand where  
> lines 765-774 are coming from.
> Thanks for your patience in helping me work through this.
> Ruth
>
> David E Jones wrote:
>
>>
>> The startup snippet you included has the following for the DB info:
>>
>>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>> Postgres info from OFBiz log file:
>>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:  
>>>>> 765:INFO ]  Database Product Name is PostgreSQL
>>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:  
>>>>> 766:INFO ]  Database Product Version is 7.4.7
>>>>
>>
>> That's definitely a 7 series version of Postgres...
>>
>> On a side note, if updating Postgres is not an option, you could  
>> try  the old 7 series JDBC driver that we used to have in SVN  
>> which Andy  had hacked to support cursors... You'll have to dig  
>> around to find a  good revision to pull it from, but it would be  
>> on the old server  before the JDBC driver removal era.
>>
>> -David
>>
>>
>> On Jul 31, 2006, at 4:11 PM, Ruth Hoffman wrote:
>>
>>> Hi David:
>>> Excuse my ignorance, I'm a bit confused:
>>> The target database is an 8.x database and the local jar file  
>>> I'm  using is:
>>> postgresql-8.0-311.jdbc3.jar
>>> Where else would any Postgres stuff get configured in OFBiz?
>>>
>>> Thanks
>>> Ruth
>>>
>>> David E Jones wrote:
>>>
>>>>
>>>> This doesn't look like anything in OFBiz, there is just an  
>>>> error  in  your database setup.
>>>>
>>>> I'm guessing the problem is that the PG8 drivers don't really  
>>>> work  with PG7 databases... You MUST have a driver that matches  
>>>> your database.
>>>>
>>>> In this case if you're using PG 7.4.7 you'll have to move down  
>>>> to  a 7  series JDBC driver. Of course, that will cause another  
>>>> problem  because the 7 series drivers did NOT support paging  
>>>> through result  sets using a database cursor, so you'll still  
>>>> get  the out of memory  error.
>>>>
>>>> So, the only solution is to upgrade your database to an 8  
>>>> series,   preferably the latest stable 8.1 release. And of  
>>>> course update  the  JDBC driver while you're at it... ;)
>>>>
>>>> -David
>>>>
>>>>
>>>> On Jul 31, 2006, at 12:54 PM, Ruth Hoffman wrote:
>>>>
>>>>> Hello All:
>>>>> Finally had a chance to try a recent version of OFBiz  
>>>>> Webtools   against my 14M+ record database. The only thing I'm  
>>>>> doing here  is  selecting the Entity Reference tool & then  
>>>>> selecting the link  to  "view data". As you can see, I'm still  
>>>>> getting that nasty out  of  memory error. Here's some of the  
>>>>> log file:
>>>>>
>>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2)    
>>>>> [               Region.java:107:INFO ] real path for [/
>>>>> templates/  main_template.jsp]
>>>>>    is:
>>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>>> webtools/templates/main_template.jsp
>>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4)    
>>>>> [        ContextFilter.java:183:INFO ] [Request]: /webtools/  
>>>>> control/ FindGeneric
>>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4)    
>>>>> [       ControlServlet.java:90 :INFO ] The character encoding  
>>>>> of   the request
>>>>>    is: [null]. The character encoding we will use for the  
>>>>> request  and
>>>>>    response is: [UTF-8]
>>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4)    
>>>>> [       ControlServlet.java:126:DEBUG] [[[FindGeneric]  
>>>>> Servlet   Starting,
>>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4)    
>>>>> [       ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup  
>>>>> done,  doing
>>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]  
>>>>> Ser...): 0.0]]
>>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4)    
>>>>> [              UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4)    
>>>>> [      ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4)    
>>>>> records in
>>>>>    0.0010s
>>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4)    
>>>>> [      ConfigXMLReader.java:614:INFO ] HandlerMap Created:  
>>>>> (2)   records in 0.0s
>>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4)    
>>>>> [      ConfigXMLReader.java:294:INFO ] RequestMap Created:  
>>>>> (78)   records in
>>>>>    0.0040s
>>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4)    
>>>>> [      ConfigXMLReader.java:403:INFO ] ViewMap Created: (51)    
>>>>> records in 0.0010s
>>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4)    
>>>>> [       RequestHandler.java:203:INFO ] [Processing Request]:    
>>>>> FindGeneric
>>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4)    
>>>>> [       RequestManager.java:114:INFO ]    
>>>>> [RequestManager.getRequestAttribute]
>>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4)    
>>>>> [       RequestHandler.java:386:INFO ]  
>>>>> [RequestHandler.doRequest]:  Response
>>>>>    is a view.
>>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4)    
>>>>> [       RequestHandler.java:538:INFO ] servletName=control,    
>>>>> view=FindGeneric
>>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4)    
>>>>> [               Region.java:107:INFO ] real path for [/
>>>>> templates/  main_template.jsp]
>>>>>    is:
>>>>>    /Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/  
>>>>> webtools/templates/main_template.jsp
>>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>>    org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service()  
>>>>> for   servlet
>>>>>    jsp threw exception
>>>>>    java.lang.OutOfMemoryError
>>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4)    
>>>>> [       JspViewHandler.java:88 :ERROR]
>>>>>    ---- exception report
>>>>>    ----------------------------------------------------------
>>>>>    ServletException rendering JSP view
>>>>>    Exception: javax.servlet.ServletException
>>>>>    Message: null
>>>>>    ---- stack trace
>>>>>    ---------------------------------------------------------------
>>>>>    javax.servlet.ServletException
>>>>>      
>>>>> org.apache.jasper.runtime.PageContextImpl.doHandlePageException  (
>>>>> PageContextImpl.java:858)
>>>>>    
>>>>> org.apache.jasper.runtime.PageContextImpl.handlePageException  
>>>>> (PageContextImpl.java:791)
>>>>>    org.apache.jsp.entity.FindGeneric_jsp._jspService  
>>>>> (FindGeneric_jsp.java:838)
>>>>>    org.apache.jasper.runtime.HttpJspBase.service
>>>>> (HttpJspBase.java: 97)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.jasper.servlet.JspServletWrapper.service  
>>>>> (JspServletWrapper.java:332)
>>>>>    org.apache.jasper.servlet.JspServlet.serviceJspFile  
>>>>> (JspServlet.java:314)
>>>>>    org.apache.jasper.servlet.JspServlet.service(JspServlet.java:
>>>>> 264)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>>
>>>>> To recap:
>>>>> OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>> Postgres info from OFBiz log file:
>>>>> 2006-07-31 13:36:04,584 (main) [       DatabaseUtil.java:  
>>>>> 765:INFO ]  Database Product Name is PostgreSQL
>>>>> 2006-07-31 13:36:04,586 (main) [       DatabaseUtil.java:  
>>>>> 766:INFO ]  Database Product Version is 7.4.7
>>>>> 2006-07-31 13:36:04,588 (main) [       DatabaseUtil.java:  
>>>>> 774:INFO ]  Database Driver Name is PostgreSQL Native Driver
>>>>> 2006-07-31 13:36:04,590 (main) [       DatabaseUtil.java:  
>>>>> 775:INFO ]  Database Driver Version is PostgreSQL 8.0 JDBC3  
>>>>> with  SSL (build 311)
>>>>> 2006-07-31 13:36:04,591 (main) [       DatabaseUtil.java:  
>>>>> 776:INFO ]  Database Driver JDBC Version is 3.0
>>>>>
>>>>> Also, I'm having the same problem when I try to  
>>>>> programmatically   access this database and attempt to set  
>>>>> the   TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns  
>>>>> from a   call - just runs out of memory.
>>>>>
>>>>> Ruth
>>>>>
>>>>>
>>>>
>>>>
>>
>>

[Ruth Hoffman]

David:
Please clarify, if you could - are you saying that PostgresSQL v. 8.1.4
(as a client) is not compatible with PostgresSQL 8.0? (as installed on
my remote db)

To your knowledge, has anyone ever successfully used the Entity Engine
with remote (not on the same server) database tables of over 1.5Milliion
records?


FYI - to verify Postgres versions,  log file from yesterday:
2006-08-01 09:42:30,687 (main) [       DatabaseUtil.java:765:INFO ]
Database Product Name is PostgreSQL
2006-08-01 09:42:30,689 (main) [       DatabaseUtil.java:766:INFO ]
Database Product Version is 8.1.4
2006-08-01 09:42:30,701 (main) [       DatabaseUtil.java:774:INFO ]
Database Driver Name is PostgreSQL Native Driver
2006-08-01 09:42:30,706 (main) [       DatabaseUtil.java:775:INFO ]
Database Driver Version is PostgreSQL 8.0 JDBC3 with SSL (build 311)

TIA
Ruth

[David E Jones-2]

On Aug 1, 2006, at 8:50 AM, Ruth Hoffman wrote:

> David:
> Please clarify, if you could - are you saying that PostgresSQL v.  
> 8.1.4 (as a client) is not compatible with PostgresSQL 8.0? (as  
> installed on my remote db)

I'm saying look at the pgsql web site because there are issues with  
using the wrong version of the JDBC driver for a given version of the  
database.

In other words, there are two different things: the database, and the  
JDBC driver. Each has its own version. If the JDBC driver version  
does not work with the version of the database it is talking to,  
things will not work.

> To your knowledge, has anyone ever successfully used the Entity  
> Engine with remote (not on the same server) database tables of over  
> 1.5Milliion records?

Yes, there are many OFBiz installations with single tables even  
larger than this and they work fine.

-David

[Ruth Hoffman]

Thanks David:
Now I have the same client version as the server version (here's the log
file):

    2006-08-01 10:14:06,553 (main) [       DatabaseUtil.java:765:INFO ]
    Database Product Name is PostgreSQL
    2006-08-01 10:14:06,555 (main) [       DatabaseUtil.java:766:INFO ]
    Database Product Version is 8.1.4
    2006-08-01 10:14:06,557 (main) [       DatabaseUtil.java:774:INFO ]
    Database Driver Name is PostgreSQL Native Driver
    2006-08-01 10:14:06,561 (main) [       DatabaseUtil.java:775:INFO ]
    Database Driver Version is PostgreSQL 8.1 JDBC3 with SSL (build 407)

And I just verified that: Webtools/Entity Reference; Webtools/XML export
& programmatic EntityListIterator...all cause either an out of memory
error or, a transaction time out error.

TIA
Ruth



David E Jones wrote:

>
> On Aug 1, 2006, at 8:50 AM, Ruth Hoffman wrote:
>
>> David:
>> Please clarify, if you could - are you saying that PostgresSQL v.  
>> 8.1.4 (as a client) is not compatible with PostgresSQL 8.0? (as  
>> installed on my remote db)
>
>
> I'm saying look at the pgsql web site because there are issues with  
> using the wrong version of the JDBC driver for a given version of the  
> database.
>
> In other words, there are two different things: the database, and the  
> JDBC driver. Each has its own version. If the JDBC driver version  
> does not work with the version of the database it is talking to,  
> things will not work.
>
>> To your knowledge, has anyone ever successfully used the Entity  
>> Engine with remote (not on the same server) database tables of over  
>> 1.5Milliion records?
>
>
> Yes, there are many OFBiz installations with single tables even  
> larger than this and they work fine.
>
> -David
>
>
>
>

[David E Jones-2]

Sounds like you have some digging to do then.

Please understand this is most likely a database configuration  
problem, not a problem that can be fixed with code or other changes  
in OFBiz.

The best thing to do is review the JDBC driver documentation to see  
if special parameters are needed, or in general do some debugging to  
see exactly what is going on.

Unless someone else has any tips from recent experience for you, I'm  
not sure how much help this mailing list can be...

Best of luck,
-David


On Aug 1, 2006, at 9:20 AM, Ruth Hoffman wrote:

> Thanks David:
> Now I have the same client version as the server version (here's  
> the log file):
>
>    2006-08-01 10:14:06,553 (main) [       DatabaseUtil.java:765:INFO ]
>    Database Product Name is PostgreSQL
>    2006-08-01 10:14:06,555 (main) [       DatabaseUtil.java:766:INFO ]
>    Database Product Version is 8.1.4
>    2006-08-01 10:14:06,557 (main) [       DatabaseUtil.java:774:INFO ]
>    Database Driver Name is PostgreSQL Native Driver
>    2006-08-01 10:14:06,561 (main) [       DatabaseUtil.java:775:INFO ]
>    Database Driver Version is PostgreSQL 8.1 JDBC3 with SSL (build  
> 407)
>
> And I just verified that: Webtools/Entity Reference; Webtools/XML  
> export & programmatic EntityListIterator...all cause either an out  
> of memory error or, a transaction time out error.
>
> TIA
> Ruth
>
>
>
> David E Jones wrote:
>
>>
>> On Aug 1, 2006, at 8:50 AM, Ruth Hoffman wrote:
>>
>>> David:
>>> Please clarify, if you could - are you saying that PostgresSQL  
>>> v.  8.1.4 (as a client) is not compatible with PostgresSQL 8.0?  
>>> (as  installed on my remote db)
>>
>>
>> I'm saying look at the pgsql web site because there are issues  
>> with  using the wrong version of the JDBC driver for a given  
>> version of the  database.
>>
>> In other words, there are two different things: the database, and  
>> the  JDBC driver. Each has its own version. If the JDBC driver  
>> version  does not work with the version of the database it is  
>> talking to,  things will not work.
>>
>>> To your knowledge, has anyone ever successfully used the Entity  
>>> Engine with remote (not on the same server) database tables of  
>>> over  1.5Milliion records?
>>
>>
>> Yes, there are many OFBiz installations with single tables even  
>> larger than this and they work fine.
>>
>> -David
>>
>>
>>
>>

[Ho Chan Heng]

Hi,

I have been recieving alot of emails from ofbiz, please kindly exclude me from your mailing list.

Thanks.

---

From:  BJ Freeman <[hidden email]>
Reply-To:  [hidden email]
To:  [hidden email]
Subject:  Re: java.lang.OutOfMemoryError - still, please some advice?
Date:  Mon, 31 Jul 2006 13:37:38 -0700

>I think the confusion is the cursors was for Import and Export, in
>web tools based on the email dated back in may.
>
>Ruth Hoffman sent the following on 7/31/2006 12:59 PM:
>>Hi BJ:
>>Thanks for the quick reply.
>>
>>In a recent email where I reported the same problem in an older
>>version of OFBiz, David and several others suggested that this had
>>been fixed or rather Webtools had been changed to use cursors. I'm
>>here to report that it does not appear to have any effect. I still
>>get an OutOfMemoryError.
>>
>>When I set xms (for example: MEMIF="-Xms512M -Xmx512M") I get the
>>following error (which was the subject of my orginal post - some
>>time ago - about Geronimo time outs):
>>
>>006-07-31 14:50:35,443 (http-0.0.0.0-8443-Processor2) [    
>>RequestHandler.java:538:INFO ] servletName=control,
>>view=FindGeneric
>>2006-07-31 14:50:35,452 (http-0.0.0.0-8443-Processor2) [            
>>  Region.java:107:INFO ] real path for
>>[/templates/main_template.jsp] is:
>>/Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>
>>2006-07-31 14:52:21,717 (http-0.0.0.0-8443-Processor2)
>>[InheritableTransactionContext.java:311:ERROR] Unable to roll back
>>transaction
>>java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
>>        at
>>org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
>>
>>        at
>>org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
>>
>>        at
>>org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
>>
>>        at
>>org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>>
>>        at
>>org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>>
>>        at
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>>
>>        at
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>>        at
>>org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>>        at
>>org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>        at
>>javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>        at
>>org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>
>>        at
>>org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>++++++ lots of stuff left out +++++++++
>>java.lang.Exception: Stack trace
>>        at java.lang.Thread.dumpStack(Thread.java:1082)
>>        at
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:194)
>>
>>        at
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>>        at
>>org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:188)
>>        at
>>org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>        at
>>javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>        at
>>org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>
>>        at
>>org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>        at
>>org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>+++++ more stuff left out ++++++
>>java.lang.Thread.run(Thread.java:552)
>>javax.transaction.RollbackException: Transaction timout
>>org.apache.geronimo.transaction.manager.TransactionImpl.commit(TransactionImpl.java:236)
>>
>>org.apache.geronimo.transaction.manager.TransactionManagerImpl.commit(TransactionManagerImpl.java:143)
>>
>>org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:196)
>>
>>org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>>
>>org.apache.geronimo.transaction.context.GeronimoTransactionManager.commit(GeronimoTransactionManager.java:81)
>>
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:181)
>>
>>org.ofbiz.entity.transaction.TransactionUtil.commit(TransactionUtil.java:167)
>>
>>org.apache.jsp.entity.FindG eneric_jsp._jspService(FindGeneric_jsp.java:188)
>>org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)
>>javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>+++++ and on it goes ++++++
>>
>>
>>BJ Freeman wrote:
>>
>>>I am guessing, and david will correct me, that the view has not be
>>>set to use the cursors.
>>>I am not sure if the widgets next and previous are setup to switch
>>>to cursors if the data exceeds a certian amount.
>>>would be a nice feature though.
>>>
>>>Th only other options is to increase the Xms to more till you
>>>don't get the out of memory.
>>>
>>>if on windows, this will slow down the response, if the max you
>>>put in exceeds real memory.
>>>
>>>
>>>Ruth Hoffman sent the following on 7/31/2006 12:04 PM:
>>>
>>>>To be more precise, the table that I am trying to view has:
>>>>1,571,094 records.
>>>>
>>>>Ruth Hoffman wrote:
>>>>
>>>>>Hello All:
>>>>>Finally had a chance to try a recent version of OFBiz Webtools
>>>>>against my 14M+ record database. The only thing I'm doing here
>>>>>is selecting the Entity Reference tool & then selecting the link
>>>>>to "view data". As you can see, I'm still getting that nasty out
>>>>>of memory error. Here's some of the log file:
>>>>>
>>>>>    2006-07-31 13:38:00,996 (http-0.0.0.0-8443-Processor2) [    
>>>>>           Region.java:107:INFO ] real path for
>>>>>[/templates/main_template.jsp]
>>>>>    is:
>>>>>    
>>>>>/Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>>
>>>>>    2006-07-31 13:38:20,017 (http-0.0.0.0-8443-Processor4) [    
>>>>>    ContextFilter.java:183:INFO ] [Request]:
>>>>>/webtools/control/FindGeneric
>>>>>    2006-07-31 13:38:20,019 (http-0.0.0.0-8443-Processor4) [    
>>>>>   ControlServlet.java:90 :INFO ] The character encoding of the
>>>>>request
>>>>>    is: [null]. The character encoding we will use for the
>>>>>request and
>>>>>    response is: [UTF-8]
>>>>>    2006-07-31 13:38:20,021 (http-0.0.0.0-8443-Processor4) [    
>>>>>   ControlServlet.java:126:DEBUG] [[[FindGeneric] Servlet
>>>>>Starting,
>>>>>    doing setup- total:0.0,since last(Begin):0.0]]
>>>>>    2006-07-31 13:38:20,023 (http-0.0.0.0-8443-Processor4) [    
>>>>>   ControlServlet.java:175:DEBUG] [[[FindGeneric] Setup done,
>>>>>doing
>>>>>    Event(s) and View(s)- total:0.0,since last([FindGeneric]
>>>>>Ser...):0.0]]
>>>>>    2006-07-31 13:38:20,052 (http-0.0.0.0-8443-Processor4) [    
>>>>>          UtilXml.java:255:DEBUG] XML Read 0.026s:
>>>>>    jndi:/0.0.0.0/webtools/WEB-INF/controller.xml
>>>>>    2006-07-31 13:38:20,056 (http-0.0.0.0-8443-Processor4) [    
>>>>>  ConfigXMLReader.java:544:INFO ] ConfigMap Created: (4) records
>>>>>in
>>>>>    0.0010s
>>>>>    2006-07-31 13:38:20,058 (http-0.0.0.0-8443-Processor4) [    
>>>>>  ConfigXMLReader.java:614:INFO ] HandlerMap Created: (2)
>>>>>records in 0.0s
>>>>>    2006-07-31 13:38:20,064 (http-0.0.0.0-8443-Processor4) [    
>>>>>  ConfigXMLReader.java:294:INFO ] RequestMap Created: (78)
>>>>>records in
>>>>>    0.0040s
>>>>>    2006-07-31 13:38:20,067 (http-0.0.0.0-8443-Processor4) [    
>>>>>  ConfigXMLReader.java:403:INFO ] ViewMap Created: (51) records
>>>>>in 0.0010s
>>>>>    2006-07-31 13:38:20,069 (http-0.0.0.0-8443-Processor4) [    
>>>>>   RequestHandler.java:203:INFO ] [Processing Request]:
>>>>>FindGeneric
>>>>>    2006-07-31 13:38:20,111 (http-0.0.0.0-8443-Processor4) [    
>>>>>   RequestManager.java:114:INFO ]
>>>>>[RequestManager.getRequestAttribute]
>>>>>    Value for attribute "null" of uri "FindGeneric" not found
>>>>>    2006-07-31 13:38:20,113 (http-0.0.0.0-8443-Processor4) [    
>>>>>   RequestHandler.java:386:INFO ] [RequestHandler.doRequest]:
>>>>>Response
>>>>>    is a view.
>>>>>    2006-07-31 13:38:20,115 (http-0.0.0.0-8443-Processor4) [    
>>>>>   RequestHandler.java:538:INFO ] servletName=control,
>>>>>view=FindGeneric
>>>>>    2006-07-31 13:38:20,117 (http-0.0.0.0-8443-Processor4) [    
>>>>>           Region.java:107:INFO ] real path for
>>>>>[/templates/main_template.jsp]
>>>>>    is:
>>>>>    
>>>>>/Users/ruthhoffman/427128ofbiz/framework/webtools/webapp/webtools/templates/main_template.jsp
>>>>>
>>>>>    2006-07-31 13:38:22,206 (http-0.0.0.0-8443-Processor4)
>>>>>    [XAConnectionFactory.java:119:WARN ] no xares in rms for con
>>>>>    
>>>>>org.ofbiz.minerva.pool.jdbc.xa.wrapper.XAConnectionImpl@d5bd50
>>>>>    2006-07-31 13:39:08,143 (http-0.0.0.0-8443-Processor4)
>>>>>    [ApplicationDispatcher.java:704:ERROR] Servlet.service() for
>>>>>servlet
>>>>>    jsp threw exception
>>>>>    java.lang.OutOfMemoryError
>>>>>    2006-07-31 13:39:08,261 (http-0.0.0.0-8443-Processor4) [    
>>>>>   JspViewHandler.java:88 :ERROR]
>>>>>    ---- exception report
>>>>>    ----------------------------------------------------------
>>>>>    ServletException rendering JSP view
>>>>>    Exception: javax.servlet.ServletException
>>>>>    Message: null
>>>>>    ---- stack trace
>>>>>    
>>>>>---------------------------------------------------------------
>>>>>    javax.servlet.ServletException
>>>>>    
>>>>>org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:858)
>>>>>
>>>>>    
>>>>>org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:791)
>>>>>
>>>>>    
>>>>>org.apache.jsp.entity.FindGeneric_jsp._jspService(FindGeneric_jsp.java:838)
>>>>>
>>>>>    
>>>>>org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97)

& gt;>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)

>>>>>    
>>>>>org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:332)
>>>>>
>>>>>    
>>>>>org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
>>>>>
>>>>>    
>>>>>org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
>>>>>    javax.servlet.http.HttpServlet.service(HttpServlet.java:688)
>>>>>    org.apache.catalina.core.ApplicationFilterCha..
>>>>>
>>>>>To recap:
>>>>>OFBiz version: 427128 (checked out today - July 31, 2006)
>>>>>Postgres info from OFBiz log file:
>>>>>2006-07-31 13:36:04,584 (main) [      
>>>>>DatabaseUtil.java:765:INFO ] Database Product Name is PostgreSQL
>>>>>2006-07-31 13:36:04,586 (main) [      
>>>>>DatabaseUtil.java:766:INFO ] Database Product Version is 7.4.7
>>>>>2006-07-31 13:36:04,588 (main) [      
>>>>>DatabaseUtil.java:774:INFO ] Database Driver Name is PostgreSQL
>>>>>Native Driver
>>>>>2006-07-31 13:36:04,590 (main) [      
>>>>>DatabaseUtil.java:775:INFO ] Database Driver Version is
>>>>>PostgreSQL 8.0 JDBC3 with SSL (build 311)
>>>>>2006-07-31 13:36:04,591 (main) [      
>>>>>DatabaseUtil.java:776:INFO ] Database Driver JDBC Version is 3.0
>>>>>
>>>>>Also, I'm having the same problem when I try to programmatically
>>>>>access this database and attempt to set the
>>>>>TYPE_SCROLL_INSENSITIVE. The Entity Engine never returns from a
>>>>>call - just runs out of memory.
>>>>>
>>>>>Ruth
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>

[Ruth Hoffman]

Hi David:
Ok, thats fair.
Thanks for your help.
Ruth

David E Jones wrote:

>
> Sounds like you have some digging to do then.
>
> Please understand this is most likely a database configuration  
> problem, not a problem that can be fixed with code or other changes  
> in OFBiz.
>
> The best thing to do is review the JDBC driver documentation to see  
> if special parameters are needed, or in general do some debugging to  
> see exactly what is going on.
>
> Unless someone else has any tips from recent experience for you, I'm  
> not sure how much help this mailing list can be...
>
> Best of luck,
> -David
>
>
> On Aug 1, 2006, at 9:20 AM, Ruth Hoffman wrote:
>
>> Thanks David:
>> Now I have the same client version as the server version (here's  the
>> log file):
>>
>>    2006-08-01 10:14:06,553 (main) [       DatabaseUtil.java:765:INFO ]
>>    Database Product Name is PostgreSQL
>>    2006-08-01 10:14:06,555 (main) [       DatabaseUtil.java:766:INFO ]
>>    Database Product Version is 8.1.4
>>    2006-08-01 10:14:06,557 (main) [       DatabaseUtil.java:774:INFO ]
>>    Database Driver Name is PostgreSQL Native Driver
>>    2006-08-01 10:14:06,561 (main) [       DatabaseUtil.java:775:INFO ]
>>    Database Driver Version is PostgreSQL 8.1 JDBC3 with SSL (build  407)
>>
>> And I just verified that: Webtools/Entity Reference; Webtools/XML  
>> export & programmatic EntityListIterator...all cause either an out  
>> of memory error or, a transaction time out error.
>>
>> TIA
>> Ruth
>>
>>
>>
>> David E Jones wrote:
>>
>>>
>>> On Aug 1, 2006, at 8:50 AM, Ruth Hoffman wrote:
>>>
>>>> David:
>>>> Please clarify, if you could - are you saying that PostgresSQL  v.  
>>>> 8.1.4 (as a client) is not compatible with PostgresSQL 8.0?  (as  
>>>> installed on my remote db)
>>>
>>>
>>>
>>> I'm saying look at the pgsql web site because there are issues  
>>> with  using the wrong version of the JDBC driver for a given  
>>> version of the  database.
>>>
>>> In other words, there are two different things: the database, and  
>>> the  JDBC driver. Each has its own version. If the JDBC driver  
>>> version  does not work with the version of the database it is  
>>> talking to,  things will not work.
>>>
>>>> To your knowledge, has anyone ever successfully used the Entity  
>>>> Engine with remote (not on the same server) database tables of  
>>>> over  1.5Milliion records?
>>>
>>>
>>>
>>> Yes, there are many OFBiz installations with single tables even  
>>> larger than this and they work fine.
>>>
>>> -David
>>>
>>>
>>>
>>>
>
>

[BJ Freeman]

couple of things to help on the db side
http://secure.linuxports.com/pgsql-novice/2002-04/msg00182.php
On Tue, 2006-08-01 at 14:51 +0000, Karl O. Pinc wrote:

 > > Whatever happened to the rpm packaging of the 7.x libpq?
 > > (Which enabled programs linked against the old libraries
 > > to be used with a 8.x. postgresql.)

http://developer.postgresql.org/~devrim/rpms/compat/



Ruth Hoffman sent the following on 8/1/2006 9:12 AM:

> Hi David:
> Ok, thats fair.
> Thanks for your help.
> Ruth
>
> David E Jones wrote:
>
>>
>> Sounds like you have some digging to do then.
>>
>> Please understand this is most likely a database configuration  
>> problem, not a problem that can be fixed with code or other changes  
>> in OFBiz.
>>
>> The best thing to do is review the JDBC driver documentation to see  
>> if special parameters are needed, or in general do some debugging to  
>> see exactly what is going on.
>>
>> Unless someone else has any tips from recent experience for you, I'm  
>> not sure how much help this mailing list can be...
>>
>> Best of luck,
>> -David
>>
>>
>> On Aug 1, 2006, at 9:20 AM, Ruth Hoffman wrote:
>>
>>> Thanks David:
>>> Now I have the same client version as the server version (here's  the
>>> log file):
>>>
>>>    2006-08-01 10:14:06,553 (main) [       DatabaseUtil.java:765:INFO ]
>>>    Database Product Name is PostgreSQL
>>>    2006-08-01 10:14:06,555 (main) [       DatabaseUtil.java:766:INFO ]
>>>    Database Product Version is 8.1.4
>>>    2006-08-01 10:14:06,557 (main) [       DatabaseUtil.java:774:INFO ]
>>>    Database Driver Name is PostgreSQL Native Driver
>>>    2006-08-01 10:14:06,561 (main) [       DatabaseUtil.java:775:INFO ]
>>>    Database Driver Version is PostgreSQL 8.1 JDBC3 with SSL (build  407)
>>>
>>> And I just verified that: Webtools/Entity Reference; Webtools/XML  
>>> export & programmatic EntityListIterator...all cause either an out  
>>> of memory error or, a transaction time out error.
>>>
>>> TIA
>>> Ruth
>>>
>>>
>>>
>>> David E Jones wrote:
>>>
>>>>
>>>> On Aug 1, 2006, at 8:50 AM, Ruth Hoffman wrote:
>>>>
>>>>> David:
>>>>> Please clarify, if you could - are you saying that PostgresSQL  v.  
>>>>> 8.1.4 (as a client) is not compatible with PostgresSQL 8.0?  (as  
>>>>> installed on my remote db)
>>>>
>>>>
>>>>
>>>> I'm saying look at the pgsql web site because there are issues  
>>>> with  using the wrong version of the JDBC driver for a given  
>>>> version of the  database.
>>>>
>>>> In other words, there are two different things: the database, and  
>>>> the  JDBC driver. Each has its own version. If the JDBC driver  
>>>> version  does not work with the version of the database it is  
>>>> talking to,  things will not work.
>>>>
>>>>> To your knowledge, has anyone ever successfully used the Entity  
>>>>> Engine with remote (not on the same server) database tables of  
>>>>> over  1.5Milliion records?
>>>>
>>>>
>>>>
>>>> Yes, there are many OFBiz installations with single tables even  
>>>> larger than this and they work fine.
>>>>
>>>> -David
>>>>
>>>>
>>>>
>>>>
>>
>>
>