[OFBiz] Users - XML import failure

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[OFBiz] Users - XML import failure

Christopher Farley
I'm running into a problem trying to import a large file into ofbiz using
the Web Tools xml import. I'm importing an XML file that has about 4,000
Product and ProductPrice records. I don't think there's anything wrong
with the data, but I get repeated failures whenever I try to import any
more than 600 records at a time. I'm using a recent subversion checkout.

Is anybody using ofbiz's xml import for relatively large imports? Am I
running into memory issues? The GUI reports "ERROR: A transaction error
occurred reading data". The console log has thousands of lines of error
messages, here is how they begin:


105182924 (http-0.0.0.0-8443-Processor2) [  ServiceDispatcher.java:447:DEBUG] [[Sync service finished- total:0.154,since last(Begin):0.154]] - 'entity-default / indexProductKeywords'
105182934 (http-0.0.0.0-8443-Processor2) [    EntitySaxReader.java:495:WARN ] Ignoring invalid field name [primaryProductCategory] found for the entity: Product with value=101
105182947 (http-0.0.0.0-8443-Processor2) [      EntityEcaRule.java:122:INFO ] Running Entity ECA Service: indexProductKeywords, triggered by rule on Entity: Product
105183018 (http-0.0.0.0-8443-Processor2) [            UtilXml.java:242:DEBUG] XML Read 0.057s: file:/Users/chris/src/ofbiz/applications/product/script/org/ofbiz/product/product/ProductServices.xml
105183067 (JotmBatch) [    TransactionImpl.java:765:INFO ] set rollback only (tx=bb14:38:0:01bc9c2640bfff0e69...547518:)
105183082 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
---- exception report ----------------------------------------------------------
[TransactionUtil.begin] active transaction marked for rollback in place, so no transaction begun; this stack trace shows when the exception began:
Exception: java.lang.Exception
Message: Tx Stack Placeholder
---- stack trace ---------------------------------------------------------------
java.lang.Exception: Tx Stack Placeholder
org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:518)
org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:117)
org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63)
org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:117)
org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHandler.java:85)
org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589)
org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
java.lang.Thread.run(Thread.java:552)
--------------------------------------------------------------------------------

105183156 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:615:WARN ] WARNING: In getSetRollbackOnlyCause no stack placeholder was in place, here is the current location:
105183162 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
---- exception report ----------------------------------------------------------
[TransactionUtil.begin] active transaction marked for rollback in place, so no transaction begun; this stack trace shows when the exception began:
Exception: java.lang.Exception
Message: Tx Stack Placeholder
---- stack trace ---------------------------------------------------------------
java.lang.Exception: Tx Stack Placeholder
org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:518)
org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:117)
org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63)
org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:117)
org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHandler.java:85)
org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589)
org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
java.lang.Thread.run(Thread.java:552)
--------------------------------------------------------------------------------

--
Christopher Farley
www.northernbrewer.com
 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Jacopo Cappellato
Hi Christopher,

which SVN version are you running? A version before or after the 6007?
Is the error happening exactly after TWO minutes you click the submit
button?

Thanks,

Jacopo

Christopher Farley wrote:

> I'm running into a problem trying to import a large file into ofbiz using
> the Web Tools xml import. I'm importing an XML file that has about 4,000
> Product and ProductPrice records. I don't think there's anything wrong
> with the data, but I get repeated failures whenever I try to import any
> more than 600 records at a time. I'm using a recent subversion checkout.
>
> Is anybody using ofbiz's xml import for relatively large imports? Am I
> running into memory issues? The GUI reports "ERROR: A transaction error
> occurred reading data". The console log has thousands of lines of error
> messages, here is how they begin:
>
>
> 105182924 (http-0.0.0.0-8443-Processor2) [  ServiceDispatcher.java:447:DEBUG] [[Sync service finished- total:0.154,since last(Begin):0.154]] - 'entity-default / indexProductKeywords'
> 105182934 (http-0.0.0.0-8443-Processor2) [    EntitySaxReader.java:495:WARN ] Ignoring invalid field name [primaryProductCategory] found for the entity: Product with value=101
> 105182947 (http-0.0.0.0-8443-Processor2) [      EntityEcaRule.java:122:INFO ] Running Entity ECA Service: indexProductKeywords, triggered by rule on Entity: Product
> 105183018 (http-0.0.0.0-8443-Processor2) [            UtilXml.java:242:DEBUG] XML Read 0.057s: file:/Users/chris/src/ofbiz/applications/product/script/org/ofbiz/product/product/ProductServices.xml
> 105183067 (JotmBatch) [    TransactionImpl.java:765:INFO ] set rollback only (tx=bb14:38:0:01bc9c2640bfff0e69...547518:)
> 105183082 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place, so no transaction begun; this stack trace shows when the exception began:
> Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:117)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63)
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:117)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHandler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589)
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
> org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------------
>
> 105183156 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:615:WARN ] WARNING: In getSetRollbackOnlyCause no stack placeholder was in place, here is the current location:
> 105183162 (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place, so no transaction begun; this stack trace shows when the exception began:
> Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(TransactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:117)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63)
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:117)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHandler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589)
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
> org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------------
>

 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Ian Gilbert
In reply to this post by Christopher Farley
Hi Chris,

We had import problems which seemed to dramatically improve once we
increased the amount of RAM in the machine.  However our issues were in
different records to the ones that you seem to be having trouble with.
How much memory are you working with?  Our problems were, I think, related
to the process timing out therefore a better server resolved many of the
issues that we were having.  Another way we found which mostly worked was
to break down the import/export into smaller chunks.

HTH

Ian

On Tue, November 1, 2005 7:34 am, Christopher Farley wrote:

> I'm running into a problem trying to import a large file into ofbiz using
>  the Web Tools xml import. I'm importing an XML file that has about 4,000
>  Product and ProductPrice records. I don't think there's anything wrong
> with the data, but I get repeated failures whenever I try to import any
> more than 600 records at a time. I'm using a recent subversion checkout.
>
> Is anybody using ofbiz's xml import for relatively large imports? Am I
> running into memory issues? The GUI reports "ERROR: A transaction error
> occurred reading data". The console log has thousands of lines of error
> messages, here is how they begin:
>
>
> 105182924 (http-0.0.0.0-8443-Processor2) [
> ServiceDispatcher.java:447:DEBUG] [[Sync service finished-
> total:0.154,since last(Begin):0.154]] - 'entity-default /
> indexProductKeywords' 105182934 (http-0.0.0.0-8443-Processor2) [
> EntitySaxReader.java:495:WARN ] Ignoring invalid field name
> [primaryProductCategory] found for the entity: Product with value=101
> 105182947 (http-0.0.0.0-8443-Processor2) [
> EntityEcaRule.java:122:INFO ] Running Entity ECA Service:
> indexProductKeywords, triggered by rule on Entity: Product 105183018
> (http-0.0.0.0-8443-Processor2) [            UtilXml.java:242:DEBUG] XML
> Read 0.057s:
> file:/Users/chris/src/ofbiz/applications/product/script/org/ofbiz/product
> /product/ProductServices.xml
> 105183067 (JotmBatch) [    TransactionImpl.java:765:INFO ] set rollback
> only (tx=bb14:38:0:01bc9c2640bfff0e69...547518:) 105183082
> (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report
> ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place,
> so no transaction begun; this stack trace shows when the exception began:
>  Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace
> ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(Tran
> sactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:11
> 7)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63
> )
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:11
> 7)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHan
> dler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589
> )
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
>  org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.
> java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.
> java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1
> 26)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1
> 05)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja
> va:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148
> )
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
>
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processCo
> nnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.j
> ava:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollower
> WorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.j
> ava:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------
> ------
>
>
> 105183156 (http-0.0.0.0-8443-Processor2) [
> TransactionUtil.java:615:WARN ] WARNING: In getSetRollbackOnlyCause no
> stack placeholder was in place, here is the current location: 105183162
> (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report
> ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place,
> so no transaction begun; this stack trace shows when the exception began:
>  Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace
> ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(Tran
> sactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:11
> 7)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63
> )
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:11
> 7)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHan
> dler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589
> )
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
>  org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.
> java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.
> java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1
> 26)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1
> 05)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja
> va:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148
> )
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
>
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processCo
> nnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.j
> ava:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollower
> WorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.j
> ava:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------
> ------
>
>
> --
> Christopher Farley
> www.northernbrewer.com
>
> _______________________________________________
> Users mailing list
> [hidden email]
> http://lists.ofbiz.org/mailman/listinfo/users
>
>


 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Christopher Farley
In reply to this post by Jacopo Cappellato
Jacopo Cappellato ([hidden email]) wrote:

> Hi Christopher,
>
> which SVN version are you running? A version before or after the 6007?
> Is the error happening exactly after TWO minutes you click the submit
> button?

Anecdeotally, yes, it definitely seems like two minutes. `svn info`
shows I've got version 6044. However, there's some possibility that
I synced the repository but never re-compiled. I'm assuming you are
asking because of a known issue 6007. I'll let you know!

--
Christopher Farley
www.northernbrewer.com
 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Jacopo Cappellato
Hi Christopher,

I'm asking this because in rev. 6007 we have migrated the import jsp
page to the widget; and two minutes is the default transaction timeout
of a screen built with widgets.

Could you please verify:

1) if in the framework\webtools\widget\EntityScreen.xml file, inside the
action element of the "EntityImport" screen definition, there is a line
like this:

<set field="parameters.TRANSACTION_TIMEOUT" value="7200"/>

(this line should set the screen timeout to two hours)

2) if you have recompiled the framework\widget component

?

Jacopo


Christopher Farley wrote:

> Jacopo Cappellato ([hidden email]) wrote:
>
>
>>Hi Christopher,
>>
>>which SVN version are you running? A version before or after the 6007?
>>Is the error happening exactly after TWO minutes you click the submit
>>button?
>
>
> Anecdeotally, yes, it definitely seems like two minutes. `svn info`
> shows I've got version 6044. However, there's some possibility that
> I synced the repository but never re-compiled. I'm assuming you are
> asking because of a known issue 6007. I'll let you know!
>

 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Christopher Farley
In reply to this post by Christopher Farley
Christopher Farley ([hidden email]) wrote:

> Anecdeotally, yes, it definitely seems like two minutes. `svn info`
> shows I've got version 6044. However, there's some possibility that
> I synced the repository but never re-compiled. I'm assuming you are
> asking because of a known issue 6007. I'll let you know!

Actually, even with recent svn revisions, my 40,000-line XML file fails.
I have switched between postgres and derby, and I get the same error.

I have split the files into many smaller files (600 lines each) and done
the XML directory import. It fails in about the same spot.

When I tediously import each split xml file by hand, it succeeds!

So I do not think I am feeding ofbiz corrupt data. It just seems to
have trouble with the larger files.

I have also noticed that it is MUCH slower to import 600 "Product"
records, as opposed to 600 "Party" records, etc. I notice that during
the product import, it is "Running Entity ECA Service: indexProductKeywords"
very frequently. I wonder if this is a hint about the problem. Is there a
way to defer the indexing of product keywords until after the data has
been imported?

--
Christopher Farley
www.northernbrewer.com
 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Christopher Farley
In reply to this post by Jacopo Cappellato
Jacopo Cappellato ([hidden email]) wrote:

> Could you please verify:
>
> 1) if in the framework\webtools\widget\EntityScreen.xml file, inside the
> action element of the "EntityImport" screen definition, there is a line
> like this:
>
> <set field="parameters.TRANSACTION_TIMEOUT" value="7200"/>

That line is present.

> 2) if you have recompiled the framework\widget component

If "ant clean && ant" is will recompile this component, then yes. Otherwise,
maybe not...

By the way, the failure does not occur at exactly two minutes. More like
1:15 - 1:30.  

--
Christopher Farley
www.northernbrewer.com
 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: [OFBiz] Users - XML import failure

Jacopo Cappellato
In reply to this post by Christopher Farley
Hi Christopher,

yes, importing products is slower than importing parties because there
is an eca attached.
You can simply disable it commenting the first eca defined in
product\entitydef\eecas.xml.

By the way, please have a look at my last mail (I sent it an hour ago)
because I'd like to verify with you if the current screen implementation
is working fine.

Jacopo

Christopher Farley wrote:

> Christopher Farley ([hidden email]) wrote:
>
>
>>Anecdeotally, yes, it definitely seems like two minutes. `svn info`
>>shows I've got version 6044. However, there's some possibility that
>>I synced the repository but never re-compiled. I'm assuming you are
>>asking because of a known issue 6007. I'll let you know!
>
>
> Actually, even with recent svn revisions, my 40,000-line XML file fails.
> I have switched between postgres and derby, and I get the same error.
>
> I have split the files into many smaller files (600 lines each) and done
> the XML directory import. It fails in about the same spot.
>
> When I tediously import each split xml file by hand, it succeeds!
>
> So I do not think I am feeding ofbiz corrupt data. It just seems to
> have trouble with the larger files.
>
> I have also noticed that it is MUCH slower to import 600 "Product"
> records, as opposed to 600 "Party" records, etc. I notice that during
> the product import, it is "Running Entity ECA Service: indexProductKeywords"
> very frequently. I wonder if this is a hint about the problem. Is there a
> way to defer the indexing of product keywords until after the data has
> been imported?
>

 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users