Login  Register

Re: [OFBiz] Users - XML import failure

Posted by Ian Gilbert on Nov 01, 2005; 11:23am
URL: http://ofbiz.116.s1.nabble.com/OFBiz-Users-XML-import-failure-tp136279p136286.html

Hi Chris,

We had import problems which seemed to dramatically improve once we
increased the amount of RAM in the machine.  However our issues were in
different records to the ones that you seem to be having trouble with.
How much memory are you working with?  Our problems were, I think, related
to the process timing out therefore a better server resolved many of the
issues that we were having.  Another way we found which mostly worked was
to break down the import/export into smaller chunks.

HTH

Ian

On Tue, November 1, 2005 7:34 am, Christopher Farley wrote:

> I'm running into a problem trying to import a large file into ofbiz using
>  the Web Tools xml import. I'm importing an XML file that has about 4,000
>  Product and ProductPrice records. I don't think there's anything wrong
> with the data, but I get repeated failures whenever I try to import any
> more than 600 records at a time. I'm using a recent subversion checkout.
>
> Is anybody using ofbiz's xml import for relatively large imports? Am I
> running into memory issues? The GUI reports "ERROR: A transaction error
> occurred reading data". The console log has thousands of lines of error
> messages, here is how they begin:
>
>
> 105182924 (http-0.0.0.0-8443-Processor2) [
> ServiceDispatcher.java:447:DEBUG] [[Sync service finished-
> total:0.154,since last(Begin):0.154]] - 'entity-default /
> indexProductKeywords' 105182934 (http-0.0.0.0-8443-Processor2) [
> EntitySaxReader.java:495:WARN ] Ignoring invalid field name
> [primaryProductCategory] found for the entity: Product with value=101
> 105182947 (http-0.0.0.0-8443-Processor2) [
> EntityEcaRule.java:122:INFO ] Running Entity ECA Service:
> indexProductKeywords, triggered by rule on Entity: Product 105183018
> (http-0.0.0.0-8443-Processor2) [            UtilXml.java:242:DEBUG] XML
> Read 0.057s:
> file:/Users/chris/src/ofbiz/applications/product/script/org/ofbiz/product
> /product/ProductServices.xml
> 105183067 (JotmBatch) [    TransactionImpl.java:765:INFO ] set rollback
> only (tx=bb14:38:0:01bc9c2640bfff0e69...547518:) 105183082
> (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report
> ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place,
> so no transaction begun; this stack trace shows when the exception began:
>  Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace
> ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(Tran
> sactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:11
> 7)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63
> )
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:11
> 7)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHan
> dler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589
> )
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
>  org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.
> java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.
> java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1
> 26)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1
> 05)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja
> va:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148
> )
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
>
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processCo
> nnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.j
> ava:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollower
> WorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.j
> ava:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------
> ------
>
>
> 105183156 (http-0.0.0.0-8443-Processor2) [
> TransactionUtil.java:615:WARN ] WARNING: In getSetRollbackOnlyCause no
> stack placeholder was in place, here is the current location: 105183162
> (http-0.0.0.0-8443-Processor2) [    TransactionUtil.java:83 :WARN ]
> ---- exception report
> ----------------------------------------------------------
> [TransactionUtil.begin] active transaction marked for rollback in place,
> so no transaction begun; this stack trace shows when the exception began:
>  Exception: java.lang.Exception
> Message: Tx Stack Placeholder
> ---- stack trace
> ---------------------------------------------------------------
> java.lang.Exception: Tx Stack Placeholder
> org.ofbiz.entity.transaction.TransactionUtil.setTransactionBeginStack(Tran
> sactionUtil.java:518)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:11
> 7)
> org.ofbiz.entity.transaction.TransactionUtil.begin(TransactionUtil.java:63
> )
> org.ofbiz.widget.screen.ModelScreen.renderScreenString(ModelScreen.java:11
> 7)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:115)
> org.ofbiz.widget.screen.ScreenRenderer.render(ScreenRenderer.java:100)
> org.ofbiz.widget.screen.ScreenWidgetViewHandler.render(ScreenWidgetViewHan
> dler.java:85)
> org.ofbiz.webapp.control.RequestHandler.renderView(RequestHandler.java:589
> )
> org.ofbiz.webapp.control.RequestHandler.doRequest(RequestHandler.java:374)
>  org.ofbiz.webapp.control.ControlServlet.doGet(ControlServlet.java:191)
> org.ofbiz.webapp.control.ControlServlet.doPost(ControlServlet.java:87)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:252)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.ofbiz.webapp.control.ContextFilter.doFilter(ContextFilter.java:258)
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati
> onFilterChain.java:202)
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter
> Chain.java:173)
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.
> java:213)
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.
> java:178)
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1
> 26)
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1
> 05)
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja
> va:107)
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:526)
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148
> )
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:856)
>
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processCo
> nnection(Http11Protocol.java:744)
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.j
> ava:527)
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollower
> WorkerThread.java:80)
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.j
> ava:684)
> java.lang.Thread.run(Thread.java:552)
> --------------------------------------------------------------------------
> ------
>
>
> --
> Christopher Farley
> www.northernbrewer.com
>
> _______________________________________________
> Users mailing list
> [hidden email]
> http://lists.ofbiz.org/mailman/listinfo/users
>
>


 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users