Re: Users - XML data import fails when importing more than ~10000 products

Posted by Nick Olson on Jun 20, 2006; 9:34pm
URL: http://ofbiz.116.s1.nabble.com/Users-XML-data-import-fails-when-importing-more-than-10000-products-tp140028p140043.html

I thought the xml might be invalid, so I generated a test xml file with
some dummy information, like this:

    <Product productId='1'
    productTypeId='GOOD'
    productName='1'
    internalName='1'
    longDescription='1'
    taxable='Y'
    weight='1'
    largeImageUrl='1'
    chargeShipping='Y'
    autoCreateKeywords='N'
    isVirtual='N'
    isVariant='N'
    createdDate='2006-06-20 12:43:25'
    createdByUserLogin='admin'
    lastModifiedDate='2006-06-20 12:43:25'
    lastModifiedByUserLogin='admin'/>


    <Product productId='2'
    productTypeId='GOOD'
    productName='2'
    internalName='2'
    longDescription='2'
    taxable='Y'
    weight='2'
    largeImageUrl='2'
    chargeShipping='Y'
    autoCreateKeywords='N'
    isVirtual='N'
    isVariant='N'
    createdDate='2006-06-20 12:43:25'
    createdByUserLogin='admin'
    lastModifiedDate='2006-06-20 12:43:25'
    lastModifiedByUserLogin='admin'/>
...


Still, I get the same errors.

Walter Vaughan wrote:

> Nick Olson wrote:
>
>> I am trying to import 40k products into the database (I'm running
>> postgres), but when I try to import, I get an error message that says:
>> ERROR parsing Entity Xml file: Commit transaction failed.
>>
>> This appears in the log file:
>>
>> 78565324 (http-0.0.0.0-8443-Processor2) [
>> EntitySaxReader.java:403:INFO ] Another 1000 values imported: now up
>> to 16000
>> 78570220 (http-0.0.0.0-8443-Processor2) [
>> EntitySaxReader.java:403:INFO ] Another 1000 values imported: now up
>> to 17000
>> 78575552 (http-0.0.0.0-8443-Processor2) [
>> EntitySaxReader.java:403:INFO ] Another 1000 values imported: now up
>> to 18000
>> 78580442 (http-0.0.0.0-8443-Processor2) [
>> EntitySaxReader.java:261:INFO ] Finished 18999 values from
>> file:/home/nick/ofbiz-7818/import/demo_products.xml
>> 78580444 (http-0.0.0.0-8443-Processor2)
>> [InheritableTransactionContext.java:311:ERROR] Unable to roll back
>> transaction
>> java.lang.IllegalStateException: Status is STATUS_NO_TRANSACTION
>> at org.apache.geronimo.transaction.manager.TransactionImpl.rollback(TransactionImpl.java:438)
>> at org.apache.geronimo.transaction.context.InheritableTransactionContext.rollbackAndThrow(InheritableTransactionContext.java:308)
>> at org.apache.geronimo.transaction.context.InheritableTransactionContext.complete(InheritableTransactionContext.java:199)
>> at org.apache.geronimo.transaction.context.InheritableTransactionContext.commit(InheritableTransactionContext.java:146)
>>
>>
>> I get the exact same error when I try to use a derby database instead
>> of the postgres one. This import was working when I was using an
>> earlier build of ofbiz (1-2 months ago), but it is failing now.
>>
>> What could be causing this error?
>
> We've discovered that using "xmllint" is an excellent tool to make sure the xml
> is actually clean enough to use. Does xmllint pass the file cleanly?
>
> http://xmlsoft.org/xmllint.html
>
> You may already have the program on your server.
>
> It installs in freebsd as
> cd /usr/ports/textproc/libxml2/ && make install clean
>
>
>  
> _______________________________________________
> Users mailing list
> [hidden email]
> http://lists.ofbiz.org/mailman/listinfo/users
>
>

 
_______________________________________________
Users mailing list
[hidden email]
http://lists.ofbiz.org/mailman/listinfo/users