Data Load tips/tricks?

[Boyden, Timothy]

I started writing scripts this week to export data from our current ERP to the OFBiz XML data formats. I have loaded about 25,000 of our 150,000 products through the Web Tools Import XML utility. Are there any tips to improve load speed, such as temporarily disabling indexing or anything else anyone has experience with?

Thanks,

Tim

[taher]

Hi Tim,

My recommendation is to avoid using the web tools altogether, and
instead using the CLI. The exact documentation for how to import from
XML files is specified in the README.md. This has the benefit of not
only reducing resource usage but also allows for automation instead of
doing this stuff manually by hand

On Wed, Dec 27, 2017 at 3:06 PM, Boyden, Timothy
<[hidden email]> wrote:
> I started writing scripts this week to export data from our current ERP to the OFBiz XML data formats. I have loaded about 25,000 of our 150,000 products through the Web Tools Import XML utility. Are there any tips to improve load speed, such as temporarily disabling indexing or anything else anyone has experience with?
>
> Thanks,
>
> Tim

[Nicolas Malin-2]

Disable eeca on your delegator like :

     <delegator name="default-no-eca" entity-model-reader="main"
entity-group-reader="main" entity-eca-reader="main"
*entity-eca-enabled="false"* distributed-cache-clear-enabled="false">

Nicolas
Le 27/12/2017 à 13:06, Boyden, Timothy a écrit :
> I started writing scripts this week to export data from our current ERP to the OFBiz XML data formats. I have loaded about 25,000 of our 150,000 products through the Web Tools Import XML utility. Are there any tips to improve load speed, such as temporarily disabling indexing or anything else anyone has experience with?
>
> Thanks,
>
> Tim
>

[Boyden, Timothy]

Thanks Taher and Nicolas. I'll check those out.

-Tim

-----Original Message-----
From: Taher Alkhateeb [mailto:[hidden email]]
Sent: Wednesday, December 27, 2017 7:18 AM
To: [hidden email]
Subject: Re: Data Load tips/tricks?

Hi Tim,

My recommendation is to avoid using the web tools altogether, and instead using the CLI. The exact documentation for how to import from XML files is specified in the README.md. This has the benefit of not only reducing resource usage but also allows for automation instead of doing this stuff manually by hand

On Wed, Dec 27, 2017 at 3:06 PM, Boyden, Timothy <[hidden email]> wrote:
> I started writing scripts this week to export data from our current ERP to the OFBiz XML data formats. I have loaded about 25,000 of our 150,000 products through the Web Tools Import XML utility. Are there any tips to improve load speed, such as temporarily disabling indexing or anything else anyone has experience with?
>
> Thanks,
>
> Tim