MySQL DB creation with demo data
Locked
MySQL DB creation with demo data
 
|
Hi,
I have setup 10.04 branch in my dev enviornment, with MySQL db server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having 4 processors & 2 gb ram. Encoding in entityengine.xml is set to utf8. Database creation with demo data takes minimum 40 minutes. Is this an acceptable for db creation given above configuration ? PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs ram used to take 10 mins. -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
Administrator
|
It's far too slow. On my 2 years old Windows box (Intel dual Proc, 4 GB, SATAs) it takes about 3 mins with Postgres 8.4 and 12 with
Derby (not much else running at the same time) Jacques From: "varun bhansaly" <[hidden email]> > Hi, > I have setup 10.04 branch in my dev enviornment, with MySQL db > server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having > 4 processors & 2 gb ram. > Encoding in entityengine.xml is set to utf8. > Database creation with demo data takes minimum 40 minutes. Is this an > acceptable for db creation given above configuration ? > > PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs > ram used to take 10 mins. > > -- > Regards, > Varun Bhansaly > |
|
|
In reply to this post by Varun Bhansaly
That's pretty dog slow. You probably need to tune mysql. Ofbiz has a
lot of tables. Here is what I was using: # # * Fine Tuning # key_buffer = 64M max_allowed_packet = 640M thread_stack = 192K thread_cache_size = 8 max_connections = 256 table_cache = 2400 table_definition_cache = 2400 max_heap_table_size = 512M tmp_table_size = 512M join_buffer_size = 5M #thread_concurrency = 10 # # * Query Cache Configuration # query_cache_limit = 64M query_cache_size = 128M However, I'm currently in the process of dumping mysql due to it's timestamp issue. On Tue, Aug 31, 2010 at 5:32 AM, varun bhansaly <[hidden email]> wrote: > Hi, > I have setup 10.04 branch in my dev enviornment, with MySQL db > server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having > 4 processors & 2 gb ram. > Encoding in entityengine.xml is set to utf8. > Database creation with demo data takes minimum 40 minutes. Is this an > acceptable for db creation given above configuration ? > > PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs > ram used to take 10 mins. > > -- > Regards, > Varun Bhansaly > |
Re: MySQL DB creation with demo data
|
|
Thanks for sharing the thoughts & configuration, quite strangely, db creation on a plain jane default mysql installation (of a previous version) would not take so long. Does it sound some sort of encoding issue ?
Thanks, |
Re: MySQL DB creation with demo data
|
|
In reply to this post by Varun Bhansaly
if I read this correct you have introduced many variables.
1) have you tested loading a MySQL db over the network in this configuration, list a restore, not using ofbiz? 2) have you tested loading a local MySQL db using ofbiz? ========================= BJ Freeman <http://bjfreeman.elance.com> Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52> Specialtymarket.com <http://www.specialtymarket.com/> Systems Integrator-- Glad to Assist Chat Y! messenger: bjfr33man varun bhansaly sent the following on 8/31/2010 5:32 AM: > Hi, > I have setup 10.04 branch in my dev enviornment, with MySQL db > server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having > 4 processors& 2 gb ram. > Encoding in entityengine.xml is set to utf8. > Database creation with demo data takes minimum 40 minutes. Is this an > acceptable for db creation given above configuration ? > > PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs > ram used to take 10 mins. > |
Re: MySQL DB creation with demo data
|
|
I have tried loading over network as well as from local.
Are talking of mysqldump restore as well ? On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman <[hidden email]> wrote: > if I read this correct you have introduced many variables. > 1) have you tested loading a MySQL db over the network in this > configuration, list a restore, not using ofbiz? > 2) have you tested loading a local MySQL db using ofbiz? > > ========================= > BJ Freeman <http://bjfreeman.elance.com> > Strategic Power Office with Supplier Automation < > http://www.businessesnetwork.com/automation/viewforum.php?f=52> > Specialtymarket.com <http://www.specialtymarket.com/> > Systems Integrator-- Glad to Assist > > Chat Y! messenger: bjfr33man > > > varun bhansaly sent the following on 8/31/2010 5:32 AM: > > Hi, >> I have setup 10.04 branch in my dev enviornment, with MySQL db >> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >> having >> 4 processors& 2 gb ram. >> Encoding in entityengine.xml is set to utf8. >> Database creation with demo data takes minimum 40 minutes. Is this an >> acceptable for db creation given above configuration ? >> >> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs >> ram used to take 10 mins. >> >> > -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
|
|
the first is to isolate if ofbiz is causing anything by removing it from
the equation. so do a equivalent restore of data from the machine that ofbiz resides on to the target that MySQL resides on and time. you can do this by saving the MySQL data of a current db that has ofbiz structure and data then loading like above to the db on the target machine. That give you a bench mark of the DB by itself. then setup ofbiz to a local db with the same setting as the remote one and see what the load time of the db is from ofbiz. that should give you a fair estimation where the problem is. ========================= BJ Freeman <http://bjfreeman.elance.com> Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52> Specialtymarket.com <http://www.specialtymarket.com/> Systems Integrator-- Glad to Assist Chat Y! messenger: bjfr33man varun bhansaly sent the following on 8/31/2010 10:10 AM: > I have tried loading over network as well as from local. > Are talking of mysqldump restore as well ? > > On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> wrote: > >> if I read this correct you have introduced many variables. >> 1) have you tested loading a MySQL db over the network in this >> configuration, list a restore, not using ofbiz? >> 2) have you tested loading a local MySQL db using ofbiz? >> >> ========================= >> BJ Freeman<http://bjfreeman.elance.com> >> Strategic Power Office with Supplier Automation< >> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >> Specialtymarket.com<http://www.specialtymarket.com/> >> Systems Integrator-- Glad to Assist >> >> Chat Y! messenger: bjfr33man >> >> >> varun bhansaly sent the following on 8/31/2010 5:32 AM: >> >> Hi, >>> I have setup 10.04 branch in my dev enviornment, with MySQL db >>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >>> having >>> 4 processors& 2 gb ram. >>> Encoding in entityengine.xml is set to utf8. >>> Database creation with demo data takes minimum 40 minutes. Is this an >>> acceptable for db creation given above configuration ? >>> >>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs >>> ram used to take 10 mins. >>> >>> >> > > |
Re: MySQL DB creation with demo data
|
|
Thanks BJ, what is available is the 'target' m/c only with latest MySQL, no
backup has been taken for this dev env. Since I work primarily with ofbiz, theres no other dataset to reference. On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman <[hidden email]> wrote: > the first is to isolate if ofbiz is causing anything by removing it from > the equation. > so do a equivalent restore of data from the machine that ofbiz resides on > to the target that MySQL resides on and time. > you can do this by saving the MySQL data of a current db that has ofbiz > structure and data then loading like above to the db on the target machine. > That give you a bench mark of the DB by itself. > > then setup ofbiz to a local db with the same setting as the remote one and > see what the load time of the db is from ofbiz. > > that should give you a fair estimation where the problem is. > > > > ========================= > BJ Freeman <http://bjfreeman.elance.com> > Strategic Power Office with Supplier Automation < > http://www.businessesnetwork.com/automation/viewforum.php?f=52> > Specialtymarket.com <http://www.specialtymarket.com/> > Systems Integrator-- Glad to Assist > > Chat Y! messenger: bjfr33man > > > varun bhansaly sent the following on 8/31/2010 10:10 AM: > > I have tried loading over network as well as from local. >> Are talking of mysqldump restore as well ? >> >> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> wrote: >> >> if I read this correct you have introduced many variables. >>> 1) have you tested loading a MySQL db over the network in this >>> configuration, list a restore, not using ofbiz? >>> 2) have you tested loading a local MySQL db using ofbiz? >>> >>> ========================= >>> BJ Freeman<http://bjfreeman.elance.com> >>> Strategic Power Office with Supplier Automation< >>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>> Specialtymarket.com<http://www.specialtymarket.com/> >>> Systems Integrator-- Glad to Assist >>> >>> Chat Y! messenger: bjfr33man >>> >>> >>> varun bhansaly sent the following on 8/31/2010 5:32 AM: >>> >>> Hi, >>> >>>> I have setup 10.04 branch in my dev enviornment, with MySQL db >>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >>>> having >>>> 4 processors& 2 gb ram. >>>> Encoding in entityengine.xml is set to utf8. >>>> Database creation with demo data takes minimum 40 minutes. Is this an >>>> acceptable for db creation given above configuration ? >>>> >>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 >>>> gigs >>>> ram used to take 10 mins. >>>> >>>> >>>> >>> >> >> > -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
|
|
that does make it more difficult.
Not sure what you can do, you might check if it is the MySQL jdbc driver you using in ofiz. and possibly so setting the driver needs in the entityengine.xml ========================= BJ Freeman <http://bjfreeman.elance.com> Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52> Specialtymarket.com <http://www.specialtymarket.com/> Systems Integrator-- Glad to Assist Chat Y! messenger: bjfr33man varun bhansaly sent the following on 8/31/2010 10:58 AM: > Thanks BJ, what is available is the 'target' m/c only with latest MySQL, no > backup has been taken for this dev env. > Since I work primarily with ofbiz, theres no other dataset to reference. > > On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<[hidden email]> wrote: > >> the first is to isolate if ofbiz is causing anything by removing it from >> the equation. >> so do a equivalent restore of data from the machine that ofbiz resides on >> to the target that MySQL resides on and time. >> you can do this by saving the MySQL data of a current db that has ofbiz >> structure and data then loading like above to the db on the target machine. >> That give you a bench mark of the DB by itself. >> >> then setup ofbiz to a local db with the same setting as the remote one and >> see what the load time of the db is from ofbiz. >> >> that should give you a fair estimation where the problem is. >> >> >> >> ========================= >> BJ Freeman<http://bjfreeman.elance.com> >> Strategic Power Office with Supplier Automation< >> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >> Specialtymarket.com<http://www.specialtymarket.com/> >> Systems Integrator-- Glad to Assist >> >> Chat Y! messenger: bjfr33man >> >> >> varun bhansaly sent the following on 8/31/2010 10:10 AM: >> >> I have tried loading over network as well as from local. >>> Are talking of mysqldump restore as well ? >>> >>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> wrote: >>> >>> if I read this correct you have introduced many variables. >>>> 1) have you tested loading a MySQL db over the network in this >>>> configuration, list a restore, not using ofbiz? >>>> 2) have you tested loading a local MySQL db using ofbiz? >>>> >>>> ========================= >>>> BJ Freeman<http://bjfreeman.elance.com> >>>> Strategic Power Office with Supplier Automation< >>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>>> Specialtymarket.com<http://www.specialtymarket.com/> >>>> Systems Integrator-- Glad to Assist >>>> >>>> Chat Y! messenger: bjfr33man >>>> >>>> >>>> varun bhansaly sent the following on 8/31/2010 5:32 AM: >>>> >>>> Hi, >>>> >>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db >>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >>>>> having >>>>> 4 processors& 2 gb ram. >>>>> Encoding in entityengine.xml is set to utf8. >>>>> Database creation with demo data takes minimum 40 minutes. Is this an >>>>> acceptable for db creation given above configuration ? >>>>> >>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 >>>>> gigs >>>>> ram used to take 10 mins. >>>>> >>>>> >>>>> >>>> >>> >>> >> > > |
Re: MySQL DB creation with demo data
|
|
I have tried with latest Connector/J 5.1.13, but result is the same (slow db
creation) On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman <[hidden email]> wrote: > that does make it more difficult. > Not sure what you can do, you might check if it is the MySQL jdbc driver > you using in ofiz. and possibly so setting the driver needs in the > entityengine.xml > > > ========================= > BJ Freeman <http://bjfreeman.elance.com> > Strategic Power Office with Supplier Automation < > http://www.businessesnetwork.com/automation/viewforum.php?f=52> > Specialtymarket.com <http://www.specialtymarket.com/> > Systems Integrator-- Glad to Assist > > Chat Y! messenger: bjfr33man > > > varun bhansaly sent the following on 8/31/2010 10:58 AM: > > Thanks BJ, what is available is the 'target' m/c only with latest MySQL, >> no >> backup has been taken for this dev env. >> Since I work primarily with ofbiz, theres no other dataset to reference. >> >> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<[hidden email]> wrote: >> >> the first is to isolate if ofbiz is causing anything by removing it from >>> the equation. >>> so do a equivalent restore of data from the machine that ofbiz resides on >>> to the target that MySQL resides on and time. >>> you can do this by saving the MySQL data of a current db that has ofbiz >>> structure and data then loading like above to the db on the target >>> machine. >>> That give you a bench mark of the DB by itself. >>> >>> then setup ofbiz to a local db with the same setting as the remote one >>> and >>> see what the load time of the db is from ofbiz. >>> >>> that should give you a fair estimation where the problem is. >>> >>> >>> >>> ========================= >>> BJ Freeman<http://bjfreeman.elance.com> >>> Strategic Power Office with Supplier Automation< >>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>> Specialtymarket.com<http://www.specialtymarket.com/> >>> Systems Integrator-- Glad to Assist >>> >>> Chat Y! messenger: bjfr33man >>> >>> >>> varun bhansaly sent the following on 8/31/2010 10:10 AM: >>> >>> I have tried loading over network as well as from local. >>> >>>> Are talking of mysqldump restore as well ? >>>> >>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> >>>> wrote: >>>> >>>> if I read this correct you have introduced many variables. >>>> >>>>> 1) have you tested loading a MySQL db over the network in this >>>>> configuration, list a restore, not using ofbiz? >>>>> 2) have you tested loading a local MySQL db using ofbiz? >>>>> >>>>> ========================= >>>>> BJ Freeman<http://bjfreeman.elance.com> >>>>> Strategic Power Office with Supplier Automation< >>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>>>> Specialtymarket.com<http://www.specialtymarket.com/> >>>>> Systems Integrator-- Glad to Assist >>>>> >>>>> Chat Y! messenger: bjfr33man >>>>> >>>>> >>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM: >>>>> >>>>> Hi, >>>>> >>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db >>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >>>>>> having >>>>>> 4 processors& 2 gb ram. >>>>>> Encoding in entityengine.xml is set to utf8. >>>>>> Database creation with demo data takes minimum 40 minutes. Is this an >>>>>> acceptable for db creation given above configuration ? >>>>>> >>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 >>>>>> gigs >>>>>> ram used to take 10 mins. >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>> >> >> > -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
|
|
unfortunately I use postgres and don't have time to do a setup of mysql.
hopefully someone that is using mysql can help you further. ========================= BJ Freeman <http://bjfreeman.elance.com> Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52> Specialtymarket.com <http://www.specialtymarket.com/> Systems Integrator-- Glad to Assist Chat Y! messenger: bjfr33man varun bhansaly sent the following on 8/31/2010 11:32 AM: > I have tried with latest Connector/J 5.1.13, but result is the same (slow db > creation) > > On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman<[hidden email]> wrote: > >> that does make it more difficult. >> Not sure what you can do, you might check if it is the MySQL jdbc driver >> you using in ofiz. and possibly so setting the driver needs in the >> entityengine.xml >> >> >> ========================= >> BJ Freeman<http://bjfreeman.elance.com> >> Strategic Power Office with Supplier Automation< >> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >> Specialtymarket.com<http://www.specialtymarket.com/> >> Systems Integrator-- Glad to Assist >> >> Chat Y! messenger: bjfr33man >> >> >> varun bhansaly sent the following on 8/31/2010 10:58 AM: >> >> Thanks BJ, what is available is the 'target' m/c only with latest MySQL, >>> no >>> backup has been taken for this dev env. >>> Since I work primarily with ofbiz, theres no other dataset to reference. >>> >>> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<[hidden email]> wrote: >>> >>> the first is to isolate if ofbiz is causing anything by removing it from >>>> the equation. >>>> so do a equivalent restore of data from the machine that ofbiz resides on >>>> to the target that MySQL resides on and time. >>>> you can do this by saving the MySQL data of a current db that has ofbiz >>>> structure and data then loading like above to the db on the target >>>> machine. >>>> That give you a bench mark of the DB by itself. >>>> >>>> then setup ofbiz to a local db with the same setting as the remote one >>>> and >>>> see what the load time of the db is from ofbiz. >>>> >>>> that should give you a fair estimation where the problem is. >>>> >>>> >>>> >>>> ========================= >>>> BJ Freeman<http://bjfreeman.elance.com> >>>> Strategic Power Office with Supplier Automation< >>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>>> Specialtymarket.com<http://www.specialtymarket.com/> >>>> Systems Integrator-- Glad to Assist >>>> >>>> Chat Y! messenger: bjfr33man >>>> >>>> >>>> varun bhansaly sent the following on 8/31/2010 10:10 AM: >>>> >>>> I have tried loading over network as well as from local. >>>> >>>>> Are talking of mysqldump restore as well ? >>>>> >>>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> >>>>> wrote: >>>>> >>>>> if I read this correct you have introduced many variables. >>>>> >>>>>> 1) have you tested loading a MySQL db over the network in this >>>>>> configuration, list a restore, not using ofbiz? >>>>>> 2) have you tested loading a local MySQL db using ofbiz? >>>>>> >>>>>> ========================= >>>>>> BJ Freeman<http://bjfreeman.elance.com> >>>>>> Strategic Power Office with Supplier Automation< >>>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> >>>>>> Specialtymarket.com<http://www.specialtymarket.com/> >>>>>> Systems Integrator-- Glad to Assist >>>>>> >>>>>> Chat Y! messenger: bjfr33man >>>>>> >>>>>> >>>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM: >>>>>> >>>>>> Hi, >>>>>> >>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db >>>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 >>>>>>> having >>>>>>> 4 processors& 2 gb ram. >>>>>>> Encoding in entityengine.xml is set to utf8. >>>>>>> Database creation with demo data takes minimum 40 minutes. Is this an >>>>>>> acceptable for db creation given above configuration ? >>>>>>> >>>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 >>>>>>> gigs >>>>>>> ram used to take 10 mins. >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>> >>> >>> >> > > |
Re: MySQL DB creation with demo data
|
|
I have two environments:
2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the initial data. 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the data. Don't have the solution but I have noticed that on machines with slow disks the performance while creating indices, constraints and tables is poor. Dnia 2010-08-31, wto o godzinie 11:35 -0700, BJ Freeman pisze: > unfortunately I use postgres and don't have time to do a setup of mysql. > hopefully someone that is using mysql can help you further. > > ========================= > BJ Freeman <http://bjfreeman.elance.com> > Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52> > Specialtymarket.com <http://www.specialtymarket.com/> > Systems Integrator-- Glad to Assist > > Chat Y! messenger: bjfr33man > > > varun bhansaly sent the following on 8/31/2010 11:32 AM: > > I have tried with latest Connector/J 5.1.13, but result is the same (slow db > > creation) > > > > On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman<[hidden email]> wrote: > > > >> that does make it more difficult. > >> Not sure what you can do, you might check if it is the MySQL jdbc driver > >> you using in ofiz. and possibly so setting the driver needs in the > >> entityengine.xml > >> > >> > >> ========================= > >> BJ Freeman<http://bjfreeman.elance.com> > >> Strategic Power Office with Supplier Automation< > >> http://www.businessesnetwork.com/automation/viewforum.php?f=52> > >> Specialtymarket.com<http://www.specialtymarket.com/> > >> Systems Integrator-- Glad to Assist > >> > >> Chat Y! messenger: bjfr33man > >> > >> > >> varun bhansaly sent the following on 8/31/2010 10:58 AM: > >> > >> Thanks BJ, what is available is the 'target' m/c only with latest MySQL, > >>> no > >>> backup has been taken for this dev env. > >>> Since I work primarily with ofbiz, theres no other dataset to reference. > >>> > >>> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<[hidden email]> wrote: > >>> > >>> the first is to isolate if ofbiz is causing anything by removing it from > >>>> the equation. > >>>> so do a equivalent restore of data from the machine that ofbiz resides on > >>>> to the target that MySQL resides on and time. > >>>> you can do this by saving the MySQL data of a current db that has ofbiz > >>>> structure and data then loading like above to the db on the target > >>>> machine. > >>>> That give you a bench mark of the DB by itself. > >>>> > >>>> then setup ofbiz to a local db with the same setting as the remote one > >>>> and > >>>> see what the load time of the db is from ofbiz. > >>>> > >>>> that should give you a fair estimation where the problem is. > >>>> > >>>> > >>>> > >>>> ========================= > >>>> BJ Freeman<http://bjfreeman.elance.com> > >>>> Strategic Power Office with Supplier Automation< > >>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> > >>>> Specialtymarket.com<http://www.specialtymarket.com/> > >>>> Systems Integrator-- Glad to Assist > >>>> > >>>> Chat Y! messenger: bjfr33man > >>>> > >>>> > >>>> varun bhansaly sent the following on 8/31/2010 10:10 AM: > >>>> > >>>> I have tried loading over network as well as from local. > >>>> > >>>>> Are talking of mysqldump restore as well ? > >>>>> > >>>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<[hidden email]> > >>>>> wrote: > >>>>> > >>>>> if I read this correct you have introduced many variables. > >>>>> > >>>>>> 1) have you tested loading a MySQL db over the network in this > >>>>>> configuration, list a restore, not using ofbiz? > >>>>>> 2) have you tested loading a local MySQL db using ofbiz? > >>>>>> > >>>>>> ========================= > >>>>>> BJ Freeman<http://bjfreeman.elance.com> > >>>>>> Strategic Power Office with Supplier Automation< > >>>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52> > >>>>>> Specialtymarket.com<http://www.specialtymarket.com/> > >>>>>> Systems Integrator-- Glad to Assist > >>>>>> > >>>>>> Chat Y! messenger: bjfr33man > >>>>>> > >>>>>> > >>>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM: > >>>>>> > >>>>>> Hi, > >>>>>> > >>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db > >>>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 > >>>>>>> having > >>>>>>> 4 processors& 2 gb ram. > >>>>>>> Encoding in entityengine.xml is set to utf8. > >>>>>>> Database creation with demo data takes minimum 40 minutes. Is this an > >>>>>>> acceptable for db creation given above configuration ? > >>>>>>> > >>>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 > >>>>>>> gigs > >>>>>>> ram used to take 10 mins. > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>> > >>>>> > >>>>> > >>>> > >>> > >>> > >> > > > > > |
Re: MySQL DB creation with demo data
|
|
On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote: > I have two environments: > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the > initial data. > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the > data. > > Don't have the solution but I have noticed that on machines with slow > disks the performance while creating indices, constraints and tables is > poor. Are both machines running the same software, ie same database, JVM, and app server? How about the same operating system? I've seen this kind of difference a lot when comparing Linux/OSX/etc to Windows. Windows uses blocking synchronous IO and is REALLY slow compared to the asynchronous IO of more server-worthy operating systems. -David |
Re: MySQL DB creation with demo data
|
|
I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community
server, utf8 encoding default, it takes 3.38 mins with demo data. On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <[hidden email]> wrote: > > On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote: > > > I have two environments: > > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the > > initial data. > > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the > > data. > > > > Don't have the solution but I have noticed that on machines with slow > > disks the performance while creating indices, constraints and tables is > > poor. > > Are both machines running the same software, ie same database, JVM, and app > server? How about the same operating system? I've seen this kind of > difference a lot when comparing Linux/OSX/etc to Windows. Windows uses > blocking synchronous IO and is REALLY slow compared to the asynchronous IO > of more server-worthy operating systems. > > -David > > > -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
|
|
Another piece of stat - Suppose db is created, when ofbiz is booting, it
takes it around a minute to gather db information, thats in collecting meta data. On Wed, Sep 1, 2010 at 6:38 AM, varun bhansaly <[hidden email]> wrote: > I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community > server, utf8 encoding default, it takes 3.38 mins with demo data. > > On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <[hidden email]> wrote: > >> >> On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote: >> >> > I have two environments: >> > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the >> > initial data. >> > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the >> > data. >> > >> > Don't have the solution but I have noticed that on machines with slow >> > disks the performance while creating indices, constraints and tables is >> > poor. >> >> Are both machines running the same software, ie same database, JVM, and >> app server? How about the same operating system? I've seen this kind of >> difference a lot when comparing Linux/OSX/etc to Windows. Windows uses >> blocking synchronous IO and is REALLY slow compared to the asynchronous IO >> of more server-worthy operating systems. >> >> -David >> >> >> > > > -- > Regards, > Varun Bhansaly > -- Regards, Varun Bhansaly |
Re: MySQL DB creation with demo data
|
|
Db creation takes 10 mins now (acceptable than 2 hours). It was due to the
new h/w we had migrated to. Thanks for all the responses. On Wed, Sep 1, 2010 at 6:44 AM, varun bhansaly <[hidden email]> wrote: > Another piece of stat - Suppose db is created, when ofbiz is booting, it > takes it around a minute to gather db information, thats in collecting meta > data. > > > On Wed, Sep 1, 2010 at 6:38 AM, varun bhansaly <[hidden email]>wrote: > >> I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community >> server, utf8 encoding default, it takes 3.38 mins with demo data. >> >> On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <[hidden email]> wrote: >> >>> >>> On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote: >>> >>> > I have two environments: >>> > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the >>> > initial data. >>> > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the >>> > data. >>> > >>> > Don't have the solution but I have noticed that on machines with slow >>> > disks the performance while creating indices, constraints and tables is >>> > poor. >>> >>> Are both machines running the same software, ie same database, JVM, and >>> app server? How about the same operating system? I've seen this kind of >>> difference a lot when comparing Linux/OSX/etc to Windows. Windows uses >>> blocking synchronous IO and is REALLY slow compared to the asynchronous IO >>> of more server-worthy operating systems. >>> >>> -David >>> >>> >>> >> >> >> -- >> Regards, >> Varun Bhansaly >> > > > > -- > Regards, > Varun Bhansaly > -- Regards, Varun Bhansaly |
«
Return to OFBiz - User
|
1 view|%1 views
| Free forum by Nabble | Edit this page |