Seed Data Load very slow in Ubuntu 10.04

[kranti]

Hi,

I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
system.
The seed data load is very very slow. It takes around 30 mins to load.
In ubuntu 8.04 LTS, it took around 2-3 mins max.
Is it due to the ext4 file system? or anything else?

Regards,
Kranti Agrawal
Student, IIIT Bangalore
krantiagrawal.blogspot.com

[jonatan soto]

I am using Ubuntu 9.10 with ext4 and it works great.

On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <[hidden email]>wrote:

> Hi,
>
> I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> system.
> The seed data load is very very slow. It takes around 30 mins to load.
> In ubuntu 8.04 LTS, it took around 2-3 mins max.
> Is it due to the ext4 file system? or anything else?
>
> Regards,
> Kranti Agrawal
> Student, IIIT Bangalore
> krantiagrawal.blogspot.com
>

[Ravindra Mandre-2]

I am also facing the same problem that Kranti reported above.
I also using Ubuntu 10.04.

Regards
Ravindra Mandre

On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto <[hidden email]>wrote:

> I am using Ubuntu 9.10 with ext4 and it works great.
>
> On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <[hidden email]
> >wrote:
>
> > Hi,
> >
> > I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> > system.
> > The seed data load is very very slow. It takes around 30 mins to load.
> > In ubuntu 8.04 LTS, it took around 2-3 mins max.
> > Is it due to the ext4 file system? or anything else?
> >
> > Regards,
> > Kranti Agrawal
> > Student, IIIT Bangalore
> > krantiagrawal.blogspot.com
> >
>

[Erwan de FERRIERES]

Le 03/05/2010 11:07, Ravindra Mandre a écrit :

> I am also facing the same problem that Kranti reported above.
> I also using Ubuntu 10.04.
>
> Regards
> Ravindra Mandre
>
> On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto<[hidden email]>wrote:
>
>> I am using Ubuntu 9.10 with ext4 and it works great.
>>
>> On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal<[hidden email]
>>> wrote:
>>
>>> Hi,
>>>
>>> I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
>>> system.
>>> The seed data load is very very slow. It takes around 30 mins to load.
>>> In ubuntu 8.04 LTS, it took around 2-3 mins max.
>>> Is it due to the ext4 file system? or anything else?
>>>
>>> Regards,
>>> Kranti Agrawal
>>> Student, IIIT Bangalore
>>> krantiagrawal.blogspot.com
>>>
>>
>

I haven't migrated yet, but which jvm are you using ?

--
Erwan de FERRIERES
www.nereide.biz

[Deyan Tsvetanov-2]

http://www.phoronix.com/scan.php?page=article&item=ubuntu_lucid_alpha2&num=3

PostgreSQL's performance continues to suffer dramatically under Ubuntu
10.04 LTS and it is not expected that it will change at all for this
next Ubuntu release. This major drop in the number of transactions being
carried out per second is due to an EXT4 file-system change designed to
provide better data safety but with a significant performance penalty.
This matter is talked about in Autonomously Finding Performance
Regressions In The Linux Kernel. The PostgreSQL performance also suffers
in Fedora 13 and any other Linux distributions using the Linux 2.6.32
kernel. Even with Fedora 13 being much earlier into its development
cycle and carrying some debugging options by default (along with using
SELinux), Fedora 13 Rawhide performed quite closely to Ubuntu 10.04
Alpha 2 in this test.



On Mon, 2010-05-03 at 14:37 +0530, Ravindra Mandre wrote:

> I am also facing the same problem that Kranti reported above.
> I also using Ubuntu 10.04.
>
> Regards
> Ravindra Mandre
>
> On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto <[hidden email]>wrote:
>
> > I am using Ubuntu 9.10 with ext4 and it works great.
> >
> > On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <[hidden email]
> > >wrote:
> >
> > > Hi,
> > >
> > > I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> > > system.
> > > The seed data load is very very slow. It takes around 30 mins to load.
> > > In ubuntu 8.04 LTS, it took around 2-3 mins max.
> > > Is it due to the ext4 file system? or anything else?
> > >
> > > Regards,
> > > Kranti Agrawal
> > > Student, IIIT Bangalore
> > > krantiagrawal.blogspot.com
> > >
> >

[kranti]

Version of Java I use:

java version "1.6.0_17"
Java(TM) SE Runtime Environment (build 1.6.0_17-b04)
Java HotSpot(TM) Server VM (build 14.3-b01, mixed mode)

Regards,
Kranti Agrawal
Student, IIIT Bangalore
krantiagrawal.blogspot.com


On Mon, May 3, 2010 at 2:54 PM, Deyan Tsvetanov
<[hidden email]>wrote:

>
> http://www.phoronix.com/scan.php?page=article&item=ubuntu_lucid_alpha2&num=3
>
> PostgreSQL's performance continues to suffer dramatically under Ubuntu
> 10.04 LTS and it is not expected that it will change at all for this
> next Ubuntu release. This major drop in the number of transactions being
> carried out per second is due to an EXT4 file-system change designed to
> provide better data safety but with a significant performance penalty.
> This matter is talked about in Autonomously Finding Performance
> Regressions In The Linux Kernel. The PostgreSQL performance also suffers
> in Fedora 13 and any other Linux distributions using the Linux 2.6.32
> kernel. Even with Fedora 13 being much earlier into its development
> cycle and carrying some debugging options by default (along with using
> SELinux), Fedora 13 Rawhide performed quite closely to Ubuntu 10.04
> Alpha 2 in this test.
>
>
>
> On Mon, 2010-05-03 at 14:37 +0530, Ravindra Mandre wrote:
> > I am also facing the same problem that Kranti reported above.
> > I also using Ubuntu 10.04.
> >
> > Regards
> > Ravindra Mandre
> >
> > On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto <[hidden email]
> >wrote:
> >
> > > I am using Ubuntu 9.10 with ext4 and it works great.
> > >
> > > On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <
> [hidden email]
> > > >wrote:
> > >
> > > > Hi,
> > > >
> > > > I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> > > > system.
> > > > The seed data load is very very slow. It takes around 30 mins to
> load.
> > > > In ubuntu 8.04 LTS, it took around 2-3 mins max.
> > > > Is it due to the ext4 file system? or anything else?
> > > >
> > > > Regards,
> > > > Kranti Agrawal
> > > > Student, IIIT Bangalore
> > > > krantiagrawal.blogspot.com
> > > >
> > >
>
>
>

[Deyan Tsvetanov-2]

Sorry, I hit ctrl + enter too quickly :)

http://www.phoronix.com/scan.php?page=article&item=linux_perf_regressions&num=1

So - don't use the 2.6.32 kernel for production yet :)


On Mon, 2010-05-03 at 12:24 +0300, Deyan Tsvetanov wrote:

> http://www.phoronix.com/scan.php?page=article&item=ubuntu_lucid_alpha2&num=3
>
> PostgreSQL's performance continues to suffer dramatically under Ubuntu
> 10.04 LTS and it is not expected that it will change at all for this
> next Ubuntu release. This major drop in the number of transactions being
> carried out per second is due to an EXT4 file-system change designed to
> provide better data safety but with a significant performance penalty.
> This matter is talked about in Autonomously Finding Performance
> Regressions In The Linux Kernel. The PostgreSQL performance also suffers
> in Fedora 13 and any other Linux distributions using the Linux 2.6.32
> kernel. Even with Fedora 13 being much earlier into its development
> cycle and carrying some debugging options by default (along with using
> SELinux), Fedora 13 Rawhide performed quite closely to Ubuntu 10.04
> Alpha 2 in this test.
>
>
>
> On Mon, 2010-05-03 at 14:37 +0530, Ravindra Mandre wrote:
> > I am also facing the same problem that Kranti reported above.
> > I also using Ubuntu 10.04.
> >
> > Regards
> > Ravindra Mandre
> >
> > On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto <[hidden email]>wrote:
> >
> > > I am using Ubuntu 9.10 with ext4 and it works great.
> > >
> > > On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <[hidden email]
> > > >wrote:
> > >
> > > > Hi,
> > > >
> > > > I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> > > > system.
> > > > The seed data load is very very slow. It takes around 30 mins to load.
> > > > In ubuntu 8.04 LTS, it took around 2-3 mins max.
> > > > Is it due to the ext4 file system? or anything else?
> > > >
> > > > Regards,
> > > > Kranti Agrawal
> > > > Student, IIIT Bangalore
> > > > krantiagrawal.blogspot.com
> > > >
> > >
>
>

[Deyan Tsvetanov-2]

Still,

my ant run-install-seed takes:

BUILD SUCCESSFUL
Total time: 6 minutes 48 seconds

real 6m48.884s
user 1m37.250s
sys 0m8.061s

using

java version "1.6.0_18"
OpenJDK Runtime Environment (IcedTea6 1.8) (6b18-1.8-0ubuntu1)
OpenJDK Server VM (build 14.0-b16, mixed mode


and

BUILD SUCCESSFUL
Total time: 7 minutes 29 seconds

real 7m29.793s
user 2m20.877s
sys 0m14.233s

using Sun JVM

java version "1.6.0_20"
Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
Java HotSpot(TM) Server VM (build 16.3-b01, mixed mode)

So- Sun JVM is slower - wow, what a surprise :)


I run ubuntu 10.04 on my laptop with all updates, ext4 fs,
2.6.32-21-generic-pae, 4 gb ram, 7200 rpm sata hdd,
Ofbiz trunk branch with all default options,
PostgreSQL 8.4.3 on i486-pc-linux-gnu, compiled by GCC gcc-4.4.real
(Ubuntu 4.4.3-4ubuntu5) 4.4.3, 32-bit,


I haven't timed the run-install procedure before, but i think the time
was pretty much the same.

It would be interesting to perform the same tests using ubuntu 10.04 and
ext3 for example. According to this benchmark

http://www.phoronix.com/scan.php?page=article&item=ext4_btrfs_nilfs2&num=3

postgre runs slightly faster on ext3 as compared to ext4, but the
difference is not that huge.

-- deyan


On Mon, 2010-05-03 at 12:32 +0300, Deyan Tsvetanov wrote:

> Sorry, I hit ctrl + enter too quickly :)
>
> http://www.phoronix.com/scan.php?page=article&item=linux_perf_regressions&num=1
>
> So - don't use the 2.6.32 kernel for production yet :)
>
>
> On Mon, 2010-05-03 at 12:24 +0300, Deyan Tsvetanov wrote:
> > http://www.phoronix.com/scan.php?page=article&item=ubuntu_lucid_alpha2&num=3
> >
> > PostgreSQL's performance continues to suffer dramatically under Ubuntu
> > 10.04 LTS and it is not expected that it will change at all for this
> > next Ubuntu release. This major drop in the number of transactions being
> > carried out per second is due to an EXT4 file-system change designed to
> > provide better data safety but with a significant performance penalty.
> > This matter is talked about in Autonomously Finding Performance
> > Regressions In The Linux Kernel. The PostgreSQL performance also suffers
> > in Fedora 13 and any other Linux distributions using the Linux 2.6.32
> > kernel. Even with Fedora 13 being much earlier into its development
> > cycle and carrying some debugging options by default (along with using
> > SELinux), Fedora 13 Rawhide performed quite closely to Ubuntu 10.04
> > Alpha 2 in this test.
> >
> >
> >
> > On Mon, 2010-05-03 at 14:37 +0530, Ravindra Mandre wrote:
> > > I am also facing the same problem that Kranti reported above.
> > > I also using Ubuntu 10.04.
> > >
> > > Regards
> > > Ravindra Mandre
> > >
> > > On Mon, May 3, 2010 at 2:17 PM, Jonatan Soto <[hidden email]>wrote:
> > >
> > > > I am using Ubuntu 9.10 with ext4 and it works great.
> > > >
> > > > On Mon, May 3, 2010 at 10:42 AM, Kranti Agrawal <[hidden email]
> > > > >wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I installed Ubuntu 10.04 LTS yesterday with ext4 as the default file
> > > > > system.
> > > > > The seed data load is very very slow. It takes around 30 mins to load.
> > > > > In ubuntu 8.04 LTS, it took around 2-3 mins max.
> > > > > Is it due to the ext4 file system? or anything else?
> > > > >
> > > > > Regards,
> > > > > Kranti Agrawal
> > > > > Student, IIIT Bangalore
> > > > > krantiagrawal.blogspot.com
> > > > >
> > > >
> >
> >
>
>