ksbhaskar on 22 Oct 2010 05:56:43 -0700


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] Recent Linux file system benchmarks

  • From: ksbhaskar@gmail.com
  • To: "Philadelphia Linux User's Group Discussion List" <plug@lists.phillylinux.org>
  • Subject: Re: [PLUG] Recent Linux file system benchmarks
  • Date: Fri, 22 Oct 2010 12:56:30 +0000
  • Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:x-rim-org-msg-ref-id :message-id:content-transfer-encoding:reply-to:x-priority:references :in-reply-to:sensitivity:importance:subject:to:from:date :content-type:mime-version; bh=8EM+YbLvdezOGiAhA5YRxf7NWFKp8W07EqgXGZ1AuTw=; b=etdGlaLMf66UxxBr5n8gxZLDt38dfNy0oVhqRLi12woAG3bcpKO2lNXv9vEOlkJoP+ zM5OXDYY9vF/wTr1JM00tuSmtOBUI347B9fFjbCvUhqbERoFAi1KfmX601rUmGXc0bNg wQPwIssElvouxicR2B9O1kL+u0nOeYySTKGGw=
  • Reply-to: ksbhaskar@gmail.com, Philadelphia Linux User's Group Discussion List <plug@lists.phillylinux.org>
  • Sender: plug-bounces@lists.phillylinux.org
  • Sensitivity: Normal

What is a native file system?

Regards 
-- Bhaskar
Sent from my Verizon Wireless BlackBerry

-----Original Message-----
From: Mag Gam <magawake@gmail.com>
Sender: plug-bounces@lists.phillylinux.org
Date: Fri, 22 Oct 2010 07:54:57 
To: Philadelphia Linux User's Group Discussion List<plug@lists.phillylinux.org>
Reply-To: Philadelphia Linux User's Group Discussion List
	<plug@lists.phillylinux.org>
Subject: Re: [PLUG] Recent Linux file system benchmarks

Interesting to see how a database would perform with their native
filesystem/data management (ie ASM) against a Linux file system.




On Mon, Oct 18, 2010 at 4:16 PM, K.S. Bhaskar <bhaskar@bhaskars.com> wrote:
> Thanks, Lee. ÂComments below.
>
> Regards
> -- Bhaskar
>
> On Mon, Oct 18, 2010 at 2:20 PM, Lee Marzke <lee@marzke.net> wrote:
>> Bhasker,
>>
>> The btrfs results are disappointing if that's the performance will be
>> expected in production.
>
> [KSB] At the Linux End User Summit in Jersey City last week, I had an
> opportunity to discuss the benchmark with some of the Red Hat
> filesystem team. ÂThe default btrfs mount options are clearly not well
> matched to the needs of a database. ÂPerhaps turning off copy on write
> will improve it. ÂAnother hypothesis is that GT.M triggers a known
> current pathological behavior in btrfs - allocating a large sparse
> file and then randomly writing blocks within it.
>
> The good news is that btrfs is still under development (it doesn't
> even have an fsck as yet) and the RH team has the benchmark. Âbtrfs
> certainly has some attractive features that I look forward to, such as
> a near instant copy of an arbitrarily large file by copying the
> metadata.
>
> My original benchmark did not include xfs. ÂOne of the RH team
> suggested it, and I was able to run a benchmark on it and include the
> results. ÂThey also said several times that they did not expect one
> file system to meet all application needs.
>
>> ZFS/Fuse performance under Linux is also disappointing.
>
> [KSB] I did not test zfs/fuse. ÂIs this something that you tried
> running the benchmark on? Â[If you did, any comments on making the
> instructions easier to follow would be appreciated.]
>
>> I'd be curious about performance of a NetApp filer ( which uses a
>> propriatary WAFL
>> filesystem, Âsimliar to ZFS ) however it has extensive caching that is
>> supposed to vastly
>> improve COW performance. Â ÂFrom what I understand caching writes in NVRAM
>> is the secret
>> to good performance with COW filesystems.
>>
>> Note that NetApps I've used ( FAS 2000 ) generally have 12 to 16 spindles
>> per Aggregate
>> SATA volume, so I'm not sure that's valid against your current benchmark.
>> ÂBut, still having
>> the advantages of using lots of snapshots without penalty, and still having
>> a very fast SAN might be
>> worth the cost of a NetApp. Â( Plus you get RAID-6 equiv protection , Âand
>> with more
>> spindles, and perhaps better performance than your RAID-0 striped SATA disks
>> )
>
> [KSB] If you have one, I'd be happy to help you set up the benchmark
> and run it. ÂIt is my goal that anyone should be able to set up and
> run the benchmark with just a few minutes effort. Â[The benchmark of
> course can run for much longer.]
>
> --
> Windows does to computers what smoking does to humans
> ___________________________________________________________________________
> Philadelphia Linux Users Group     --    Âhttp://www.phillylinux.org
> Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
> General Discussion Â-- Â http://lists.phillylinux.org/mailman/listinfo/plug
>
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug