Re: Plans for 1.8+ (2.0?)

[Michel Talon <talon@xxxxxxxxxxxxxxxx>]

Rupert Pigott wrote:

> On Thu, 01 Feb 2007 09:39:30 -0500, Justin C. Sherrill wrote:

> True, but Matt has explained that ZFS doesn't provide the functionality
> that DragonFlyBSD needs for cluster computing.
> 
> ZFS solves the problem of building a bigger fileserver, but it
> doesn't help you distribute that file system across hundreds or thousands
> of grid nodes. ZFS doesn't address the issue of high-latency
> comms links between nodes, and NFS just curls up and dies when you try to
> run it across the Atlantic with 100+ms of latency.
> 
> I don't know if IBM's GridFS does any better with the latency, but it
> certainly scales a lot better but the barrier for adoption is $$$. It
> costs $$$ and it costs a lot more $$$ to train up and hire the SAs to run
> it. There are other options like AFS too, but people tend to be put off by
> the learning curve and the fact it's an extra rather than something that
> is packaged with the OS.

Of course it is none of my business, but i have always wandered about the
real usefulness of a clustering OS in the context of free systems, and you
post allows me to explain why. People who have the money to buy machines by
the thousands, run them, pay the electricity bill, etc. should also have
the money to pay $$$ to IBM, and not count on the generosity of unpaid
developers. Small installations are the natural target of free systems, and
in this context i remain convinced that the clustering ideas have an
utility next to null. And frankly, i doubt they have any utility for big
systems if you don't use high speed, low latency connects which are far
more expensive than the machines themselves. And even with this highly
expensive hardware, if you don't have high brain programmers able to really
make use of concurrency.
On the contrary, the disks of Joe User are becoming bigger and bigger, his
processor is getting more and more cores, so there is clearly a need for
file systems appropriate for big disks and sufficiently reliable ( ZFS
being an example ) and operating systems able to use multicores
efficiently.