My whitebox ESX cluster – part 1

I wanted to get my own ESX cluster for the obvious reasons. At the time de Compaq Evo Desktop D510 Small Form Factor was pretty popular. The Intel 845 chipset though, only supports 4GB RAM. A serious limitation, so I resumed my quest for the perfect ESX whitebox. I soon learned the Intel 965 chipset supports 8GB RAM. Together with the possibility to run on Core2 Duo CPU’s it was evident that this was my chipset of choice. I sticked with the SFF enclosure so a cluster would take less space and used less electricity.

I ended up with the HP Compaq dc7700 SFF PC with E6400 CPU’s. I managed to get 4 of those and because DDR2 RAM was cheap at that time I put 4x2GB sticks in all of them.

For the LAN part, I would rely on the on board Intel 82566DM NICs. For the iSCSI SAN connection I bought 5x PCIe GBit Intel 82574L NIC’s and used the software adapter.

At that time vSphere came out with official support for the Intel ICH9 southbridge. Hoorah!

I bought some new cheap hardware for the SAN, but FreeNAS and OpenFiler didn’t support the integrated graphics in the chipset yet, so I ended up using Windows Storage Server 2008 with the Microsoft iSCSI Software Target software. Very much NOT ideal, but it was and still is stable.

When vSphere 4.1 came out, I upgraded without any problems and gained additional hardware sensors. Sweet.

All running pretty stable now. Of course there is the disk I/O bottleneck. And eventually even the 32GB RAM will fill up. Running 25+ servers on 8 CPU cores also has it’s bad times.

I would like to put some Q6600 or QX6800 into the boxes at some time. But the problem is how to find 4 of them :-/ I also have my eyes on a 24 ports GBit switch with trunking possibilities, but that will also take some more time.

Overall, it’s my perfect whitebox ESX cluster =)

Advertisements

About Yuri de Jager
Technology Addict

One Response to My whitebox ESX cluster – part 1

  1. patrick says:

    how did you manage to make it work … esx 4.1 or esxi wont reconize properly the sata controller ?
    did you do anything in particular ??

    i need your help 🙂

    patric !

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: