Do you skip a rack unit between servers?

Question

It seems like there's a lot of disagreement in mindsets when it comes to installing rackmount servers. There have been threads discussing cable arms and other rackmount accessories, but I'm curious:

Do you leave an empty rack unit between your servers when you install them? Why or why not? Do you have any empirical evidence to support your ideas? Is anyone aware of a study which proves conclusively whether one is better or not?

Solution 1

If your servers use front to back flow-through cooling, as most rack mounted servers do, leaving gaps can actually hurt cooling. You don't want the cold air to have any way to get to the hot aisle except through the server itself. If you need to leave gaps (for power concerns, floor weight issues, etc) you should use blanking panels so air can't pass between the servers.

Solution 2

I have never skipped rack units between rackmount devices in a cabinet. If a manufacturer instructed me to skip U's between devices I would, but I've never seen such a recommendation.

I would expect that any device designed for rack mounting would exhaust its heat through either the front or rear panels. Some heat is going to be conducted through the rails and top and bottom of the chassis, but I would expect that to be very small in comparison to the radiation from the front and rear.

Solution 3

In our data center we do not leave gaps. We have cool air coming up from the floor and gaps cause airflow problems. If we do have a gap for some reason we cover it with a blank plate. Adding blank plates immediately made the tops of our cold aisles colder and our hot aisles hotter.

I don't think I have the data or graphs anymore but the difference was very clear as soon as we started making changes. Servers at the tops of the racks stopped overheating. We stopped cooking power supplies (which we were doing at a rate of about 1/week). I know the changes were started after our data center manager came back from a Sun green data center expo, where he sat in some seminars about cooling and the like. Prior to this we had been using gaps and partially filled racks and perforated tiles in the floor in front and behind the racks.

Even with the management arms in place eliminating gaps has worked out better. All our server internal temperatures everywhere in the room are now well within spec. This was not the case before we standardized our cable management and eliminated the gaps, and corrected our floor tile placement. We'd like to do more to direct the hot air back to the CRAC units, but we can't get funding yet.

Solution 4

I don't skip Us. We rent and Us cost money.

No reason to for heat these days. All the cool air comes in the front, and out the back. There's no vent holes in the tops any more.

Solution 5

Google is not leaving U between servers, and i guess they are concerned by heat management. Always interesting to watch how big players do the job. Here is a video of one of their datacenter: http://www.youtube.com/watch?v=zRwPSFpLX8I&feature=player_embedded

Go directly to 4:21 to see their servers.

View more solutions

Comments

[Matt Simmons]

OK, 6 cables, let's see...2 management interfaces, 2 iscsi interfaces and 2....dedicated to the cluster manager?

[Doug Luxem]

Don't use management arms and you don't have to skip units. :)

[Doug Luxem]

In fact, if you are skipping rack units, you need to use covers between each server otherwise you will get air mixing between your high and cold aisles.

[Laura Thomas]

Having seen your data center I have to wonder if you set things up in a traditional hot aisle cold aisle setup rather than scattered around your giant room if you'd get better thermal performance.

[pauska]

If your servers use front-to-back fan cooling its not wise at all to leave gaps, it will hurt the airflow.

[Thomas]

Yes, if you leave a gap, you need to fill it with a panel to prevent that.

[joeqwerty]

=1. rack mount servers and racks are designed for air flow with all panels and bezels on and all u's filled. much like the air flow in a pc is designed for having all the covers on. circumventing the design by leaving gaps and\or removing panels and covers is likely to do more harm than good.

[JamesBarnett]

Re: "Us cost money." I use to think space was a major factor in datacenter pricing. Then I got a job in the hosting sector, turns out most costs in a Colo environment are from power circuits & cross connects.

[Tim Lehner]

+1: Thank you for mentioning actual measurement of temperatures both with and without spaces.