128-Core AMD Epyc Rome Server Tear-Down, ft. Level1Techs
video description
Date: 2020-05-06
Related videos
Comments and reviews: 10
Kernelpickle
Servers also live in data centers that are typically kept at least (68F/20C) or lower, which should (if they re setup properly) have their own HVAC and air filtration system that is separate from the rest of the building it s in. The data centers that I work in tend to have plenty of air movement, so it s not static air at that temperature. I don t know if all that air movement is due to those high powered fans in the rack units, or from the HVAC system itself since I m not sure how the HVAC was designed, I can t say for certain, but I would assume it s the HVAC recirculating the air and causing all that movement. So, in ideal conditions like that, it s easy to see why some decent heatsinks are all you need. Even if you found a way to force more air through those units, I m willing to bet that the diminishing returns would make it a pointless exercise in overkill. Consider the fact that if we re strictly using air to cool the system, the additional power draw necessary to increase fan speed further, would likely generate more heat that needs dissipating. Eventually you ll hit a brick wall where the physics won t allow you to increase airflow without adding equivalent heat, or possibly even more heat than you re dissipating with that airflow.
reply
Servers also live in data centers that are typically kept at least (68F/20C) or lower, which should (if they re setup properly) have their own HVAC and air filtration system that is separate from the rest of the building it s in. The data centers that I work in tend to have plenty of air movement, so it s not static air at that temperature. I don t know if all that air movement is due to those high powered fans in the rack units, or from the HVAC system itself since I m not sure how the HVAC was designed, I can t say for certain, but I would assume it s the HVAC recirculating the air and causing all that movement. So, in ideal conditions like that, it s easy to see why some decent heatsinks are all you need. Even if you found a way to force more air through those units, I m willing to bet that the diminishing returns would make it a pointless exercise in overkill. Consider the fact that if we re strictly using air to cool the system, the additional power draw necessary to increase fan speed further, would likely generate more heat that needs dissipating. Eventually you ll hit a brick wall where the physics won t allow you to increase airflow without adding equivalent heat, or possibly even more heat than you re dissipating with that airflow.
reply
CHOPPERGIRL's
I bought an IBM Xseries 455 like that in a 4u rack case. Itanium 2's up to 4, and up to 56gb ram, or 4x56gb if you connect four units. I hate it, it's a piece of shit. It does that same fan blast at boot because you're not in a 50 degrees server room. Worse, is the EFI bios. I've had it for years no and have no idea what to do with this 35, 000 list price boat anchor. and I'll never buy a dedicated piece of rack mounted server hardware again. At best maybe you could use it for a webserver, but it sucks so much power and generates so much heat and noise. why would you want to. These things are only really good for selling VMs. What I hate most about them, is they are all proprietary everywhere. you need a proprietary power supply, proprietary vid cards. most have no sound output, and only two usb ports. proprietary dvd drives, if that.
reply
I bought an IBM Xseries 455 like that in a 4u rack case. Itanium 2's up to 4, and up to 56gb ram, or 4x56gb if you connect four units. I hate it, it's a piece of shit. It does that same fan blast at boot because you're not in a 50 degrees server room. Worse, is the EFI bios. I've had it for years no and have no idea what to do with this 35, 000 list price boat anchor. and I'll never buy a dedicated piece of rack mounted server hardware again. At best maybe you could use it for a webserver, but it sucks so much power and generates so much heat and noise. why would you want to. These things are only really good for selling VMs. What I hate most about them, is they are all proprietary everywhere. you need a proprietary power supply, proprietary vid cards. most have no sound output, and only two usb ports. proprietary dvd drives, if that.
reply
saultube44
#AskGN Steve: I don't know why you need redundancy, encryption and error checking, I think it's just unnecessary unless you need absolute integrity and I presume you don't, you could have waited for the upcoming 64C/128T ThreadRippper, cluster 2 of them with 10 Gb LAN and boom, same performance, a lot less money; this exactly why ThreadRipper was built for, small-medium businesses like yours, you're going Enterprise, paying 2x the money for extra features that probably you'll never really need; too bad you went with Wendell, well intentioned guy but in his videos he overcomplicates things and in the installation of unRAID people noticed he did exactly that, so of course he'll go with Servers because that's what he handles, you should really check your options
reply
#AskGN Steve: I don't know why you need redundancy, encryption and error checking, I think it's just unnecessary unless you need absolute integrity and I presume you don't, you could have waited for the upcoming 64C/128T ThreadRippper, cluster 2 of them with 10 Gb LAN and boom, same performance, a lot less money; this exactly why ThreadRipper was built for, small-medium businesses like yours, you're going Enterprise, paying 2x the money for extra features that probably you'll never really need; too bad you went with Wendell, well intentioned guy but in his videos he overcomplicates things and in the installation of unRAID people noticed he did exactly that, so of course he'll go with Servers because that's what he handles, you should really check your options
reply
Rachel
I have to love Wendell trying really hard without props to describe what is essentially a low-tech version of a SGI (now HPE) ICE-XA M-Cell water cooled blade chassis block with integrated IB switches, PSUs, and management controllers in trying to describe water cooled server racks. or if you want to get fancy, the Atos Bull Sequana system with water cooling connectors embedded in the blade rack ears. Supercomputers have been doing the water cooled servers and blades for some time now and the tech is absolutely awesome to take a look at - what with CDUs (Cooling Distribution Units) to exchange heat from the rack water loop into a building loop, then on out into chiller plants for the building, and super nifty quick change water connectors
reply
I have to love Wendell trying really hard without props to describe what is essentially a low-tech version of a SGI (now HPE) ICE-XA M-Cell water cooled blade chassis block with integrated IB switches, PSUs, and management controllers in trying to describe water cooled server racks. or if you want to get fancy, the Atos Bull Sequana system with water cooling connectors embedded in the blade rack ears. Supercomputers have been doing the water cooled servers and blades for some time now and the tech is absolutely awesome to take a look at - what with CDUs (Cooling Distribution Units) to exchange heat from the rack water loop into a building loop, then on out into chiller plants for the building, and super nifty quick change water connectors
reply
MrGivmedew
I have a bunch of the 5500RPM 120mm Delta PFC fans. You can put 1 on a single 120mm radiator and it will beat out a quad radiator with 8 fans in push pull. Also they are capable of flight. I plugged one in to test it and it took off disconnected itself then came down on my foot clipped my toe and broke a blade. If you want a bunch of them you can can 9 or more of them on this pull out thing for 15-30. The fans are probably all reverse PWM but I have them in both. Reverse PWM means 0 is 100 and 100 is 0 so that if it looses the PWM speed signal it defaults to 100% fan speed. You can build a reverser with a 555 timer. Someone wrote a how to online.
reply
I have a bunch of the 5500RPM 120mm Delta PFC fans. You can put 1 on a single 120mm radiator and it will beat out a quad radiator with 8 fans in push pull. Also they are capable of flight. I plugged one in to test it and it took off disconnected itself then came down on my foot clipped my toe and broke a blade. If you want a bunch of them you can can 9 or more of them on this pull out thing for 15-30. The fans are probably all reverse PWM but I have them in both. Reverse PWM means 0 is 100 and 100 is 0 so that if it looses the PWM speed signal it defaults to 100% fan speed. You can build a reverser with a 555 timer. Someone wrote a how to online.
reply
Keri
ugh. had some enterprise-class lighton redundant PSU's in our server room before. Note: this was in an active aircraft hanger. Note: EVERYONE complained about how loud the server room was. working in the server room was a nightmare with those things. It was like working in a tornado, next to a train, passing through Woodstock. Everyone was happy when they both somehow ate an antistatic part bag and died. Replaced with a pair of normal PSU's with failover from Enermax. Much better. I swear the danm things were louder than the C5 Galaxays or Hurk's that liked to idle and do preheat's in front of our hanger.
reply
ugh. had some enterprise-class lighton redundant PSU's in our server room before. Note: this was in an active aircraft hanger. Note: EVERYONE complained about how loud the server room was. working in the server room was a nightmare with those things. It was like working in a tornado, next to a train, passing through Woodstock. Everyone was happy when they both somehow ate an antistatic part bag and died. Replaced with a pair of normal PSU's with failover from Enermax. Much better. I swear the danm things were louder than the C5 Galaxays or Hurk's that liked to idle and do preheat's in front of our hanger.
reply
Miguel
I actually have experience with server assembly and that's why I'm not surprised at the noise level generated. Mostly I worked with Xeons and Opterons (a long time ago, also some chassis optimised for storage only. The only thing that shocked me while watching this was the 7A fans. I never worked with any single fan above 2A and that's pretty much already. Way to go indeed! Stored in racks far away from users, there's no problem. Always wear hearing protection.
reply
I actually have experience with server assembly and that's why I'm not surprised at the noise level generated. Mostly I worked with Xeons and Opterons (a long time ago, also some chassis optimised for storage only. The only thing that shocked me while watching this was the 7A fans. I never worked with any single fan above 2A and that's pretty much already. Way to go indeed! Stored in racks far away from users, there's no problem. Always wear hearing protection.
reply
Abraham
6: 01 for someone who says they work on dell and hp servers, that's a really odd mistake to make. i can't imagine that a person who is experienced with enterprise hardware would think that these fans are that slow. you think this fans is a slow as a noctua iPPC fan? no chance. the slowest fan i ever saw in ANY server was 7K RPM, and they were no where near as loud. 15K is typical.
reply
6: 01 for someone who says they work on dell and hp servers, that's a really odd mistake to make. i can't imagine that a person who is experienced with enterprise hardware would think that these fans are that slow. you think this fans is a slow as a noctua iPPC fan? no chance. the slowest fan i ever saw in ANY server was 7K RPM, and they were no where near as loud. 15K is typical.
reply
David
I am glad I turned one of my bedrooms into a server room, cause that thing and a few of my other servers, have no place in my living room although I'd really like to place a rack there since optically racks can look great, yet the noise pollution would have driven me insane. I am interested, could be a great workstation for me. Does that thing have PCIE 3. 0 or 4. 0?
reply
I am glad I turned one of my bedrooms into a server room, cause that thing and a few of my other servers, have no place in my living room although I'd really like to place a rack there since optically racks can look great, yet the noise pollution would have driven me insane. I am interested, could be a great workstation for me. Does that thing have PCIE 3. 0 or 4. 0?
reply
Santospirito007
As an Ex-Apple Data Center Server Technician those servers sounds bring back terrible memories. Servers running max fan speeds, and having to install 1 new server in a rack of 52 and having to cable it, with the hot air constantly blowing on you, and trying to pinstripe all the cables, and troubleshoot any issues before turning it live to the network.
reply
As an Ex-Apple Data Center Server Technician those servers sounds bring back terrible memories. Servers running max fan speeds, and having to install 1 new server in a rack of 52 and having to cable it, with the hot air constantly blowing on you, and trying to pinstripe all the cables, and troubleshoot any issues before turning it live to the network.
reply
Add a review, comment
Other channel videos
