We were able to reduce noise levels in a particularly loud data center by installing some anechoic panels on the walls. There are a variety of active and passive noise control techniques available for data centers. Try
data center noise control.
Ken