A neutral site for baseball would be absolutely ridiculous just as it is in any other sport.
In fact, the most memorable games are usually in awful weather. No one talks about the 82 degree Dodgers' World Series Game. They talk about the Fog Bowl or the Mud Bowl.