I prefer that the grain runs the long way in the box dimension. If tall and slender, the grain should run vertical. If wider than tall, the grain should run horizontal. I would make all four (or more) sides with the grain running in the same direction. The top and bottom are of less importance, but I prefer the grain running in the longest dimension.
Charley