Systematists and evolutionary biologists have widely adopted Procrustes-based geometric morphometrics for measuring size and shape in biology. Many structures, and in fact most animals, are bilaterally symmetric with an internal plane of symmetry (also called object symmetry). Often, when quantifying asymmetric variation is not an aim, only one or the other side is measured and analyzed. This approach has been used in hundreds of studies. Its implicit assumption is that the information on the other side is redundant and a single side will, therefore, produce results mirroring those one would have obtained from the analysis of the entire structure with all its left and right landmarks. However, the extent to which this assumption is met has, to my knowledge, never been explored. Using two example data sets, I will show that congruence may be high in analyses at a macroevolutionary level but much lower at a microevolutionary one, and inaccuracies might especially affect shape. I will discuss some of the other factors that may influence results and will suggest a simple expedient that can improve both the visualization and accuracy of shape analyses in one-side-only studies.