We derive a sum rule that constrains the scale based decomposition of the trajectories of finite systems of particles. The sum rule reflects a tradeoff between the finer and larger scale collective degrees of freedom. For short duration trajectories, where acceleration is irrelevant, the sum rule can be related to the moment of inertia and the kinetic energy (times a characteristic time squared). Thus, two non-equilibrium systems that have the same kinetic energy and moment of inertia can, when compared to each other, have different scales of behavior, but if one of them has larger scales of behavior than the other, it must compensate by also having smaller scales of behavior. In the context of coherence or correlation, the larger scale of behavior corresponds to the collective motion, while the smaller scales of behavior correspond to the relative motion of correlated particles. For longer duration trajectories, the sum rule includes the full effective moment of inertia of the system in space-time with respect to an external frame of reference, providing the possibility of relating the class of systems that can exist in the same space-time domain.