The stability of numerical time integrators, and of the physical systems to which they are applied, are normally studied independently. This conceals a very interesting phenomenon, here termed inconsistent stability, wherein a numerical time marching scheme predicts a stable response about an equilibrium configuration that is, in fact, unstable. In this paper, time integrator parameters leading to possible inconsistent stability are first found analytically for conservative systems (symmetric tangent stiffness matrices), then several structural arches with increasing complexity are used as numerical case studies. The intention of this work is to highlight the potential for this unexpected, and mostly unknown, behavior to researchers studying complex dynamical systems, especially through time marching of finite element models. To allow for direct interpretation of our results, the work is focused on the Newmark time integrator, which is commonly used in structural dynamics.