Dysfunction of bone marrow mesenchymal stem cells (BMSCs), osteoblasts and osteocytes may be one of the main causes of bone loss in the elderly. In the present study, we found osteogenic cells from aged rats all exhibited senescence changes, with the most pronounced senescence changes in osteocytes. Meanwhile, the proliferative capacity and functional activity of osteogenic cells from aged rats were suppressed. Osteogenic differentiation capacity of BMSCs from aged rats decreased while adipogenic capacity increased. The mineralization capacity, ALP activity and osteogenic proteins expression of osteoblasts from aged rats decreased. Additionally, osteocytes from aged rats up-expressed sclerosteosis protein, a negative regulator of bone formation. To inhibit osteogenic cell senescence, we use low magnitude vibration (LMV) to eliminate the senescent osteogenic cells. After LMV treatment, the number of osteogenic cells staining positively for senescence-associated-β-galactosidase (SA-β-Gal) decreased significantly. Besides, the expression of anti-aging protein SIRT1 was upregulated significantly, while p53 and p21 were downregulated significantly after LMV treatment. Thus, the LMV can inhibit the senescence of osteogenic cells partly through the Sirt1/p53/p21 axis. Furthermore, LMV was found to promote bone formation of aged rats. These results suggest that the inhibition of osteogenic cell senescence by LMV is a valuable treatment to prevent or delay osteoporosis.