As the diet, hormones, amenorrhea, and bone mineral density (BMD) of physique athletes (PA) and gym enthusiasts (GE) are little-explored, we studied those in 69 females (50 PA, 19 GE) and 20 males (11 PA, 9 GE). Energy availability (EA, kcal·kgFFM−1·d−1 in DXA) in female and male PA was ~41.3 and ~37.2, and in GE ~39.4 and ~35.3, respectively. Low EA (LEA) was found in 10% and 26% of female PA and GE, respectively, and in 11% of male GE. In PA, daily protein intake (g/kg body mass) was ~2.9–3.0, whereas carbohydrate and fat intakes were ~3.6–4.3 and ~0.8–1.0, respectively. PA had higher protein and carbohydrate and lower fat intakes than GE (p < 0.05). Estradiol, testosterone, IGF-1, insulin, leptin, TSH, T4, T3, cortisol, or BMD did not differ between PA and GE. Serum IGF-1 and leptin were explained 6% and 7%, respectively, by EA. In non-users of hormonal contraceptives, amenorrhea was found only in PA (27%) and was associated with lower fat percentage, but not EA, BMD, or hormones. In conclusion, off-season dietary intakes, hormone levels, and BMD meet the recommendations in most of the PA and GE. Maintaining too-low body fat during the off-season may predispose to menstrual disturbances.