Barabar Caves are situated in the hilly area near Makhdumpur, 25 km south of Jehanabad. These ancient rock-cut Buddhist chambers date back to 3rd Century A.D. and are renowned as the place of origin of the Ajivika sect.

Baba Siddhnath Temple, also known as the Shiva Temple and originally known as Siddheshwar Nath Temple, is located at one of the highest peaks in the range of the Barabar Hills. The temple was built during the Gupta period in the 7th Century A.D. The local legends attribute the construction of the temple to Bana Raja. (the father-in-law of the legendary king Jarasandha of Rajgir.)