The benchmark BSE Sensex closed 0.53 per cent lower at 28,469.67 points.
The BSE Sensex fell on Thursday for a second consecutive session, retreating from earlier gains of as much as 1.2 per cent as investors felt domestic markets already sufficiently reflect expectations for a later start in US rate rises.
Most global markets rallied towards all-time highs after the Federal Reserve signalled it was in no rush to push borrowing costs higher despite removing a reference to being "patient" on interest rates from its policy statement on Wednesday.
In India, however, shares had already risen to record highs earlier this month but have retreated amid concerns about a lack of triggers.
The benchmark BSE Sensex closed 0.53 per cent lower at 28,469.67 points.
Earlier in the day, it gained as much as 1.25 per cent.
The broader Nifty ended down 0.59 per cent, after gaining as much as 1.18 per cent earlier.
Lenders led the decliners with the bank index of the NSE down 1.76 per cent.
State Bank of India fell 2 percent and ICICI Bank closed 1.4 per cent lower.