Banks have been a popular sector for hedge funds over the past few years. Managers that got in when banks were still in recovery mode have been able to ride the bounce back. But now, just as retail investors are starting to see the potential in banks, one fund is taking a step back and even shorting some of the stocks.

St. Louis-based FourthStone is a buy-