You lose 1 or 2 or so followers a day so you have to keep getting them up. However they never drop below half of what they were. So say you had 50 followers. Your followers would never drop below 25 but they can still drop. The game gives enough free diamonds and followers to keep them up though.
 "awesomeguy279"){kind=small}