unfortunately, the ball doesn't follow the laws of physics, like momentum. If the ball is going full speed at a hole, it shouldn't fall right in. Think of golf.
i'd would recomend making it a little more difficult and making the enemy shots more sensitive. I ended up quiting at lvl 9 with 439 mil points because it was too easy.