The point of the game is not to be easy. They won’t just hand out free shiny so it’s easier for you :)
The effect of building is what makes the game playful. If there weren’t timers for the traps or blocks, there wouldn’t be a building animation. Not fun!
-Plus it gives you a few seconds to stop the building before your workers get there.
Your idea has been mentioned many times, but a change probably won’t be implemented anytime soon. Message the developers! They’re more likely to get it there than lost in the forums.