Wow, some of these "explanations" of this tries-to-hard arthouse game are ridiculous. Here's one. If you follow the game's instructions, nothing happens. If you don't, the graphics get distracting. Also at the end, nothing happens either way.
Good lord people, the tower sways naturally, if it didn't, you could just stack straight up. The physics are fine, you either don't get them or you're making mistakes.
You can easily get 350 points by stacking up every penis block you get vertically and discarding everything else. Just hold down and hit "c" every time you get a different block.