I'm not sure what your goal was with this particular control scheme. It is awkward and very counter-intuitive. If you decided to go with it in order to increase difficulty, I urge you to consider other, more fruitful design spaces. Terrible control schemes are an excellent way to make people leave your game, and a very uninspired way to make a game more challenging. Also, adding other elements to the game would make it more engaging.