Currently your character's direction dictates your target rather than where you're actually looking. Camera direction based targeting would make it feel far more consistent.
This image shows the to be target being in the direction the character faces rather than where the player is actually looking.
.