You're not. English grammar is wonderfully easy, and yet it is still a very rich and precise language. I can express ideas much more easily in it than in my native tongue.
Other languages have confusing pronouns too. In German, "sie" stands for either a formal "you", "they" or "she". In French, "on" can mean a generic person, like "one" (as in "One shouldn't talk to strangers"), or it can replace nous (we). You also have to guess if you're hearing someone say elle/elles or il/ils (sing. and plural feminine and masculine pronouns, respectively) because the s is silent unless followed by a word that starts in a vowel...usually.
Not to mention how complex verb conjugation can be and how you have to learn to distinguish between formal and informal pronouns...for instance, the rules for using tú/vosotros/vos/usted/ustedes change depending in which Spanish-speaking country you find yourself. You were wise to get rid of all that nonsense, you were!