If you are not getting frizz by brushing your hair, then I would not think you would have to worry about breakage. I thought the only reason curlies don't like to brush is because it can cause frizz.

Me? I brush and its Roseanne Roseannadanna city.`
High Density, High Porosity, Medium Texture, 3B with some kink

Lo-Poo: No Preference
Co-wash: CJ Smoothing Conditioner
RO: CJ Strengthening Conditioner - HG
LI: CK Satin Roots
Styler: CK Coil Jam
Other Likes: Castor Oil; CK Twist Whip, MD CSC
Dislikes: Wheat Protein; Aloe LIs or Stylers