34 is far from the end of the line. It might still happen for you.
Granted, I already had 2 children at that age, so I wasn't in the same situation as you, BUT...I found myself unexpectedly single at the age of 33. I really didn't think I'd ever find a good man, and I certainly didn't think I'd have time to find a good man AND get married again AND have another baby before my biological clock ran out. I was wrong. I met someone great, got married, and had a baby at 36, and another baby at 38. I know a fair number of women who had their first baby at 40 or 42. One had her first at 44. All without fertility treatments.
If you really want children, I think you should pursue it. If it doesn't work out, worry about that later.