Elementary vs. Secondary

When I was a little girl I had an "ah-ha" moment. I realized that math was easy if you understood basic concepts. Oh course when I had this "ah-ha" moment, it was from the perspective of a student and not very ground breaking. However, it was a determining factor in what I wanted to do when I grew up.  I had always loved math. I loved solving problems in my head, I loved to do puzzles, and challenging myself to complete a problem quicker and better than everybody else. I also had amazing teachers help me grasp the fundamentals of math and see the patterns that existed within every math problem.  I knew I wanted to do this for other people.  I had friends that HATED math...but when you investigated further it wasn't because it was boring or whatever it was because they couldn't see the patterns! They struggled with the basics which made the higher level mathematics almost impossible.  I knew when I became a teacher that I wanted to help students stop struggling with math.  However, I have been teaching 6th grade (long story how I got into that grade) for 4 years now....and I have to admit I am burning out. Being in an elementary setting is really difficult.  I am asked to teach all subjects, deal with homeroom stuff, monitor 24-30 students (depends on the year), deal with field trips, school fundraisers, sign agenda books, have parent teacher conferences, among many more things. I am not saying that teaching in a secondary position is ANY easier...but I know colleagues that have made that switch that say they are a lot less stressed out...so why is it? Did I make the wrong career choice?