There's not necessarily a right or wrong way to get started. The most important thing is that you just start making healthy changes and then gradually build on those changes over time.
For me, the very first thing I started doing was simply eating less. I didn't excercise and I didn't change the quality of my food right up front. I just simply cut down on my portions and that was enough of a kick start to help me lose my first 20 lbs. From there I started improving the quality of my food (eating less processed junk, drinking more water, incorporating fruits and veggies into my day) while still being mindful of portions. Then I lost a little more weight and finally included physical activity into my daily routine. Started off walking a few times a week, then I added some low impact aerobics dvds, then eventually I went for jogs and did strength training and kickboxing.
My way isn't the only way that works. Weight loss routines have to be customized to your personal needs and daily routines. Just keep it simple and as uncomplicated as possible as there's no secret method that will yield the best results. The bottom line is to eat less, eat better and move more. Take baby steps and keep pushing past any setbacks you may encounter along the way. It sounds like you've already made some great changes to your lifestyle and are on the right path. Over time if your weight loss progress stalls then you can re-evaluate what you're doing and see where else you can make other changes.
Best of luck!
"Only when we are no longer afraid do we begin to live" ~ Dorothy Thompson
"Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring." ~ Marilyn Monroe