Whole grains are part of a healthy diet. If you would share your nutrition tracker it would be easier to advise on your nutrition. I found eliminating meat made losing 1- 2 pounds per week to goal worked for me. I have include link on meatless diet above.
Keep making the healthy fitness choices and enjoy every step you take towards changes that mean progress towards your goals.
Part of this journey is patience, perseverance and consistency which will empower other area s of your life in pleasant ways too. Enjoy this journey and much success wishes to you.