I can't have gluten's either, and a little sensitive to lactose. Don't know on ice cream (never really cared for it). Replacing other milk products is just a matter of substitutions, and getting used to the slightly different tastes.
For gluten's. I use a lot of rice and oats. Many times tricked out with stocks, veggies fruit,.... The only way I have found to stomach all the terrible non-gluten breads is to fry them. Grilled ham sandwiches, toasted subs, or go open face with sauce can also help. This is one I just had to trial and error on. Hope it goes well for you.