My mother always cooked potatoes with skin on. Then she allowed them to cool just a little and peeled the skin off with fingers-OUCH
I saw a variation of this, Before cooking score through the skin round the thin part of-the potato. Boil as usual. Meanwhile set up ice water bath. Remove potato from water and plunge in to ice water. The skin will slide of in two pieces with just a little squeeze,
I always did Tomatoes this way but score after dipping in hot water. Same family same way to peel.