I'm with the OP, first times coming to Phuket were early and mid 90's, Rawai quiet, '95 or so surfed Nai Harn on a good swell BY MYSELF. Lived in Rawai off Soi Nanachart for 11 years 2005-2016.
I'm sure this high season is a nightmare crowd-wise as we come out of the whole Covid restriction time, probably a lot of pent-up Thailand visit desires out there.
I like earlier poster's suggestion of Koh Kho Khao, just a bit far from some of OP's requirements. Gulf coast is also a great suggestion, Prachuap and Chumpon.
Not beachy but in my Thai travels really enjoyed Kanchanaburi. House on the river, fishing. OP, maybe rent your place out during high season, go to the Philippines or just elsewhere in Thailand, come back in June when it chills out a bit.