Patong is were the majority of the ladyboy action is on Phuket.
However, I don't consider Patong to be a relaxing place. It can be very annoying if you are looking for peace and quiet.
As mentioned in another thread, transportation is a pain in the ass in Phuket.
If you are comfortable riding a motorbike, then rent a motorbike and go exploring.
If you've never ridden a motorbike and are nervous in crazy traffic, then maybe consider someplace other than Phuket.
Here is something I wrote about motorbikes:
https://ladyboyforum...882-motorbikes/
If you rent something like a Honda Click, don't pay more than 200 Baht per day.
Always wear a helmet and be ready for the police checkpoint on Patong-Karon hill.
Chalong circle is nuts the first time you drive through it. Also, they are building a bypass tunnel under Chalong and there is plenty of dirt and loose gravel to watch out for.
Rawai has some ladyboy action and it isn't hectic like Patong. It has a rocky beach, but you can rent a motorbike and go to Nai Harn.