Travel in the south

I plan on traveling to the south of thailand in the next few months, and I wonder if anyone out there has heard of any problems for Westerners in the more Islamic southern provinces. I will be travelling with a large group of Thais, but still, I do stick out like a sore thumb.

I would appreciate any recommendations of places to avoid e.g. Yala, Satun, Malaysia, etc.