Thank you for the feedback. I thought about the lack of watering too, but the BIL, who planted grafted durian trees years ago and definitely waters them regularly, is having the exact same problem. Fruit just falling off, despite having had some fruit last year.
Missus says it's "too hot". While it is hotter than usual, I fail to see how the extra degree or two can cause the trees so much stress.