March, rather than May, but average temperatures are supposed to be low to mid teens then and there's a much better chance of sunshine than in England. (We considered Barcelona, but apparently that's often overcast then.)

A day-trip to Arles is definitely on the list of things we want to do, and possibly also one in the opposite direction to Orange.