Protaras, Cyprus Evening Weather?

I'm off to Protaras in Cyprus mid May and was wondering whether to take a cardi or jumper with me for the evenings? Can anyone tell me whether it gets chilly when the sun goes down there at this time of year?