Church will be decorated with Whitsun flowers