Yes it is open sundays.
To note that access to the Chapel is only for attending Services on a Sunday.
You can visit the Castle on a Sunday, but only worshipers are allowed in St. George's chapel that day. You cannot walk around or play the tourist, even if you do attend a service.
I would choose a different day, if St. George's holds any appeal--and it is magnificent.