While performing sandhyavandanam at temples, it can be done facing the main deity. At other places, it is done facing either East, North, or West as appropriate.
Since Perumal is present in temples, it is the practice of elders to consider that Perumal Himself is verily present and perform sandhyavandanam at the temple facing Perumal’s sanctum.