We've only seen it done once. In an anthology maze. For the awful Blumhouse maze. With the overused Purge.
I'd say we still owe it a chance.
There could be a lot of great lead up to going into the castle with villagers warning you before the scares start happening. I'm actually REALLY excited for this segment.
If it fails this time and the next time they use it, then I'd understand that mentality.