If the point is to have the game called correctly, then yes, review it.
I really don't understand the rationale behind reviewing some non-judgement calls, while not reviewing others. A non-judgement call is precisely defined by a rule. Each play impacts the game, and at the time the play occurs, it's nearly impossible to predict the effect of that play on the outcome of the game, especially if the play occurs early in the game. So why are some calls worthy of review, while other aren't? It doesn't make logical sense. Either make all non-judgment calls open to review/challenge, or get rid of review/challenge.
Just an example...in the last two minutes of the game, the replay official can call for a review of a 5-yd pass play to determine whether the catch was in or out of bounds, but he can't call for the review of a facemask that would result in a 15-yd penalty? Why is a gain of 5-yds more important to the game than a 15-yd gain? It makes no sense.
For my part, replay/challenge could be eliminated.
Personally I think you shouldn't be able to review or review for penalties. On every play there is a penalty that is missed (most of the time it's holding) so it is unreasonable to do this.