This may sound crazy but I wonder if they don't have a separate area for him to watch the game or something. During the Baylor game where we won he got furious and stormed off during the 1st half. Didn't hear him at all until the end of the game when he came back down to his seats. The Iowa game this year I didn't see or hear him all game until late in the 4th when he would pop in long enough to yell at Bluder.
I am guessing he sits where the player's comp tickets are located.