Or the pass interference gets called on the Pats defender on that play ... if it were the other way around, the flag would definitely have been pulled.
Just watched the play again and disagree that it was PI or that it would have been called if it were the Pats. Neither Pat even touched him until the ball was there, nor were their arms in the air. And Tony would have said so if that was the case. He just dropped it.