"What part?" he asks. "The half the universe being wiped out part or the part about me being responsible for it?"

There were still people who were unaware of the former and only Tony knew the latter. It could just as easily be one as much as the other.