Well, that's the thing. He doesn't care that others did or didn't have an impression.

[prompto shrugs his shoulders, taking a sip of his drink--and finally lifting his gaze, relaxing a bit more.]

He likes to use his energy on things he finds important, and making an impression isn't one of them. He doesn't like letting others down though, for sure.