EW conveniently provided the episode and scene numbers of these (and all the pictures) from that interview with Elizabeth Martucci.
The first picture is 401, scene 38. Normally that would be late in the episode (and it still should be in the second half) but the episode has at least 51 scenes (the one with Kurt and Rachel meeting in Washington Square Park is scene 51).
The second picture is 403, scene 16. It’s Kurt’s Vogue interview, I’m guessing. That puts it probably before the first commercial, or maybe in the second act at the latest.
Holy Fucking Shit. A gay man should not be able to turn me on this much. Fuck.