The Late Show host turned his ire toward a key member of Joe Biden's administration.