A man accused of supplying drugs to Liam Payne before his death has insisted he “never” gave narcotics to the late singer.