I Love the Sound of Breaking Glass by Nick Lowe. That would be the first cover that I learned. I still don't feel I do it justice forty years later...!
Before that I was playing to original songs that were derivative of a lot of the eighties stuff from Smiths, Joy Div/New Order, REM and such. We were a side project of the drummer's and it was for a laugh more than for the gigs.