Yeah, 80's late-night was different from today. Back then it was about movies, tv & new comedians. Once in a while they'd have a no-name band who were not yet famous & probably didn't become famous.
I think Madonna was the only 80's singer on late-night tv. But she was also acting at the time.
It wasn't the "flavor of the week" tv there is now.