Richards joked in a recent interview: "We can't get divorced - we're doing it for the kids."

Rolling Stones play $20 surprise gig

A tribute video opened Saturday's proceedings featuring celebrities heaping praise on the band.

"They're great songs to do bad things to," said actor Johnny Depp. "Just how skinny they all are... It really, really pisses me off," said actress Cate Blanchett.

The Stones - average age 68 - ripped through 20 hits that began with "Get Off of My Cloud" and closed with "Sympathy for the Devil" and an encore of "You Can't Always Get What You Want", "Jumping Jack Flash" and "(I Can't Get No) Satisfaction".

Women in the crowd opened their arms wide as Jagger, wearing a silver sequined jacket, strutted along the horseshoe-shaped stage for "I Wanna Be Your Man", a Beatles tune. The band was then joined by R&B singer Mary J. Blige for "Gimme Shelter".

Related: Fans get look at vintage Rolling Stones

"People say 'why do you keep doing this?'" Jagger told the crowd. He thanked fans for buying records and "generally being amazing for the last 50 years".

The Stones started their brief diamond jubilee tour in London and are due to play twice in Newark, New Jersey.

Fans said it could be the last chance for New Yorkers to see the band live.

"It's the only concert I wanted to see before I die," said Lucy Webley, 33.

Photos:

Grammy Nominations Concert in Nashville	Bieber, Kesha, Psy perform at Jingle Ball concert