Apparently fans have done this before at previous concerts, so much so that he's been arrested before for inciting a riot