Setting her library on fire wouldn't piss Patchouli off. It would drive her either psychotic, send her into a coma or make her suicidal.
Also, the chicken trick would not piss Aya and Mystia off, but rather traumatize them for life. Same goes for Wriggle, who would burst out crying uncontrolably. And then seek revenge.
The other things do piss the respective people off.
Good point... those are more along the lines of a death wish then a piss off.
Well then for character piss offs:
Go to Mystia's grilled lamprey stand and ask if she has any chicken. Then remark on how much you love to eat it.
Tell Letty spring is coming early this year.
Telling Suwako you just gave a bag of frogs to Cirno to play with.
Explicitly go on how much you hate history and think it's so boring to Keine.
Run around the Scarlet Devil Mansion with muddy shoes/boots on, getting footprints everywhere after Sakuya had just finished cleaning the entire mansion.
Kind of like that image but with more muddy footprints.