Ask yourself which carries the desired emphasis: "deliberately offend" or "offend deliberately" - I think the emphasis is carried by the first word, so I chose the former deliberately.
The question is: what's wrong with a split infinitive? "Split infinitive" is the name of a construction in grammar; it's only because somebody decided to declare it as bad grammar that some people think it is.
Where lies the boundary between (normal) pedantry and hyper-pedantry? Following the rules is following the rules - you either do or don't, there seems to be little latitude for grey areas... but this is a case of fashion rather than rules.
Regardless, I never suggested I'm not contrary - as I believe has been mentioned in this thread before!