i come across this kind of situation a lot thanks to the kind of character i play - when this happens, the "you are trying my character's patience" and desire to fight tends to also be coupled with the desire to fight outside. they don't want to battle and cause a mess in the middle of the quicksand!
so, like any reasonable and mature adult, i say "sure thing, you first". then i leave them outside. then i go back inside, proclaiming i won.
so, like any reasonable and mature adult, i say "sure thing, you first". then i leave them outside. then i go back inside, proclaiming i won.