I'm still not sure, if this is really a bug or if I keep messing up... :)
However, it seems like the fron-end sometimes substracts 2 coins, when I'm trying to delegate. This happens before I confirm it with my ledger, so if I'm attentive, I can catch it. It's annoying nonetheless