Ruin a British band by changing one letter of their name

The Tolling Stones

The Rolling Stoves

The Lolling Stones

The Polling Stones

The Rotting Stones (OK, double-L, L being one letter; cheating a bit)

The Robbing Stones

If one could change 2 letters, then The Robbing Stores

Another cheat, Australian band, though Anglo-Saxon:

The Peekers

The Reekers