Hey pauldo,
Yes, thats the issue. It not really a problem when I play the B string with my index and middle fingers ('upward' movement), but when I plug it with my thumb ('downward' movement, e.g. during palmmuting) then it moves a bit... with more force it gives a sublte clanking noise.
Best,
Philipp