You forgot that words can, and do, have multiple meanings depending on context. There is a more vulgar definitely that defines diddling as “to have sex with”.