I didn't suggest you were. He can still do you considerable harm, whether you fear him or not, however. Enlisting Bellatrix to do his dirty work for him isn't something I would put past him, for example, and she doesn't rely solely on a wand to - play with her food before she eats it, as someone once described it.
Private