You can take them. But they are able to kill/pod you. They are among the only few NPC’s who can actually pod you. If you see something other than Autothysian Lancer, do not approach, or provoke.
EM is the best offense against them. My T2 Precision Cruise missiles makes quick work of them.
Edit: Here is some info on drifters.
https://wiki.eveuniversity.org/Drifters