If you shake
someone by the hand
, you shake hands
I said congratulations and walked over to him and shook his hand.
The Secretary emerged, a big fat man who quickly shook us all by the hand.
COBUILD Advanced English Dictionary. Copyright © HarperCollins Publishers