Do it in .inputrc like this:

set editing-mode vi

Now any executable that uses readline will have vi editing commands on its command line. mysql, psql, etc.

Do as much of your command line editing configuration in .inputrc as possible, and you'll have it everywhere.

EDIT: man readline