Looks like the newest release of MacFUSE and sshfs are all I need to turn the switch for AFP and SMB to "off". That'll be a great move!
To use MacFUSE and sshfs (you need Mac OS X 10.4 Tiger):
I just found MacFusion (Macfusion.dmg)which looks like it has some cool gui niceties, like keychain password integration! Actually, it even has the one feature I really missed: public key!
¥