Configuring SSH access and the DD-WRT firmware choice

In attempting to configure secure remote access to my labs at home, I'm running into issues with, what I'm assuming is, handling of SSH within the home router.

The idea, eventually, is to replace the consumer router with an IOS based solution, but for now, I have to play around with DD-WRT firmware.

So far, (SVN revision 17135), is not working out.

line vty 0 4

 exec-timeout 0 0

 login local

 no exec

 transport input ssh

Have the Domain, RSA Keys set, username and password, and have tried changing default port for SSH, but am not having any luck. 

I'm going to try to set the SSHd up within the DD-WRT, and the router I'm trying to SSH to as a client to it. We'll see.