Sometimes we can't use lsof to get ssh-agent PID, so specify it ourselves.