The problem is likely nothing to do with your git install. It directs more toward your SSH keys.
If you are using Google, type the following line into the search box.
site:heroku.com ssh
It should give you better Google results. Namely, likely the Heroku “Managing Your SSH Keys | Heroku Dev Center” link.
