Bike won't start. Bad solenoid?

My 1984 Honda Magna won't start. Battery is fully charged, electrical seems to be working fine, runs great after I push start it. The starter solenoid is making a loud click when I hit the starter on. Is it safe to ume that replacing the solenoid will fix this problem?