Does audio out to amp have to be optical?

If I use HDMI direct to my TV, I get video and audio. If I use HDMI into my amp and then out from amp to TV, I only get video, but no audio, so I have to use an optical cable. That works fine, but I ...