Eye rhyme refers to words that both sound alike and look alike?

No they look alike but sound differently. Like rhyming "tough" with "bough" or "laughter" with "daughter". Usually such Words used to rhyme but pronounciations have changed the sound of one of the Words, while spelling has remained constant. (E.g. "daughter" used to sound like "laughter")