Not a requirement at all, for me. So long as the person I am with has no
problem with my reading material, I am content with either fans or non-fans.
Incidentally, I did indeed convert my girlfriend into a Fantasy fan. I fed her on a diet of varied fantasy; from Wheel of Time, to A Song of Ice and Fire, with many steps in between.
Actually, I often read aloud to her. I read her the entire Belgariad series aloud. I've also read the first three Malazan books to her, as well as several other smaller series. She loves it.