I'm not necessarily "afraid" I'll annoy anyone, but I also understand that no one wants to be locked in a conversation about something weirdly specific that they know nothing about. Ever hear someone go on at great length and in great detail about D&D or anime to a party who simply was not interested? You have to read the room a bit.
I try to give only cursory info on my interests unless prompted or if I'm with someone I know would share the interest. It's only polite. But I don't think there's anything wrong with putting the feelers out for a second to see how someone responds to the topic, that's perfectly fine.