A big chunk of the world probably doesn't know about your work.
You might think you talk about it all the time, but most people around you will be clueless about it.
Get comfortable with this fact and be happy.
It permits you to write for yourself because you really are your own audience. And don't feel bad that you're talking about your work with others The work may be right up their alley.
But also, listen to others. You're not the only one who has passions and hobbies. Learn from them and support them. Do unto others...
If you become their champion, you never know where it may lead.