It could be that you’re not focusing on the right details to establish your setting. You’ll want to find elements that speak to both elements, but are able to be married together in a way that comes across as intentional rather than anachronistic. This might be tricky, but with a little trial and error, I think it can be done.
You could try incorporating fantasy-oriented names of people and places into some of the Victorian-esque details—like noting a group of dwarves repairing a gas pipe leading to a street lamp. Or maybe that the sickly sweet smell of rendering dragon fat pours out of the factories lining the waterfront along the (insert fantasy river name here). Hopefully if you focus on bigger details, people will understand that it isn’t a matter of not knowing your material.
Here are some resources that might be helpful:
Off the Beaten Path: Non-traditional Fantasy Settings
On Stepping Out of Medieval Fantasy: Part One
Avoiding Medieval Fantasy: Part Two
Rant on Technology in Fantasy
How to Incorporate Setting
Writing Dynamic Settings
Dickens’ London
That Smell (Detailed description of the smell of Victorian London)
25 Things You Should Know About Writing Fantasy