I recently found that the OsmAnd app lets you adjust the safety of your bike routes, so you can prefer safety over distance.
When navigating, click the "Ride Style" button and choose "prefer unpaved roads." That name made me think it would find gravel/off-road trails, but it actually selects safer roads. In my experience this setting chooses the optimal routes--it's finding the same general path that I would pick based on local knowledge, and it found improvements where I could take a slightly different street for a few blocks to avoid cars!
Also, OsmAnd~ is available via Fdroid with all the paywalls removed.
Dude, no. I live off a dirt road and people treat it like a race track.
If they have an option called "prefer safer roads" then maybe, but if the app says unpaved, I'm going to assume that's what they are going for even if some of them are paved. They can "fix the glitch" server side any time they want without alerting your client side app.