I don't know if this is possible in the regular YouTube app or website, but in SmartTube you can suspend your suggestions' being based on recent viewings and then resume the behaviour once you're done watching anomalous stuff.
I'd take a look at your YouTube settings and see if it's possible to pause the "suggestions based on history" functionality.