Let's just say you own a restaurant and decide to fly a giant Nazi flag in from of it. You have the freedom to do that if you want without fear of being punished by gov't/law enforcement for it.
If they allow rainbow flags they’ll lose in court over a nazi flag every time. Because the only way they can do anything about it is if they have an ordinance against flags. Which could also easily be challenged in court.