When it comes down to cultural appropriation people should think of it in a way as knocking on doors. You don't just walk into someone's home without knocking first. You wait until they answer the door and invite you in, not just walk in and interrupt things.