Who gets the allergy? 
It is common for people to get mold allergy if they or other family members are allergic to substances such as pollen or animal dander. People may become allergic to only mold or fungi, or they may also have problems with dust mites, pollens and other spores. If you are allergic to only fungi, it is unlikely that you would be bothered by all fungi. The different types of fungi spores have only limited similarities. People in some occupations have more exposure to mold and are at greater risk of developing allergies. Senior Executives who spend long hours in closed air conditioned rooms, employees who spend long hours in closed air conditioned cubicles or halls, people working in dampy rooms are at greater risk of developing allergies. 

Fungi on houseplants can cause an allergic reaction, but this is only likely to happen if the soil is disturbed. Fungi can even grow in the human body. If not properly treated, intense inflammation can recur often. It can permanently damage airway walls. This is not common, though.