The mayapple is a perennial plant in the barberry family which can be found in the woodlands here in Michigan. The plants grow up to 18 inches in height and grow in patches. Each plant has a single stalk that is topped with one to two broad, deeply divided leaves that resemble umbrellas.
In May (hence the name) a single, small white flower blooms from the fork in the stem. The flower then develops into a pulpy, lemon-yellow berry which ripens in late summer and is the only part of the plant that is not poisonous, and it is recommended that if you should eat the berries that it be done only in extreme moderation.
You can get a ton more information and photos about Podophyllum peltatum L. (mayapple) from USDA Plants, which shows that it grows from Florida all the way up into Canada.