Not all parts of a flower are necessarily edible. Some flowers that you can eat whole with no worries are violas, violets, scarlet runner beans, honeysuckle and clover.
Others you just want to eat the petals such as roses, caladulas, tulips, yucca, lavender and chrysanthemums.
And even if the flower is edible remove the stamen & styles. Flower pollen tastes a little icky and even worse, so many people are severely allergic to to!