I don't know the food regulations, you'll have to look into that. I think baked goods like that aren't too difficult to deal with.
Some simple questions to ask yourself is...
Where do you envision your business as an end result?
Do you want a "big" business?
Do you want a small (one person) business?
Do you want high paying clientele?
How much are people willing to pay for your product?
How much do you want to invest into your business?
A few things you can do...
First, word of mouth... Let people try them and get them talking about your new business. Over deliver or add an unexpected, pleasant surprise. Again, get people talking about it in a positive way.
You can start in a flea-market, then a mall or small store front in a good location. You can even start right from your home. You can also sell to grocery store chains. Rent a small space in an existing business. Etc...
The key thing is, know what you want, use a great resource like the internet to find how to get there. But having somewhat of a direction is key. And word of mouth is the BEST advertising you can get. Also, put yourself in the customer's "shoe".
I hope this helped spark some good ideas for you.
Jeff
edit