It said lime? will help, and I figure it's not the fruit. Ive been giving it regular houseplant food and the blooms that started (which should be purple) were dry and crumbly.

your Lavender is dying for the outside air and sun! If you don't get it outside in the ground it may die! Plants may do OK for short periods of time indoors but they will soon start looking sick and having problems. As far as the lavender is concerned, you have it on a short leash, in a small cage, in the dungeon! Hardly any plants will do as good indoors as they will outside.

I have many plants of lavender, and I don't do much with them,except 2 time during the growing season I feed them Miracle grow plant food. I have them in my front yard in full sun. When I bring the flowers in the house, I let them dry, and I remove the dried flowers and sprinkle them on my carpets, when I am about to vacuum, the whole house smells so nice.

try giving it some miracle-grow. yes a little lime, just a pinch or 2 in gallon of water. it don't take much. bone meal is safer to use. also try pruning it back about a 1/3. go to local plant conservatory, if there one in your area, the workers there are helpful with info on plants.

Miracle Grow is the magic, and the other blooming plant enhancer
I use is Osmocote, slow release fertilizer.
And regular hand watering.

Good LUck!

I have just planted my first bunch of lavender and I discovered by reading the below links that I now have to move it and buy some sand and make a mound.
I also discovered I don't know what kind mine is and that there is a whole lot of them........
Good Luck to you

http://www.gardening-tips-perennials.com/lavender.html
And as there is no secret to the name of the plant, there are no secrets to the successful culture of this perennial herb. Full hot sun is the first ingredient in the recipe and this is a plant that thrives in the hottest part of my garden.
................Excellent drainage .................
is another ingredient in the recipe because any excessive wetness around the roots will lead to root rot. It is for this reason that growing lavenders on clay is not recommended. If you have clay soils, grow this plant in a container or in a raised bed with sandy soils in the raised bed.
The recipe is complete with a shovel of compost spread around the plant in early spring and yearly spring pruning to remove all the winter-killed branches.
..................Over feeding ....................
leads to soft growth and poor fragrance; you have to be tough on this plant and serious growers will eliminate even the single shovel of compost.
Spring pruning encourages thicker growth and more flower production so do trim the plant in the early spring just when the buds start to swell on the stems.
................Blooming ............................
http://www.gardenguides.com/how-to/tipstechniques/herbs/lavender.asp
The second year, they bloomed in the spring and were well on their way to maturity.

Most herbs---and that includes lavender---do best in poor soil. I'd stop fertilizing.
If you're growing yours as a houseplant, try setting it outdoors into the ground. Lavender has two main requirements: full sun, and excellent drainage. They hate to be soggy!
Water lightly until it becomes established, then water infrequently. If it's one of the hardier types, it will probably be happier left in the ground. Good luck

The trick to Lavender, as well as other aromatics (like rosemary for example) is aerated soil and cool roots. How does one attain this state - in full sun - you ask? I plant these sort of plants in a soil-crumbled up mulch-mix and a bit of pea gravel to ensure drainage. The hole dug is shallow, the plant set in it and the mixture packed in and around it, then pressed in but ending up with a cone... above ground-level. Then, my final touch is a layer of mulch around this cone or mound, then water well. My secret - you're not going to believe it... is Epsom salt. Get a small bag or box, yes the same kind you throw in the bath, and add a tablespoon to the plant, water it in. Osmokote is my favorite fertilizer and Milorganite, an organic fertilizer is my second favorite... neither will burn a plant. Keep rainwater and use on your plants as well. They really respond. Good luck & happy planting.