Preheat the oven to 375 degrees. Peel and dice all of the peaches, squeezing lemon juice over them as you go. Add the sugar to the peaches and stir.
In a mixing bowl, combine butter, brown sugar, oats, salt, and lavender. Using your hands, mix until the ingredients come together.
Pour the peaches into a 9-inch pie dish or other baking dish. Evenly sprinkle the crisp topping over the peaches. Bake for 30-35 minutes until the top is golden brown and the peaches are bubbling.
Let the crisp sit for 10 minutes before serving. Serve with vanilla ice cream!