Toss berries with brown sugar, 1 teaspoon of the pumpkin pie spice and vanilla. Set aside.
Mix melted butter and remaining 1 teaspoon pumpkin pie spice. Brush on both sides of pound cake slices.
Grill over medium heat until lightly toasted, turning once. Spoon berry mixture over pound cake. Serve with whipped topping, if desired.