Preheat the oven to 350°F (175°C).
Cut the bread into 1.5-inch thick slices and overlap them to fit a 9x13-inch baking dish.
In a large bowl, whisk together the eggs, milk, melted butter, brown sugar, vanilla flavoring, cinnamon, ginger, nutmeg, and salt.
Pour the egg mixture over the bread slices in the baking dish.
Sprinkle the chopped pecans on top of the bread.
Pour the remaining butter and sugar mixture at the bottom of the dish to create a caramel base.
Bake for 30-35 minutes or until the top is golden brown.
If the top browns too quickly, cover with foil for the last 10 minutes of baking.
Let the casserole cool slightly before serving to allow the custard to set.