Preheat oven to 350 degrees Fahrenheit.
Butter a 9 by 13 inch baking dish. Melt the remaining butter.
Tear the bread into approximately 1 inch pieces and stuff them into the buttered baking dish.
In a bowl, mix the eggs, 2 cups of the sugar, light brown sugar, melted butter, milk, half and half, vanilla, rum, and brandy.
Pour the mixture evenly over the bread.
Sprinkle with the remaining sugar.
Bake for about 1 hour, or until cooked through.
Serve with warm with whipped cream and Vanilla-Bourbon Sauce or Brandy-Rum Sauce.