Grease a loaf pan with pam spray or butter. Set aside. Chop the bread into cubes. In a container, beat the egg yolks then whisk in milk, heavy whipping cream, sugar, and vanilla. Stir in the bread pieces into the custard mix. Cover the container then store it in the fridge to soak for 2-3 hours. Once ready to bake, caramelize apple with brown sugar in a small pot. This takes about 12-15 minutes or so. Keep stirring so it doesn’t burn at the bottom.