Position rack in center of oven and preheat to 350°F. Line 12 standard (1/3-cup) muffin cups with paper liners.
Mash bananas with fork in another medium bowl until smooth. Mix sour cream and vanilla into bananas.Using electric mixer, beat sugar and butter in large bowl until light and fluffy, about 3 minutes. Add egg and egg yolk and beat until well blended.
Whisk flour, baking powder, baking soda, and salt in medium bowl. Add flour mixture in 3 additions alternately with banana-sour cream mixture in 2 additions, beginning and ending with flour mixture and beating just until blended after each addition.
Divide batter among prepared muffin cups (generous 1/4 cup for each).Bake cupcakes until tester inserted into center of each comes out clean, about 20 minutes. Transfer cupcakes to rack and let cool completely.
Sift powdered sugar into large bowl. Add cream cheese, butter, and peanut butter. Using electric mixer, beat mixture until smooth. Add more powdered sugar if needed to thicken up. Spread frosting over top of cupcakes, dividing equally.