The most common nut used in banana bread is walnuts. However, other nuts can be used as well, such as pecans, hazelnuts, cashews, almonds, or peanuts. If you prefer nut-free banana bread, you can omit the nuts altogether.