Can you get too much sugar from fruits?

I haven't been eating anything with added sugar lately (processed foods) and all I've had to eat today was falafel, tabouli salad and some hummus. But I also ate a banana for breakfast and an orange as a mid day snack and apparently I've doubled the daily recommended sugar intake from just those two fruits. Is excess sugar from fruit unhealthy? Can it cause weight gain like refined sugars?