One of the keys to a successful multi-generational vacation is plenty of communication up-front. Make sure you involve everyone in the planning process. Have each person in your group, including your youngest members, offer at least one thing they really want to see or do and make sure it happens.
Not only will this ensure everyone has a good time, it takes the pressure off one person feeling responsible for everyone's happiness.