You can upgrade your heroes using hero EXP items. You can only upgrade the activated hero, and upgrading heroes earns skill points that can be used to upgrade hero skills.