Freud upset a lot of people when he made essentially the same observations. Libido, sexual energy, was to him the basic energy of life, deriving from our inborn desire to form connections (cathexes) with the world, investing our energy of desire and pleasure in people, objects, and activities.

All our pleasures light up the same neural pathways in the brain, pathways that are also associated with motivation and desire.

The way you describe this vital energy certainly matches my experience. I need to reach out, to learn, to create, to share with my most intimate companions the great life force that enables us to be. When a sexual connection is possible, that's wonderful, but the energy is the same even in non-sexual friendships and activities.