If I’m “holding” the option, am I buying the option?

Yes; holding the option, being long the option, or buying the option are all synonymous.