I just like the taste of coffee but for some reason I do not like the taste of decalf. So the “caffeine” must give coffee a certain taste.

Decaf uses some pretty vile solvents to extract the caffeine. Methylene chloride (aka paint stripper) comes to mind. Maybe you’re tasting the toxic residue in the decaf.