Jaundice is the medical term for a yellow tinge in the skin's color. The yellow color is caused by a substance called bilirubin, which is made normally in the body. Babies with higher than normal blood levels of bilirubin, a condition called "hyperbilirubinemia, " develop this yellow color when bilirubin builds up in the skin.