Oxygen is an abstract concept and oxygen is a concrete thing. Oxygen is made up of oxygen.

If there is O in the chemical formula of a substance, then there is oxygen in the elements that make up the substance. But oxygen is just oxygen. Without this substance O2, we can't breathe.