The gold and silver markets have given back their modest early price gains in late-morning action Wednesday.