La Chapelle-sur-Oreuse is a commune. It is found in the Yonne department in the center of France.