Armentières-sur-Ourcq is a commune. It is found in the region Picardie in the Aisne department in the north of France.