At the time the things were taken, it wasn't considered unethical but more like a spoil of war or conquering. People took artifacts back with them sort of like tourists buy things now and take back home. Look at what controvery there has been with the Elgin Marbles.