To mirkosassetti or unclecheese - not sure who added the 'copyOnImport' option but thank you! Much appreciated.
If anyone finding this thread is wondering how to disable the duplication of assets in a FileDataObjectManager or ImageDataObjectManager you can do it something like this:
$manager = new ImageDataObjectManager(
$manager->copyOnImport = false;