Even if something isn’t actively being written on your USB drive, your computer might be caching some data and running background processes. So, the users of all operating systems (even Windows users with quick removal setting enabled) are advised to always manually eject the USB drive and avoid any corruption of data.
https://fossbytes.com/why-safely-eject-usb-drive-media-pc-reason-explained/