That's a kernel thing that dates from the 90s where allocating a quarter to half of your RAM for write caching made sense. These days we have more RAM than the USB stick we're writing to, so it fits well into the buffer to be flushed asynchronously.
You can tweak some sysctls to make it less of a thing: https://unix.stackexchange.com/a/640826