I've been digging a bit, trying to solve the problem and there appears to be no way to do this.
I do not want to permanently re-download the driver but I have a testing environment with multiple chrome versions and I want to run them simultaneously.
The driver SB uses is '\Lib\site-packages\seleniumbase\drivers\uc_driver.exe' or DRIVER_DIR = os.path.dirname(os.path.realpath(drivers.__file__))
Or it uses chromedriver,msedgedriver etc, but always the same vanilla type name in the python package directory.

So the driver file is not version tagged and the location appears to be hardcoded to the package directory of the drivers python file.

Is there a specific reason why this was done so restrictive and in a folder that is normally only managed by python package installation ?
Any intention to customize this or version tag it ?