ERR_EMPTY_RESPONSE when running multiple instances of the main script

[roman-boix-delectatech]

Hi everyone
I'm facing some weird behavior trying to run a script that initiates SB instance.
I have this code inside main.py file:

# all the imports
# some code 

raw_proxy = get_proxy_timezone_sync()
proxy = raw_proxy['formatted']
tz = raw_proxy['timezone']
resolutions = ['1920,1080', '1366,768', '1536,864', '1280,720']
locale_code = ['ca', 'en_us', 'en_au', 'en_gb', 'es']
dark_mode = [False, True]
slow = [False, True]

print(f'\t Init Selenium Base...{proxy}')
with SB(uc=True, proxy=proxy, locale_code=choice(locale_code), xvfb=True, xvfb_metrics=choice(resolutions), slow=choice(slow), dark_mode=choice(dark_mode)) as sb:
    tz_params = {'timezoneId': tz}
    sb.execute_cdp_cmd('Emulation.setTimezoneOverride', tz_params)
    print('\t Execute CDP...')
    sb.activate_cdp_mode("about:blank")
    print('\t Open link...')
    sb.cdp.open(url)
    sb.cdp.sleep(round(uniform(2, 5), 1))
    str_html_data = sb.cdp.get_page_source()

# more code

If I run this file with python3 -u main.py everything works well, but if I run multiples instances of this file with supervisor or with:

nohup python3 -u main.py > x1 &
nohup python3 -u main.py > x2 &
...
nohup python3 -u main.py > xN &

seleniumbase returns the typical page of ERR_EMPTY_RESPONSE.

The server where it's been run has 64 cores and 128Gb of RAM, so resources should not be the problem.

Any insights, best practices, or tips would be greatly appreciated.

Thanks in advice

[mdmintz]

You can't mix execute_cdp_cmd with CDP Mode, as execute_cdp_cmd is WebDriver-based, and CDP Mode is CDP-based. Two very different APIs. If you're using CDP Mode, see this example for changing timezone/geolocation:

• SeleniumBase/examples/cdp_mode/raw_timezone_sb.py.

Also, you may want to try things without setting a proxy.

[roman-boix-delectatech]

I had not seen this way of setting the timezone.

After trying and debugging, the problem were the proxies, as you mentioned. I don't know why, but sometimes when running several instances, the authentication of the proxies begin to fail, adding the IP to the proxies whitelist solves the problem.

Thank you so much